2023-06-08T03:37:18.234 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-08T03:37:18.235 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298110 --name xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi --verbose --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_xiubli@teuthology -- /home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298110/orig.config.yaml 2023-06-08T03:37:18.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-08T03:37:18.382 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298110 branch: wip-lxb-fscrypt-20230607-0901 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7298110' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-lxb-fscrypt-20230607-0901 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lxb-fscrypt-20230607-0901 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b owner: scheduled_xiubli@teuthology priority: 110 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-lxb-fscrypt-20230607-0901 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRaG+PAPw62/BW/RBOXAvbM4PUsL4i7Rc0Shhz92b1K4E6SMNUxIiorR97V5zrtTA1qeMTYJrCttsRM/n0RX6f1IMG/FVMnk5oEi1qCH/S9LQvf1KshuJFUlJlWOpSJ1zXwGPyVUM7+eiUMFo/DqYMOEVaRuDUJt8F7ip8FyoR6/vsQkHbCuyweQAXyi89e31lNLNfq3/BBbXRwsndwEapeZpbeNsZk4RsStn4vBhaIRf3hPPc5mBWJ0vjph7n7gb+fMi1oLMdB/PsByRdN2PJ/+UYpwu5T92smrI4p+8XxDuvJ0zBHIeF4NwmWuUxgac2Va31Wh4ncgHvIKzAne76YUqcCinP8sq1tusvC8XIIaCZlc0yIx7owdqwjEXAYuNIqWReSNoMtdMgAAG3eA1zIVAqQLUc23HzumkyIgMjP4Lo23idrcbRycqd95ZDtaQtWS8ApZGKIlDhR9zCQjSWyZkoCs/p2yP9aqURymb7Bf+VzBvLMCkiubTCo9uGL28= smithi169.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsunnVApFntDWJB8XW8mAq+MO/vNpp+IAsVun01ZGarX9+HEAGuO3SyIY0QN6Y+aSs02HYv+xeYnsUxGEynJZLUB7Qz0x0nB/XKOPe6f0IMnPM6N+4L70LUDoBL8NMsNjpr7LiRNJtFbkzoM7HAV8AMQswprkP33OmcBGmfru3PAwHBDmd/oKCs5ileVZmjzpCFJ+sujlNwtP6SsCFKgUhlkoQH6b9Vh2lJzv4ElSdZsSWS0IXGef2U8QgHNXAOM5zTsIjHzr/P4RhdhBLQJMuu+7vnBzkxLT3bvMS5JS3HwPTQ8xM9u1TXFVkRPyZyi2MhGxi6D4ZnDp/Oxs+iycYERaDSFB95ZdsZmsHs3Eza14qSTzfnYPJ/Cax2mB1kHLZGnN3BFWj4hEcl99MuPwayW8bbJRw/P7SZob6ROPdul+w0YekNdl6951RUqMCBcihH/bZQVQpbxhkQsg7v3ny7YojfJ2plb3ENbXAq/cJOE/3YZtqNd51Rcrp+r9o5ZU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61 timestamp: 2023-06-08_03:32:08 tube: smithi user: xiubli verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-08T03:37:18.382 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa; will attempt to use it 2023-06-08T03:37:18.383 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa/tasks 2023-06-08T03:37:18.383 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-08T03:37:18.386 INFO:teuthology.task.internal:Checking packages... 2023-06-08T03:37:18.418 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a02638f808b8fe11bccdd01222c0e6e2eb71120b' 2023-06-08T03:37:18.418 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-08T03:37:18.418 INFO:teuthology.packaging:ref: None 2023-06-08T03:37:18.419 INFO:teuthology.packaging:tag: None 2023-06-08T03:37:18.419 INFO:teuthology.packaging:branch: wip-lxb-fscrypt-20230607-0901 2023-06-08T03:37:18.419 INFO:teuthology.packaging:sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-08T03:37:18.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-lxb-fscrypt-20230607-0901 2023-06-08T03:37:18.638 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4313.ga02638f8 2023-06-08T03:37:18.639 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-08T03:37:18.646 INFO:teuthology.task.internal:no buildpackages task found 2023-06-08T03:37:18.646 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-08T03:37:18.654 INFO:teuthology.task.internal:Saving configuration 2023-06-08T03:37:18.671 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-08T03:37:18.682 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-08T03:37:18.708 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298110', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-08 03:32:14.930367', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJpF8kDFLgqO+ph7eYLhXcyRXJGjZ2M24l1l6eZvCi96B8bt585nUI64cvANW8fEb2y/CttRA3CaBIu35bConWg='} 2023-06-08T03:37:18.734 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298110', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-08 03:32:14.932284', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCBXtgQZnuwaajXjtuxQMoYnFumfSzzTy5b47q8DfcHEYEu6GL8kQ/L7yqB43wjwAdJ4DO7wJOpnIgC8M55g+hs='} 2023-06-08T03:37:18.734 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-08T03:37:18.739 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-08T03:37:18.740 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-08T03:37:18.740 INFO:teuthology.run_tasks:Running task console_log... 2023-06-08T03:37:18.821 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff3aa08bf70>, signals=[15]) 2023-06-08T03:37:18.822 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-08T03:37:18.828 INFO:teuthology.task.internal:Opening connections... 2023-06-08T03:37:18.828 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2023-06-08T03:37:18.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:37:18.904 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2023-06-08T03:37:18.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:37:18.973 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-08T03:37:18.979 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2023-06-08T03:37:19.002 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2023-06-08T03:37:19.003 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-06-08T03:37:19.065 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2023-06-08T03:37:19.066 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8" 2023-06-08T03:37:19.066 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2023-06-08T03:37:19.066 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2023-06-08T03:37:19.067 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8" 2023-06-08T03:37:19.067 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-06-08T03:37:19.067 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-08T03:37:19.067 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-06-08T03:37:19.068 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-08T03:37:19.068 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2023-06-08T03:37:19.068 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T03:37:19.068 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T03:37:19.068 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-08T03:37:19.069 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-06-08T03:37:19.095 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-06-08T03:37:19.116 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-06-08T03:37:19.116 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-06-08T03:37:19.176 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-06-08T03:37:19.177 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2023-06-08T03:37:19.177 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-06-08T03:37:19.177 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-06-08T03:37:19.177 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2023-06-08T03:37:19.177 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2023-06-08T03:37:19.177 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-08T03:37:19.178 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-06-08T03:37:19.178 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-08T03:37:19.178 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-06-08T03:37:19.178 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T03:37:19.178 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T03:37:19.178 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-08T03:37:19.178 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-06-08T03:37:19.211 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-08T03:37:19.222 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-08T03:37:19.282 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-08T03:37:19.282 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2023-06-08T03:37:19.285 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2023-06-08T03:37:19.305 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-08T03:37:19.312 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-08T03:37:19.313 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2023-06-08T03:37:19.347 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2023-06-08T03:37:19.375 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-08T03:37:19.433 INFO:teuthology.run_tasks:Running task kernel... 2023-06-08T03:37:19.448 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-06-08T03:37:19.449 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-06-08T03:37:19.449 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-06-08T03:37:19.450 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-08T03:37:19.450 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-08T03:37:19.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T03:37:19.471 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-06-08T03:37:19.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T03:37:19.474 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-06-08T03:37:19.623 DEBUG:teuthology.task.kernel:sha1 for client.1 is 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-08T03:37:19.623 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "10b2f20a4f46c803bb730efc73498f97d45082e7"... 2023-06-08T03:37:19.623 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2023-06-08T03:37:19.644 INFO:teuthology.orchestra.run.smithi169.stdout:4.18.0-489.el8.x86_64 2023-06-08T03:37:19.645 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-08T03:37:19.645 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-08T03:37:19.646 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum upgrade -y linux-firmware 2023-06-08T03:37:19.719 DEBUG:teuthology.task.kernel:sha1 for client.0 is 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-08T03:37:19.720 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "10b2f20a4f46c803bb730efc73498f97d45082e7"... 2023-06-08T03:37:19.720 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2023-06-08T03:37:19.742 INFO:teuthology.orchestra.run.smithi016.stdout:4.18.0-489.el8.x86_64 2023-06-08T03:37:19.743 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-08T03:37:19.743 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-08T03:37:19.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum upgrade -y linux-firmware 2023-06-08T03:37:24.602 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 8 - AppStream 13 MB/s | 29 MB 00:02 2023-06-08T03:37:24.699 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - AppStream 12 MB/s | 29 MB 00:02 2023-06-08T03:37:34.094 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 8 - BaseOS 9.9 MB/s | 38 MB 00:03 2023-06-08T03:37:34.457 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - BaseOS 8.9 MB/s | 38 MB 00:04 2023-06-08T03:37:40.382 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2023-06-08T03:37:40.461 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 8 - Extras 36 kB/s | 18 kB 00:00 2023-06-08T03:37:41.041 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.6 kB 00:00 2023-06-08T03:37:41.111 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 8 - Extras common packages 14 kB/s | 6.6 kB 00:00 2023-06-08T03:37:43.625 INFO:teuthology.orchestra.run.smithi169.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-08T03:37:43.804 INFO:teuthology.orchestra.run.smithi016.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-08T03:37:45.603 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 16 MB 00:01 2023-06-08T03:37:46.088 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 16 MB 00:02 2023-06-08T03:37:49.343 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 352 kB/s | 24 kB 00:00 2023-06-08T03:37:50.121 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 447 kB/s | 24 kB 00:00 2023-06-08T03:37:52.784 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2023-06-08T03:37:52.785 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2023-06-08T03:37:52.785 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repo Size 2023-06-08T03:37:52.785 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2023-06-08T03:37:52.785 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2023-06-08T03:37:52.786 INFO:teuthology.orchestra.run.smithi169.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-06-08T03:37:52.786 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T03:37:52.786 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2023-06-08T03:37:52.786 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2023-06-08T03:37:52.786 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 1 Package 2023-06-08T03:37:52.786 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T03:37:52.786 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 266 M 2023-06-08T03:37:52.787 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2023-06-08T03:37:53.705 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2023-06-08T03:37:53.706 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2023-06-08T03:37:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repo Size 2023-06-08T03:37:53.706 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2023-06-08T03:37:53.706 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrading: 2023-06-08T03:37:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-06-08T03:37:53.706 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:37:53.706 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2023-06-08T03:37:53.707 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2023-06-08T03:37:53.707 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 1 Package 2023-06-08T03:37:53.707 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:37:53.707 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 266 M 2023-06-08T03:37:53.707 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2023-06-08T03:38:10.567 INFO:teuthology.orchestra.run.smithi169.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 15 MB/s | 266 MB 00:17 2023-06-08T03:38:10.567 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2023-06-08T03:38:10.568 INFO:teuthology.orchestra.run.smithi169.stdout:Total 15 MB/s | 266 MB 00:17 2023-06-08T03:38:12.144 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2023-06-08T03:38:12.210 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2023-06-08T03:38:12.211 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2023-06-08T03:38:13.881 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2023-06-08T03:38:13.913 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2023-06-08T03:38:15.613 INFO:teuthology.orchestra.run.smithi016.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 12 MB/s | 266 MB 00:21 2023-06-08T03:38:15.613 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2023-06-08T03:38:15.614 INFO:teuthology.orchestra.run.smithi016.stdout:Total 12 MB/s | 266 MB 00:21 2023-06-08T03:38:17.272 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2023-06-08T03:38:17.354 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2023-06-08T03:38:17.355 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2023-06-08T03:38:19.100 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2023-06-08T03:38:19.133 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2023-06-08T03:38:31.723 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2023-06-08T03:38:32.092 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-08T03:38:32.341 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-08T03:38:32.566 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-08T03:38:32.566 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-08T03:38:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-08T03:38:33.282 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T03:38:33.282 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2023-06-08T03:38:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-06-08T03:38:33.283 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T03:38:33.283 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2023-06-08T03:38:33.458 INFO:teuthology.task.kernel:Downloading kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.1... 2023-06-08T03:38:33.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-08T03:38:33.675 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/centos/8/flavors/default/x86_64/ 2023-06-08T03:38:33.675 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_rc2_g10b2f20a4f46-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/centos/8/flavors/default/x86_64/ --input-file=- 2023-06-08T03:38:33.677 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi169.front.sepia.ceph.com to complete... 2023-06-08T03:38:37.985 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2023-06-08T03:38:38.361 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-08T03:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-08T03:38:38.830 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-08T03:38:38.831 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-08T03:38:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-08T03:38:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:38:39.533 INFO:teuthology.orchestra.run.smithi016.stdout:Upgraded: 2023-06-08T03:38:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-06-08T03:38:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:38:39.533 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2023-06-08T03:38:39.730 INFO:teuthology.task.kernel:Downloading kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.0... 2023-06-08T03:38:39.730 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-08T03:38:39.874 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/centos/8/flavors/default/x86_64/ 2023-06-08T03:38:39.874 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_rc2_g10b2f20a4f46-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/centos/8/flavors/default/x86_64/ --input-file=- 2023-06-08T03:38:39.876 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi016.front.sepia.ceph.com to complete... 2023-06-08T03:38:52.806 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08 03:38:52 URL:https://2.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/centos/8/flavors/default/x86_64/kernel-6.4.0_rc2_g10b2f20a4f46-1.x86_64.rpm [379752256/379752256] -> "/tmp/kernel.x86_64.rpm" [1] 2023-06-08T03:38:52.806 INFO:teuthology.orchestra.run.smithi169.stderr:FINISHED --2023-06-08 03:38:52-- 2023-06-08T03:38:52.807 INFO:teuthology.orchestra.run.smithi169.stderr:Total wall clock time: 19s 2023-06-08T03:38:52.807 INFO:teuthology.orchestra.run.smithi169.stderr:Downloaded: 1 files, 362M in 19s (19.2 MB/s) 2023-06-08T03:38:52.808 INFO:teuthology.task.kernel:Installing kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.1... 2023-06-08T03:38:52.808 DEBUG:teuthology.orchestra.run.smithi169:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-06-08T03:38:54.511 INFO:teuthology.orchestra.run.smithi169.stdout:Verifying... ######################################## 2023-06-08T03:38:54.554 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing... ######################################## 2023-06-08T03:38:54.664 INFO:teuthology.orchestra.run.smithi169.stdout:Updating / installing... 2023-06-08T03:39:00.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08 03:39:00 URL:https://2.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/centos/8/flavors/default/x86_64/kernel-6.4.0_rc2_g10b2f20a4f46-1.x86_64.rpm [379752256/379752256] -> "/tmp/kernel.x86_64.rpm" [1] 2023-06-08T03:39:00.742 INFO:teuthology.orchestra.run.smithi016.stderr:FINISHED --2023-06-08 03:39:00-- 2023-06-08T03:39:00.743 INFO:teuthology.orchestra.run.smithi016.stderr:Total wall clock time: 21s 2023-06-08T03:39:00.743 INFO:teuthology.orchestra.run.smithi016.stderr:Downloaded: 1 files, 362M in 21s (17.7 MB/s) 2023-06-08T03:39:00.744 INFO:teuthology.task.kernel:Installing kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.0... 2023-06-08T03:39:00.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-06-08T03:39:02.494 INFO:teuthology.orchestra.run.smithi016.stdout:Verifying... ######################################## 2023-06-08T03:39:02.539 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing... ######################################## 2023-06-08T03:39:02.655 INFO:teuthology.orchestra.run.smithi016.stdout:Updating / installing... 2023-06-08T03:39:32.445 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-6.4.0_rc2_g10b2f20a4f46-1 ######################################## 2023-06-08T03:39:42.999 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-6.4.0_rc2_g10b2f20a4f46-1 ######################################## 2023-06-08T03:39:55.116 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-06-08T03:39:55.117 DEBUG:teuthology.orchestra.run.smithi169:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-06-08T03:39:55.173 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/System.map-6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:39:55.173 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/config-6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:39:55.173 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:39:55.174 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:39:55.174 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel 2023-06-08T03:39:55.174 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch 2023-06-08T03:39:55.174 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86 2023-06-08T03:39:55.174 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto 2023-06-08T03:39:55.174 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-08T03:39:55.174 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-08T03:39:55.175 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-08T03:39:55.175 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-08T03:39:55.175 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-08T03:39:55.175 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-08T03:39:55.175 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-08T03:39:55.175 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crc32c-intel.ko 2023-06-08T03:39:55.175 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-08T03:39:55.175 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-08T03:39:55.176 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-08T03:39:55.176 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-08T03:39:55.176 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-08T03:39:55.176 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-08T03:39:55.176 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-08T03:39:55.176 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-08T03:39:55.176 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-08T03:39:55.177 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-08T03:39:55.177 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-08T03:39:55.177 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-08T03:39:55.177 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel 2023-06-08T03:39:55.177 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu 2023-06-08T03:39:55.177 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce 2023-06-08T03:39:55.177 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-08T03:39:55.177 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm 2023-06-08T03:39:55.178 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-08T03:39:55.178 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-08T03:39:55.178 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm.ko 2023-06-08T03:39:55.178 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto 2023-06-08T03:39:55.178 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ansi_cprng.ko 2023-06-08T03:39:55.178 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/anubis.ko 2023-06-08T03:39:55.178 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/arc4.ko 2023-06-08T03:39:55.178 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx 2023-06-08T03:39:55.179 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_memcpy.ko 2023-06-08T03:39:55.179 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_pq.ko 2023-06-08T03:39:55.179 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-08T03:39:55.179 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_tx.ko 2023-06-08T03:39:55.179 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_xor.ko 2023-06-08T03:39:55.179 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/raid6test.ko 2023-06-08T03:39:55.179 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authenc.ko 2023-06-08T03:39:55.180 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authencesn.ko 2023-06-08T03:39:55.180 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blake2b_generic.ko 2023-06-08T03:39:55.180 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_common.ko 2023-06-08T03:39:55.180 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_generic.ko 2023-06-08T03:39:55.180 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/camellia_generic.ko 2023-06-08T03:39:55.180 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast5_generic.ko 2023-06-08T03:39:55.180 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast6_generic.ko 2023-06-08T03:39:55.181 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast_common.ko 2023-06-08T03:39:55.181 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ccm.ko 2023-06-08T03:39:55.181 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cmac.ko 2023-06-08T03:39:55.181 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crc32_generic.ko 2023-06-08T03:39:55.181 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_engine.ko 2023-06-08T03:39:55.181 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_user.ko 2023-06-08T03:39:55.181 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cts.ko 2023-06-08T03:39:55.181 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/des_generic.ko 2023-06-08T03:39:55.182 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/dh_generic.ko 2023-06-08T03:39:55.182 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/echainiv.ko 2023-06-08T03:39:55.182 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/essiv.ko 2023-06-08T03:39:55.182 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/fcrypt.ko 2023-06-08T03:39:55.182 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/khazad.ko 2023-06-08T03:39:55.182 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4.ko 2023-06-08T03:39:55.182 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4hc.ko 2023-06-08T03:39:55.183 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/md4.ko 2023-06-08T03:39:55.183 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/michael_mic.ko 2023-06-08T03:39:55.183 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcbc.ko 2023-06-08T03:39:55.183 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcrypt.ko 2023-06-08T03:39:55.183 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/rmd160.ko 2023-06-08T03:39:55.183 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/seed.ko 2023-06-08T03:39:55.183 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/serpent_generic.ko 2023-06-08T03:39:55.183 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tcrypt.ko 2023-06-08T03:39:55.184 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tea.ko 2023-06-08T03:39:55.184 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_common.ko 2023-06-08T03:39:55.184 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_generic.ko 2023-06-08T03:39:55.184 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/vmac.ko 2023-06-08T03:39:55.184 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/wp512.ko 2023-06-08T03:39:55.184 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xcbc.ko 2023-06-08T03:39:55.184 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xor.ko 2023-06-08T03:39:55.185 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xxhash_generic.ko 2023-06-08T03:39:55.185 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers 2023-06-08T03:39:55.185 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi 2023-06-08T03:39:55.185 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-08T03:39:55.185 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_pad.ko 2023-06-08T03:39:55.185 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/custom_method.ko 2023-06-08T03:39:55.185 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ec_sys.ko 2023-06-08T03:39:55.185 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/platform_profile.ko 2023-06-08T03:39:55.186 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbs.ko 2023-06-08T03:39:55.186 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbshc.ko 2023-06-08T03:39:55.186 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/video.ko 2023-06-08T03:39:55.186 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata 2023-06-08T03:39:55.186 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/acard-ahci.ko 2023-06-08T03:39:55.186 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci_platform.ko 2023-06-08T03:39:55.186 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ata_generic.ko 2023-06-08T03:39:55.186 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci_platform.ko 2023-06-08T03:39:55.187 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_acpi.ko 2023-06-08T03:39:55.187 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ali.ko 2023-06-08T03:39:55.187 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_amd.ko 2023-06-08T03:39:55.187 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_artop.ko 2023-06-08T03:39:55.187 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atiixp.ko 2023-06-08T03:39:55.187 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atp867x.ko 2023-06-08T03:39:55.187 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd640.ko 2023-06-08T03:39:55.188 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd64x.ko 2023-06-08T03:39:55.188 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cypress.ko 2023-06-08T03:39:55.188 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_efar.ko 2023-06-08T03:39:55.188 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt366.ko 2023-06-08T03:39:55.188 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt37x.ko 2023-06-08T03:39:55.188 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-08T03:39:55.188 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-08T03:39:55.189 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it8213.ko 2023-06-08T03:39:55.189 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it821x.ko 2023-06-08T03:39:55.189 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_jmicron.ko 2023-06-08T03:39:55.189 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_marvell.ko 2023-06-08T03:39:55.189 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_mpiix.ko 2023-06-08T03:39:55.189 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_netcell.ko 2023-06-08T03:39:55.189 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ninja32.ko 2023-06-08T03:39:55.189 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87410.ko 2023-06-08T03:39:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87415.ko 2023-06-08T03:39:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_oldpiix.ko 2023-06-08T03:39:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_opti.ko 2023-06-08T03:39:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_optidma.ko 2023-06-08T03:39:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pcmcia.ko 2023-06-08T03:39:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-08T03:39:55.190 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-08T03:39:55.191 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_piccolo.ko 2023-06-08T03:39:55.191 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rdc.ko 2023-06-08T03:39:55.191 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sch.ko 2023-06-08T03:39:55.191 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_serverworks.ko 2023-06-08T03:39:55.191 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sil680.ko 2023-06-08T03:39:55.191 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sis.ko 2023-06-08T03:39:55.191 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sl82c105.ko 2023-06-08T03:39:55.191 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_triflex.ko 2023-06-08T03:39:55.192 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_via.ko 2023-06-08T03:39:55.192 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pdc_adma.ko 2023-06-08T03:39:55.192 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_inic162x.ko 2023-06-08T03:39:55.192 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_mv.ko 2023-06-08T03:39:55.192 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_nv.ko 2023-06-08T03:39:55.192 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_promise.ko 2023-06-08T03:39:55.192 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_qstor.ko 2023-06-08T03:39:55.193 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil.ko 2023-06-08T03:39:55.193 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil24.ko 2023-06-08T03:39:55.193 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sis.ko 2023-06-08T03:39:55.193 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_svw.ko 2023-06-08T03:39:55.193 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sx4.ko 2023-06-08T03:39:55.193 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_uli.ko 2023-06-08T03:39:55.193 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_via.ko 2023-06-08T03:39:55.194 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_vsc.ko 2023-06-08T03:39:55.194 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay 2023-06-08T03:39:55.194 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ks0108.ko 2023-06-08T03:39:55.194 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/base 2023-06-08T03:39:55.194 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/base/regmap 2023-06-08T03:39:55.194 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/base/regmap/regmap-i2c.ko 2023-06-08T03:39:55.194 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma 2023-06-08T03:39:55.194 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/bcma.ko 2023-06-08T03:39:55.195 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block 2023-06-08T03:39:55.195 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe 2023-06-08T03:39:55.195 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/aoe.ko 2023-06-08T03:39:55.195 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/brd.ko 2023-06-08T03:39:55.195 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd 2023-06-08T03:39:55.195 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/drbd.ko 2023-06-08T03:39:55.195 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/floppy.ko 2023-06-08T03:39:55.195 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/loop.ko 2023-06-08T03:39:55.196 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx 2023-06-08T03:39:55.196 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-08T03:39:55.196 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/nbd.ko 2023-06-08T03:39:55.196 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk 2023-06-08T03:39:55.196 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/null_blk.ko 2023-06-08T03:39:55.196 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/pktcdvd.ko 2023-06-08T03:39:55.196 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/rbd.ko 2023-06-08T03:39:55.197 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/virtio_blk.ko 2023-06-08T03:39:55.197 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback 2023-06-08T03:39:55.197 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-08T03:39:55.197 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkfront.ko 2023-06-08T03:39:55.197 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram 2023-06-08T03:39:55.197 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/zram.ko 2023-06-08T03:39:55.197 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char 2023-06-08T03:39:55.197 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hangcheck-timer.ko 2023-06-08T03:39:55.198 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random 2023-06-08T03:39:55.198 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-08T03:39:55.198 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-08T03:39:55.198 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-08T03:39:55.198 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/via-rng.ko 2023-06-08T03:39:55.198 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-08T03:39:55.198 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi 2023-06-08T03:39:55.198 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-08T03:39:55.199 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-08T03:39:55.199 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-08T03:39:55.199 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-08T03:39:55.199 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-08T03:39:55.199 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-08T03:39:55.199 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/lp.ko 2023-06-08T03:39:55.200 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave 2023-06-08T03:39:55.201 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/mwave.ko 2023-06-08T03:39:55.201 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ppdev.ko 2023-06-08T03:39:55.201 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tlclk.ko 2023-06-08T03:39:55.201 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm 2023-06-08T03:39:55.202 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm.ko 2023-06-08T03:39:55.202 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-08T03:39:55.202 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-08T03:39:55.202 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-08T03:39:55.202 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_tis.ko 2023-06-08T03:39:55.202 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-06-08T03:39:55.202 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/uv_mmtimer.ko 2023-06-08T03:39:55.203 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/virtio_console.ko 2023-06-08T03:39:55.203 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq 2023-06-08T03:39:55.203 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-06-08T03:39:55.203 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-08T03:39:55.203 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-08T03:39:55.203 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-06-08T03:39:55.203 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/powernow-k8.ko 2023-06-08T03:39:55.203 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-08T03:39:55.204 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto 2023-06-08T03:39:55.204 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp 2023-06-08T03:39:55.204 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-08T03:39:55.204 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp.ko 2023-06-08T03:39:55.204 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel 2023-06-08T03:39:55.204 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat 2023-06-08T03:39:55.204 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common 2023-06-08T03:39:55.205 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-08T03:39:55.205 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-06-08T03:39:55.205 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-08T03:39:55.205 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-aes.ko 2023-06-08T03:39:55.205 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-sha.ko 2023-06-08T03:39:55.205 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio 2023-06-08T03:39:55.205 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-08T03:39:55.205 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca 2023-06-08T03:39:55.206 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/dca.ko 2023-06-08T03:39:55.206 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/devfreq 2023-06-08T03:39:55.206 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-06-08T03:39:55.206 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma 2023-06-08T03:39:55.206 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw 2023-06-08T03:39:55.206 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-08T03:39:55.206 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat 2023-06-08T03:39:55.207 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-08T03:39:55.207 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac 2023-06-08T03:39:55.207 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/amd64_edac.ko 2023-06-08T03:39:55.207 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/e752x_edac.ko 2023-06-08T03:39:55.207 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/edac_mce_amd.ko 2023-06-08T03:39:55.207 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3000_edac.ko 2023-06-08T03:39:55.207 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3200_edac.ko 2023-06-08T03:39:55.207 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5100_edac.ko 2023-06-08T03:39:55.208 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5400_edac.ko 2023-06-08T03:39:55.208 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7300_edac.ko 2023-06-08T03:39:55.208 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7core_edac.ko 2023-06-08T03:39:55.208 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i82975x_edac.ko 2023-06-08T03:39:55.208 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ie31200_edac.ko 2023-06-08T03:39:55.208 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/sb_edac.ko 2023-06-08T03:39:55.208 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/x38_edac.ko 2023-06-08T03:39:55.209 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware 2023-06-08T03:39:55.209 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/edd.ko 2023-06-08T03:39:55.209 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-08T03:39:55.209 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio 2023-06-08T03:39:55.209 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ich.ko 2023-06-08T03:39:55.209 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-08T03:39:55.209 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid 2023-06-08T03:39:55.209 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-appleir.ko 2023-06-08T03:39:55.210 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-aureal.ko 2023-06-08T03:39:55.210 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-axff.ko 2023-06-08T03:39:55.210 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-dr.ko 2023-06-08T03:39:55.210 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elecom.ko 2023-06-08T03:39:55.210 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elo.ko 2023-06-08T03:39:55.210 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-emsff.ko 2023-06-08T03:39:55.210 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gaff.ko 2023-06-08T03:39:55.210 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gt683r.ko 2023-06-08T03:39:55.211 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gyration.ko 2023-06-08T03:39:55.211 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-08T03:39:55.211 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-08T03:39:55.211 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtekff.ko 2023-06-08T03:39:55.211 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-hyperv.ko 2023-06-08T03:39:55.211 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-icade.ko 2023-06-08T03:39:55.211 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-keytouch.ko 2023-06-08T03:39:55.212 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kye.ko 2023-06-08T03:39:55.212 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lcpower.ko 2023-06-08T03:39:55.212 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-led.ko 2023-06-08T03:39:55.212 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lenovo.ko 2023-06-08T03:39:55.212 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-08T03:39:55.212 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-08T03:39:55.212 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-multitouch.ko 2023-06-08T03:39:55.212 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ortek.ko 2023-06-08T03:39:55.213 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-penmount.ko 2023-06-08T03:39:55.213 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-petalynx.ko 2023-06-08T03:39:55.213 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-picolcd.ko 2023-06-08T03:39:55.213 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-pl.ko 2023-06-08T03:39:55.213 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-plantronics.ko 2023-06-08T03:39:55.213 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-primax.ko 2023-06-08T03:39:55.213 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-rmi.ko 2023-06-08T03:39:55.214 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-08T03:39:55.214 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-common.ko 2023-06-08T03:39:55.214 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-08T03:39:55.214 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-08T03:39:55.214 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-08T03:39:55.214 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-08T03:39:55.214 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-08T03:39:55.214 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-08T03:39:55.215 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-08T03:39:55.215 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-08T03:39:55.215 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-08T03:39:55.215 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat.ko 2023-06-08T03:39:55.215 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-saitek.ko 2023-06-08T03:39:55.215 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-samsung.ko 2023-06-08T03:39:55.215 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-08T03:39:55.215 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sjoy.ko 2023-06-08T03:39:55.216 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sony.ko 2023-06-08T03:39:55.216 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-speedlink.ko 2023-06-08T03:39:55.216 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-steelseries.ko 2023-06-08T03:39:55.216 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sunplus.ko 2023-06-08T03:39:55.216 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-08T03:39:55.216 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tivo.ko 2023-06-08T03:39:55.216 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tmff.ko 2023-06-08T03:39:55.217 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-topseed.ko 2023-06-08T03:39:55.217 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-twinhan.ko 2023-06-08T03:39:55.217 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-uclogic.ko 2023-06-08T03:39:55.217 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-waltop.ko 2023-06-08T03:39:55.217 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-wiimote.ko 2023-06-08T03:39:55.217 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-xinmo.ko 2023-06-08T03:39:55.217 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zpff.ko 2023-06-08T03:39:55.217 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zydacron.ko 2023-06-08T03:39:55.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/uhid.ko 2023-06-08T03:39:55.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/wacom.ko 2023-06-08T03:39:55.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv 2023-06-08T03:39:55.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_balloon.ko 2023-06-08T03:39:55.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_utils.ko 2023-06-08T03:39:55.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_vmbus.ko 2023-06-08T03:39:55.218 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon 2023-06-08T03:39:55.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru.ko 2023-06-08T03:39:55.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru3.ko 2023-06-08T03:39:55.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-08T03:39:55.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7414.ko 2023-06-08T03:39:55.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7418.ko 2023-06-08T03:39:55.219 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adc128d818.ko 2023-06-08T03:39:55.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1025.ko 2023-06-08T03:39:55.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1026.ko 2023-06-08T03:39:55.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1029.ko 2023-06-08T03:39:55.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1031.ko 2023-06-08T03:39:55.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm9240.ko 2023-06-08T03:39:55.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ads7828.ko 2023-06-08T03:39:55.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7410.ko 2023-06-08T03:39:55.220 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7411.ko 2023-06-08T03:39:55.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7462.ko 2023-06-08T03:39:55.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7470.ko 2023-06-08T03:39:55.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7475.ko 2023-06-08T03:39:55.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7x10.ko 2023-06-08T03:39:55.221 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/amc6821.ko 2023-06-08T03:39:55.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/applesmc.ko 2023-06-08T03:39:55.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asb100.ko 2023-06-08T03:39:55.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asc7621.ko 2023-06-08T03:39:55.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-08T03:39:55.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/atxp1.ko 2023-06-08T03:39:55.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/coretemp.ko 2023-06-08T03:39:55.222 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-08T03:39:55.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dme1737.ko 2023-06-08T03:39:55.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds1621.ko 2023-06-08T03:39:55.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds620.ko 2023-06-08T03:39:55.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc1403.ko 2023-06-08T03:39:55.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc6w201.ko 2023-06-08T03:39:55.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71805f.ko 2023-06-08T03:39:55.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71882fg.ko 2023-06-08T03:39:55.223 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f75375s.ko 2023-06-08T03:39:55.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fam15h_power.ko 2023-06-08T03:39:55.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fschmd.ko 2023-06-08T03:39:55.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g760a.ko 2023-06-08T03:39:55.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g762.ko 2023-06-08T03:39:55.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl518sm.ko 2023-06-08T03:39:55.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl520sm.ko 2023-06-08T03:39:55.224 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-08T03:39:55.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5500_temp.ko 2023-06-08T03:39:55.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5k_amb.ko 2023-06-08T03:39:55.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmaem.ko 2023-06-08T03:39:55.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmpex.ko 2023-06-08T03:39:55.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina209.ko 2023-06-08T03:39:55.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina2xx.ko 2023-06-08T03:39:55.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/it87.ko 2023-06-08T03:39:55.225 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k10temp.ko 2023-06-08T03:39:55.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k8temp.ko 2023-06-08T03:39:55.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lineage-pem.ko 2023-06-08T03:39:55.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm63.ko 2023-06-08T03:39:55.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm73.ko 2023-06-08T03:39:55.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm75.ko 2023-06-08T03:39:55.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm77.ko 2023-06-08T03:39:55.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm78.ko 2023-06-08T03:39:55.226 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm80.ko 2023-06-08T03:39:55.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm83.ko 2023-06-08T03:39:55.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm85.ko 2023-06-08T03:39:55.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm87.ko 2023-06-08T03:39:55.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm90.ko 2023-06-08T03:39:55.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm92.ko 2023-06-08T03:39:55.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm93.ko 2023-06-08T03:39:55.227 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95234.ko 2023-06-08T03:39:55.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95241.ko 2023-06-08T03:39:55.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95245.ko 2023-06-08T03:39:55.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc2945.ko 2023-06-08T03:39:55.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4151.ko 2023-06-08T03:39:55.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4215.ko 2023-06-08T03:39:55.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4222.ko 2023-06-08T03:39:55.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4245.ko 2023-06-08T03:39:55.228 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4260.ko 2023-06-08T03:39:55.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4261.ko 2023-06-08T03:39:55.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max16065.ko 2023-06-08T03:39:55.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1619.ko 2023-06-08T03:39:55.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1668.ko 2023-06-08T03:39:55.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max197.ko 2023-06-08T03:39:55.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6639.ko 2023-06-08T03:39:55.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6650.ko 2023-06-08T03:39:55.229 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6697.ko 2023-06-08T03:39:55.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mcp3021.ko 2023-06-08T03:39:55.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6683.ko 2023-06-08T03:39:55.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775-core.ko 2023-06-08T03:39:55.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775.ko 2023-06-08T03:39:55.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct7802.ko 2023-06-08T03:39:55.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87360.ko 2023-06-08T03:39:55.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87427.ko 2023-06-08T03:39:55.230 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pcf8591.ko 2023-06-08T03:39:55.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus 2023-06-08T03:39:55.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-08T03:39:55.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-08T03:39:55.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-08T03:39:55.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-08T03:39:55.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-08T03:39:55.231 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-08T03:39:55.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-08T03:39:55.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-08T03:39:55.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-08T03:39:55.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-08T03:39:55.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-08T03:39:55.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-08T03:39:55.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/powr1220.ko 2023-06-08T03:39:55.232 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5627.ko 2023-06-08T03:39:55.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5636.ko 2023-06-08T03:39:55.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-08T03:39:55.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht15.ko 2023-06-08T03:39:55.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht21.ko 2023-06-08T03:39:55.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/shtc1.ko 2023-06-08T03:39:55.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sis5595.ko 2023-06-08T03:39:55.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47b397.ko 2023-06-08T03:39:55.233 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m1.ko 2023-06-08T03:39:55.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m192.ko 2023-06-08T03:39:55.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/thmc50.ko 2023-06-08T03:39:55.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp102.ko 2023-06-08T03:39:55.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp103.ko 2023-06-08T03:39:55.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp401.ko 2023-06-08T03:39:55.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp421.ko 2023-06-08T03:39:55.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via-cputemp.ko 2023-06-08T03:39:55.234 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via686a.ko 2023-06-08T03:39:55.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt1211.ko 2023-06-08T03:39:55.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt8231.ko 2023-06-08T03:39:55.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627ehf.ko 2023-06-08T03:39:55.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627hf.ko 2023-06-08T03:39:55.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83781d.ko 2023-06-08T03:39:55.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83791d.ko 2023-06-08T03:39:55.235 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83792d.ko 2023-06-08T03:39:55.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83793.ko 2023-06-08T03:39:55.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83795.ko 2023-06-08T03:39:55.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l785ts.ko 2023-06-08T03:39:55.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l786ng.ko 2023-06-08T03:39:55.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c 2023-06-08T03:39:55.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos 2023-06-08T03:39:55.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-08T03:39:55.236 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-08T03:39:55.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses 2023-06-08T03:39:55.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-08T03:39:55.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-08T03:39:55.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-08T03:39:55.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-08T03:39:55.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-08T03:39:55.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-08T03:39:55.237 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-08T03:39:55.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-08T03:39:55.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-08T03:39:55.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-08T03:39:55.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-08T03:39:55.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-08T03:39:55.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-08T03:39:55.238 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-08T03:39:55.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-08T03:39:55.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-08T03:39:55.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-08T03:39:55.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-08T03:39:55.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-08T03:39:55.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-08T03:39:55.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-08T03:39:55.239 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-08T03:39:55.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-08T03:39:55.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-dev.ko 2023-06-08T03:39:55.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-mux.ko 2023-06-08T03:39:55.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-06-08T03:39:55.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-smbus.ko 2023-06-08T03:39:55.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-stub.ko 2023-06-08T03:39:55.240 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband 2023-06-08T03:39:55.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core 2023-06-08T03:39:55.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-08T03:39:55.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_core.ko 2023-06-08T03:39:55.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-08T03:39:55.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-08T03:39:55.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-08T03:39:55.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-08T03:39:55.241 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-08T03:39:55.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw 2023-06-08T03:39:55.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4 2023-06-08T03:39:55.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-08T03:39:55.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4 2023-06-08T03:39:55.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-08T03:39:55.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5 2023-06-08T03:39:55.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-08T03:39:55.242 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca 2023-06-08T03:39:55.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-08T03:39:55.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp 2023-06-08T03:39:55.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib 2023-06-08T03:39:55.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-08T03:39:55.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser 2023-06-08T03:39:55.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-08T03:39:55.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert 2023-06-08T03:39:55.243 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-08T03:39:55.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp 2023-06-08T03:39:55.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-08T03:39:55.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt 2023-06-08T03:39:55.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-08T03:39:55.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input 2023-06-08T03:39:55.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport 2023-06-08T03:39:55.244 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-08T03:39:55.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-08T03:39:55.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/gameport.ko 2023-06-08T03:39:55.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/lightning.ko 2023-06-08T03:39:55.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ns558.ko 2023-06-08T03:39:55.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/joydev.ko 2023-06-08T03:39:55.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard 2023-06-08T03:39:55.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-08T03:39:55.245 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse 2023-06-08T03:39:55.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/appletouch.ko 2023-06-08T03:39:55.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/bcm5974.ko 2023-06-08T03:39:55.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/cyapatp.ko 2023-06-08T03:39:55.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-08T03:39:55.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/sermouse.ko 2023-06-08T03:39:55.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-08T03:39:55.246 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-08T03:39:55.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-08T03:39:55.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4 2023-06-08T03:39:55.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-08T03:39:55.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio 2023-06-08T03:39:55.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/altera_ps2.ko 2023-06-08T03:39:55.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/arc_ps2.ko 2023-06-08T03:39:55.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-08T03:39:55.247 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serio_raw.ko 2023-06-08T03:39:55.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/sparse-keymap.ko 2023-06-08T03:39:55.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu 2023-06-08T03:39:55.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd 2023-06-08T03:39:55.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-08T03:39:55.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds 2023-06-08T03:39:55.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-blinkm.ko 2023-06-08T03:39:55.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3530.ko 2023-06-08T03:39:55.248 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp3944.ko 2023-06-08T03:39:55.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-ss4200.ko 2023-06-08T03:39:55.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger 2023-06-08T03:39:55.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-08T03:39:55.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-08T03:39:55.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-08T03:39:55.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-08T03:39:55.249 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-08T03:39:55.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-08T03:39:55.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-08T03:39:55.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-08T03:39:55.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md 2023-06-08T03:39:55.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache 2023-06-08T03:39:55.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/bcache.ko 2023-06-08T03:39:55.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bio-prison.ko 2023-06-08T03:39:55.250 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache-smq.ko 2023-06-08T03:39:55.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache.ko 2023-06-08T03:39:55.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-crypt.ko 2023-06-08T03:39:55.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-delay.ko 2023-06-08T03:39:55.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-flakey.ko 2023-06-08T03:39:55.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log-userspace.ko 2023-06-08T03:39:55.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-multipath.ko 2023-06-08T03:39:55.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-queue-length.ko 2023-06-08T03:39:55.251 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-raid.ko 2023-06-08T03:39:55.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-round-robin.ko 2023-06-08T03:39:55.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-service-time.ko 2023-06-08T03:39:55.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-switch.ko 2023-06-08T03:39:55.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-thin-pool.ko 2023-06-08T03:39:55.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-verity.ko 2023-06-08T03:39:55.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/faulty.ko 2023-06-08T03:39:55.252 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/linear.ko 2023-06-08T03:39:55.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/multipath.ko 2023-06-08T03:39:55.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data 2023-06-08T03:39:55.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-08T03:39:55.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid0.ko 2023-06-08T03:39:55.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid1.ko 2023-06-08T03:39:55.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid10.ko 2023-06-08T03:39:55.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid456.ko 2023-06-08T03:39:55.253 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message 2023-06-08T03:39:55.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion 2023-06-08T03:39:55.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptbase.ko 2023-06-08T03:39:55.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptctl.ko 2023-06-08T03:39:55.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptfc.ko 2023-06-08T03:39:55.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptlan.ko 2023-06-08T03:39:55.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptsas.ko 2023-06-08T03:39:55.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptscsih.ko 2023-06-08T03:39:55.254 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptspi.ko 2023-06-08T03:39:55.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd 2023-06-08T03:39:55.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_ich.ko 2023-06-08T03:39:55.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_sch.ko 2023-06-08T03:39:55.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mfd-core.ko 2023-06-08T03:39:55.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/sm501.ko 2023-06-08T03:39:55.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/viperboard.ko 2023-06-08T03:39:55.255 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/vx855.ko 2023-06-08T03:39:55.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wl1273-core.ko 2023-06-08T03:39:55.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc 2023-06-08T03:39:55.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl 2023-06-08T03:39:55.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-08T03:39:55.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds9802als.ko 2023-06-08T03:39:55.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds990x.ko 2023-06-08T03:39:55.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/bh1770glc.ko 2023-06-08T03:39:55.256 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710 2023-06-08T03:39:55.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/cb710.ko 2023-06-08T03:39:55.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom 2023-06-08T03:39:55.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/at24.ko 2023-06-08T03:39:55.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-08T03:39:55.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-08T03:39:55.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/max6875.ko 2023-06-08T03:39:55.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/enclosure.ko 2023-06-08T03:39:55.257 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hpilo.ko 2023-06-08T03:39:55.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29003.ko 2023-06-08T03:39:55.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29020.ko 2023-06-08T03:39:55.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d 2023-06-08T03:39:55.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-08T03:39:55.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-08T03:39:55.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei 2023-06-08T03:39:55.258 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-me.ko 2023-06-08T03:39:55.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-txe.ko 2023-06-08T03:39:55.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei.ko 2023-06-08T03:39:55.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-gru 2023-06-08T03:39:55.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-gru/gru.ko 2023-06-08T03:39:55.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-xp 2023-06-08T03:39:55.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-xp/xp.ko 2023-06-08T03:39:55.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-xp/xpc.ko 2023-06-08T03:39:55.259 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-06-08T03:39:55.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_7xx1.ko 2023-06-08T03:39:55.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_core.ko 2023-06-08T03:39:55.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tsl2550.ko 2023-06-08T03:39:55.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_balloon.ko 2023-06-08T03:39:55.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci 2023-06-08T03:39:55.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-08T03:39:55.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net 2023-06-08T03:39:55.260 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding 2023-06-08T03:39:55.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/bonding.ko 2023-06-08T03:39:55.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa 2023-06-08T03:39:55.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53 2023-06-08T03:39:55.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-08T03:39:55.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-08T03:39:55.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-08T03:39:55.261 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx 2023-06-08T03:39:55.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-08T03:39:55.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dummy.ko 2023-06-08T03:39:55.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/eql.ko 2023-06-08T03:39:55.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet 2023-06-08T03:39:55.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com 2023-06-08T03:39:55.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-08T03:39:55.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-08T03:39:55.262 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-08T03:39:55.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-08T03:39:55.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390 2023-06-08T03:39:55.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-08T03:39:55.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-08T03:39:55.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-08T03:39:55.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-08T03:39:55.263 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec 2023-06-08T03:39:55.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-08T03:39:55.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere 2023-06-08T03:39:55.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-08T03:39:55.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon 2023-06-08T03:39:55.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-08T03:39:55.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera 2023-06-08T03:39:55.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-08T03:39:55.264 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd 2023-06-08T03:39:55.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-08T03:39:55.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-08T03:39:55.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-08T03:39:55.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros 2023-06-08T03:39:55.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx 2023-06-08T03:39:55.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-08T03:39:55.265 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c 2023-06-08T03:39:55.266 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-08T03:39:55.266 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e 2023-06-08T03:39:55.266 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-08T03:39:55.266 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx 2023-06-08T03:39:55.266 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-08T03:39:55.266 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-08T03:39:55.266 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom 2023-06-08T03:39:55.266 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-08T03:39:55.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-08T03:39:55.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-06-08T03:39:55.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-08T03:39:55.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-08T03:39:55.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet 2023-06-08T03:39:55.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-08T03:39:55.267 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-08T03:39:55.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade 2023-06-08T03:39:55.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna 2023-06-08T03:39:55.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-08T03:39:55.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio 2023-06-08T03:39:55.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb 2023-06-08T03:39:55.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-08T03:39:55.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-06-08T03:39:55.268 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-08T03:39:55.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-06-08T03:39:55.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-08T03:39:55.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-06-08T03:39:55.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-08T03:39:55.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-06-08T03:39:55.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-08T03:39:55.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco 2023-06-08T03:39:55.269 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic 2023-06-08T03:39:55.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-08T03:39:55.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec 2023-06-08T03:39:55.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip 2023-06-08T03:39:55.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-08T03:39:55.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-08T03:39:55.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-08T03:39:55.270 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-08T03:39:55.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-08T03:39:55.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-08T03:39:55.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink 2023-06-08T03:39:55.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-08T03:39:55.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-08T03:39:55.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dnet.ko 2023-06-08T03:39:55.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex 2023-06-08T03:39:55.271 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet 2023-06-08T03:39:55.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-08T03:39:55.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ethoc.ko 2023-06-08T03:39:55.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fealnx.ko 2023-06-08T03:39:55.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel 2023-06-08T03:39:55.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-08T03:39:55.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000 2023-06-08T03:39:55.272 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-08T03:39:55.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e 2023-06-08T03:39:55.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-08T03:39:55.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k 2023-06-08T03:39:55.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-08T03:39:55.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e 2023-06-08T03:39:55.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-08T03:39:55.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf 2023-06-08T03:39:55.273 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-08T03:39:55.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb 2023-06-08T03:39:55.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-08T03:39:55.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf 2023-06-08T03:39:55.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-08T03:39:55.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe 2023-06-08T03:39:55.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-08T03:39:55.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf 2023-06-08T03:39:55.274 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-08T03:39:55.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/jme.ko 2023-06-08T03:39:55.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell 2023-06-08T03:39:55.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-08T03:39:55.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-08T03:39:55.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-08T03:39:55.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox 2023-06-08T03:39:55.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4 2023-06-08T03:39:55.275 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-08T03:39:55.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-08T03:39:55.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5 2023-06-08T03:39:55.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-06-08T03:39:55.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-08T03:39:55.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel 2023-06-08T03:39:55.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-08T03:39:55.276 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom 2023-06-08T03:39:55.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge 2023-06-08T03:39:55.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-08T03:39:55.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi 2023-06-08T03:39:55.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-08T03:39:55.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-08T03:39:55.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion 2023-06-08T03:39:55.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-08T03:39:55.277 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia 2023-06-08T03:39:55.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-08T03:39:55.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines 2023-06-08T03:39:55.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-08T03:39:55.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-08T03:39:55.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic 2023-06-08T03:39:55.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen 2023-06-08T03:39:55.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-08T03:39:55.278 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-08T03:39:55.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-06-08T03:39:55.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-08T03:39:55.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc 2023-06-08T03:39:55.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-08T03:39:55.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek 2023-06-08T03:39:55.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-08T03:39:55.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-08T03:39:55.279 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-08T03:39:55.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-08T03:39:55.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rocker 2023-06-08T03:39:55.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-06-08T03:39:55.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc 2023-06-08T03:39:55.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-08T03:39:55.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan 2023-06-08T03:39:55.280 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-08T03:39:55.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis 2023-06-08T03:39:55.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-08T03:39:55.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-08T03:39:55.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc 2023-06-08T03:39:55.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-08T03:39:55.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-08T03:39:55.281 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-08T03:39:55.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-08T03:39:55.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro 2023-06-08T03:39:55.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac 2023-06-08T03:39:55.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-08T03:39:55.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-08T03:39:55.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun 2023-06-08T03:39:55.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-08T03:39:55.282 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-08T03:39:55.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-08T03:39:55.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-08T03:39:55.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti 2023-06-08T03:39:55.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-08T03:39:55.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti 2023-06-08T03:39:55.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-08T03:39:55.283 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via 2023-06-08T03:39:55.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-08T03:39:55.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-08T03:39:55.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet 2023-06-08T03:39:55.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-08T03:39:55.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-08T03:39:55.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom 2023-06-08T03:39:55.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-08T03:39:55.284 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/geneve.ko 2023-06-08T03:39:55.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv 2023-06-08T03:39:55.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-08T03:39:55.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154 2023-06-08T03:39:55.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-08T03:39:55.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ifb.ko 2023-06-08T03:39:55.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan 2023-06-08T03:39:55.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-08T03:39:55.285 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvlan.ko 2023-06-08T03:39:55.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvtap.ko 2023-06-08T03:39:55.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio 2023-06-08T03:39:55.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio.ko 2023-06-08T03:39:55.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-08T03:39:55.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-08T03:39:55.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mii.ko 2023-06-08T03:39:55.286 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/net_failover.ko 2023-06-08T03:39:55.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/netconsole.ko 2023-06-08T03:39:55.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/nlmon.ko 2023-06-08T03:39:55.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs 2023-06-08T03:39:55.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-08T03:39:55.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-08T03:39:55.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy 2023-06-08T03:39:55.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/amd.ko 2023-06-08T03:39:55.287 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-08T03:39:55.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-06-08T03:39:55.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-08T03:39:55.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm87xx.ko 2023-06-08T03:39:55.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/broadcom.ko 2023-06-08T03:39:55.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/cicada.ko 2023-06-08T03:39:55.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/davicom.ko 2023-06-08T03:39:55.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/dp83640.ko 2023-06-08T03:39:55.288 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/et1011c.ko 2023-06-08T03:39:55.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/icplus.ko 2023-06-08T03:39:55.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/lxt.ko 2023-06-08T03:39:55.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/marvell.ko 2023-06-08T03:39:55.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/micrel.ko 2023-06-08T03:39:55.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/national.ko 2023-06-08T03:39:55.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/phylink.ko 2023-06-08T03:39:55.289 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/qsemi.ko 2023-06-08T03:39:55.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/realtek.ko 2023-06-08T03:39:55.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/smsc.ko 2023-06-08T03:39:55.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ste10Xp.ko 2023-06-08T03:39:55.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/vitesse.ko 2023-06-08T03:39:55.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp 2023-06-08T03:39:55.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-08T03:39:55.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_async.ko 2023-06-08T03:39:55.290 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-08T03:39:55.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_generic.ko 2023-06-08T03:39:55.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-08T03:39:55.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-08T03:39:55.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppoe.ko 2023-06-08T03:39:55.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppox.ko 2023-06-08T03:39:55.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pptp.ko 2023-06-08T03:39:55.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip 2023-06-08T03:39:55.291 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/slhc.ko 2023-06-08T03:39:55.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/slip.ko 2023-06-08T03:39:55.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sungem_phy.ko 2023-06-08T03:39:55.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/tap.ko 2023-06-08T03:39:55.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team 2023-06-08T03:39:55.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team.ko 2023-06-08T03:39:55.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-08T03:39:55.292 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-08T03:39:55.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-08T03:39:55.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_random.ko 2023-06-08T03:39:55.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-08T03:39:55.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/tun.ko 2023-06-08T03:39:55.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/veth.ko 2023-06-08T03:39:55.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/virtio_net.ko 2023-06-08T03:39:55.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3 2023-06-08T03:39:55.293 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-08T03:39:55.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan 2023-06-08T03:39:55.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/vxlan.ko 2023-06-08T03:39:55.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback 2023-06-08T03:39:55.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-08T03:39:55.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netfront.ko 2023-06-08T03:39:55.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb 2023-06-08T03:39:55.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ntb.ko 2023-06-08T03:39:55.294 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme 2023-06-08T03:39:55.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host 2023-06-08T03:39:55.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme-core.ko 2023-06-08T03:39:55.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme.ko 2023-06-08T03:39:55.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport 2023-06-08T03:39:55.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport.ko 2023-06-08T03:39:55.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_cs.ko 2023-06-08T03:39:55.295 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_pc.ko 2023-06-08T03:39:55.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_serial.ko 2023-06-08T03:39:55.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci 2023-06-08T03:39:55.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug 2023-06-08T03:39:55.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-08T03:39:55.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/pcie 2023-06-08T03:39:55.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/pcie/aer_inject.ko 2023-06-08T03:39:55.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/xen-pcifront.ko 2023-06-08T03:39:55.296 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia 2023-06-08T03:39:55.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/i82092.ko 2023-06-08T03:39:55.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pd6729.ko 2023-06-08T03:39:55.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-08T03:39:55.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl 2023-06-08T03:39:55.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel 2023-06-08T03:39:55.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-08T03:39:55.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform 2023-06-08T03:39:55.297 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86 2023-06-08T03:39:55.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-08T03:39:55.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acerhdf.ko 2023-06-08T03:39:55.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-08T03:39:55.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-08T03:39:55.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-08T03:39:55.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-08T03:39:55.298 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-08T03:39:55.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-08T03:39:55.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-08T03:39:55.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-08T03:39:55.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-08T03:39:55.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/hdaps.ko 2023-06-08T03:39:55.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel 2023-06-08T03:39:55.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-08T03:39:55.299 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel_ips.ko 2023-06-08T03:39:55.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-08T03:39:55.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-08T03:39:55.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-08T03:39:55.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-08T03:39:55.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-08T03:39:55.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-08T03:39:55.300 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-08T03:39:55.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-08T03:39:55.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-08T03:39:55.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi.ko 2023-06-08T03:39:55.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap 2023-06-08T03:39:55.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-08T03:39:55.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-08T03:39:55.301 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps 2023-06-08T03:39:55.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients 2023-06-08T03:39:55.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-08T03:39:55.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-08T03:39:55.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps_parport.ko 2023-06-08T03:39:55.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/pps_core.ko 2023-06-08T03:39:55.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp 2023-06-08T03:39:55.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp.ko 2023-06-08T03:39:55.302 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp_kvm.ko 2023-06-08T03:39:55.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc 2023-06-08T03:39:55.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-08T03:39:55.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-08T03:39:55.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-08T03:39:55.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-08T03:39:55.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-08T03:39:55.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-08T03:39:55.303 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-08T03:39:55.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-08T03:39:55.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-08T03:39:55.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-08T03:39:55.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-08T03:39:55.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-em3027.ko 2023-06-08T03:39:55.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-08T03:39:55.304 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-08T03:39:55.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-08T03:39:55.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-08T03:39:55.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-08T03:39:55.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-08T03:39:55.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max6900.ko 2023-06-08T03:39:55.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-08T03:39:55.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-08T03:39:55.305 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-08T03:39:55.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-08T03:39:55.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-08T03:39:55.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-08T03:39:55.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-08T03:39:55.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-08T03:39:55.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-08T03:39:55.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-08T03:39:55.306 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-08T03:39:55.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-08T03:39:55.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-x1205.ko 2023-06-08T03:39:55.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi 2023-06-08T03:39:55.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-9xxx.ko 2023-06-08T03:39:55.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-sas.ko 2023-06-08T03:39:55.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-xxxx.ko 2023-06-08T03:39:55.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/BusLogic.ko 2023-06-08T03:39:55.307 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/a100u2w.ko 2023-06-08T03:39:55.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid 2023-06-08T03:39:55.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-08T03:39:55.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/advansys.ko 2023-06-08T03:39:55.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx 2023-06-08T03:39:55.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-08T03:39:55.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-08T03:39:55.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/am53c974.ko 2023-06-08T03:39:55.308 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr 2023-06-08T03:39:55.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-08T03:39:55.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/atp870u.ko 2023-06-08T03:39:55.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi 2023-06-08T03:39:55.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-08T03:39:55.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa 2023-06-08T03:39:55.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/bfa.ko 2023-06-08T03:39:55.309 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc 2023-06-08T03:39:55.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-08T03:39:55.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i 2023-06-08T03:39:55.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-08T03:39:55.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ch.ko 2023-06-08T03:39:55.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor 2023-06-08T03:39:55.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-08T03:39:55.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi 2023-06-08T03:39:55.310 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i 2023-06-08T03:39:55.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-08T03:39:55.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i 2023-06-08T03:39:55.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-08T03:39:55.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-08T03:39:55.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dc395x.ko 2023-06-08T03:39:55.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/device_handler 2023-06-08T03:39:55.311 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-06-08T03:39:55.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-06-08T03:39:55.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-06-08T03:39:55.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-06-08T03:39:55.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dmx3191d.ko 2023-06-08T03:39:55.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r 2023-06-08T03:39:55.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-08T03:39:55.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esp_scsi.ko 2023-06-08T03:39:55.312 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe 2023-06-08T03:39:55.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-08T03:39:55.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-08T03:39:55.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic 2023-06-08T03:39:55.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/fnic.ko 2023-06-08T03:39:55.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hpsa.ko 2023-06-08T03:39:55.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hptiop.ko 2023-06-08T03:39:55.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hv_storvsc.ko 2023-06-08T03:39:55.313 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/initio.ko 2023-06-08T03:39:55.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ipr.ko 2023-06-08T03:39:55.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ips.ko 2023-06-08T03:39:55.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci 2023-06-08T03:39:55.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/isci.ko 2023-06-08T03:39:55.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-08T03:39:55.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-08T03:39:55.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc 2023-06-08T03:39:55.314 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/libfc.ko 2023-06-08T03:39:55.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi.ko 2023-06-08T03:39:55.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-08T03:39:55.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas 2023-06-08T03:39:55.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/libsas.ko 2023-06-08T03:39:55.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc 2023-06-08T03:39:55.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-08T03:39:55.315 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid 2023-06-08T03:39:55.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid.ko 2023-06-08T03:39:55.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-08T03:39:55.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-08T03:39:55.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-08T03:39:55.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas 2023-06-08T03:39:55.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-08T03:39:55.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas 2023-06-08T03:39:55.316 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-08T03:39:55.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvumi.ko 2023-06-08T03:39:55.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001 2023-06-08T03:39:55.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-08T03:39:55.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pmcraid.ko 2023-06-08T03:39:55.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla1280.ko 2023-06-08T03:39:55.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx 2023-06-08T03:39:55.317 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-08T03:39:55.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-08T03:39:55.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx 2023-06-08T03:39:55.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-08T03:39:55.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/raid_class.ko 2023-06-08T03:39:55.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_debug.ko 2023-06-08T03:39:55.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-08T03:39:55.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-08T03:39:55.318 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-08T03:39:55.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-08T03:39:55.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-08T03:39:55.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ses.ko 2023-06-08T03:39:55.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/st.ko 2023-06-08T03:39:55.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/stex.ko 2023-06-08T03:39:55.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2 2023-06-08T03:39:55.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-08T03:39:55.319 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/virtio_scsi.ko 2023-06-08T03:39:55.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-08T03:39:55.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/wd719x.ko 2023-06-08T03:39:55.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb 2023-06-08T03:39:55.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ssb.ko 2023-06-08T03:39:55.320 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target 2023-06-08T03:39:55.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi 2023-06-08T03:39:55.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-08T03:39:55.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback 2023-06-08T03:39:55.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-08T03:39:55.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_file.ko 2023-06-08T03:39:55.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_iblock.ko 2023-06-08T03:39:55.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_mod.ko 2023-06-08T03:39:55.321 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_pscsi.ko 2023-06-08T03:39:55.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_user.ko 2023-06-08T03:39:55.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc 2023-06-08T03:39:55.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-08T03:39:55.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal 2023-06-08T03:39:55.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel 2023-06-08T03:39:55.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal 2023-06-08T03:39:55.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-08T03:39:55.322 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-08T03:39:55.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-08T03:39:55.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-08T03:39:55.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-08T03:39:55.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-08T03:39:55.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-08T03:39:55.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-08T03:39:55.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-08T03:39:55.323 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-08T03:39:55.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-08T03:39:55.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-08T03:39:55.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-08T03:39:55.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-08T03:39:55.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-08T03:39:55.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty 2023-06-08T03:39:55.324 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless 2023-06-08T03:39:55.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-08T03:39:55.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_gsm.ko 2023-06-08T03:39:55.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_hdlc.ko 2023-06-08T03:39:55.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/nozomi.ko 2023-06-08T03:39:55.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial 2023-06-08T03:39:55.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250 2023-06-08T03:39:55.325 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-08T03:39:55.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/arc_uart.ko 2023-06-08T03:39:55.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm 2023-06-08T03:39:55.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-08T03:39:55.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/synclink_gt.ko 2023-06-08T03:39:55.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs 2023-06-08T03:39:55.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core 2023-06-08T03:39:55.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-08T03:39:55.326 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host 2023-06-08T03:39:55.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-08T03:39:55.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio 2023-06-08T03:39:55.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio.ko 2023-06-08T03:39:55.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_aec.ko 2023-06-08T03:39:55.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_cif.ko 2023-06-08T03:39:55.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pci_generic.ko 2023-06-08T03:39:55.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_sercos3.ko 2023-06-08T03:39:55.327 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb 2023-06-08T03:39:55.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class 2023-06-08T03:39:55.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-acm.ko 2023-06-08T03:39:55.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-08T03:39:55.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usblp.ko 2023-06-08T03:39:55.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usbtmc.ko 2023-06-08T03:39:55.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host 2023-06-08T03:39:55.328 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-08T03:39:55.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image 2023-06-08T03:39:55.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/mdc800.ko 2023-06-08T03:39:55.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/microtek.ko 2023-06-08T03:39:55.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc 2023-06-08T03:39:55.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/adutux.ko 2023-06-08T03:39:55.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/appledisplay.ko 2023-06-08T03:39:55.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi26.ko 2023-06-08T03:39:55.329 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi62.ko 2023-06-08T03:39:55.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ezusb.ko 2023-06-08T03:39:55.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/idmouse.ko 2023-06-08T03:39:55.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/iowarrior.ko 2023-06-08T03:39:55.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-08T03:39:55.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ldusb.ko 2023-06-08T03:39:55.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/legousbtower.ko 2023-06-08T03:39:55.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga 2023-06-08T03:39:55.330 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-08T03:39:55.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-08T03:39:55.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usb3503.ko 2023-06-08T03:39:55.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usblcd.ko 2023-06-08T03:39:55.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-08T03:39:55.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/uss720.ko 2023-06-08T03:39:55.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/yurex.ko 2023-06-08T03:39:55.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy 2023-06-08T03:39:55.331 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-generic.ko 2023-06-08T03:39:55.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial 2023-06-08T03:39:55.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/aircable.ko 2023-06-08T03:39:55.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ark3116.ko 2023-06-08T03:39:55.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-08T03:39:55.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ch341.ko 2023-06-08T03:39:55.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cp210x.ko 2023-06-08T03:39:55.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cyberjack.ko 2023-06-08T03:39:55.332 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-08T03:39:55.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-08T03:39:55.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/empeg.ko 2023-06-08T03:39:55.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-08T03:39:55.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-08T03:39:55.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-08T03:39:55.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_ti.ko 2023-06-08T03:39:55.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipaq.ko 2023-06-08T03:39:55.333 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipw.ko 2023-06-08T03:39:55.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ir-usb.ko 2023-06-08T03:39:55.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-08T03:39:55.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan.ko 2023-06-08T03:39:55.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-08T03:39:55.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-08T03:39:55.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-08T03:39:55.334 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mct_u232.ko 2023-06-08T03:39:55.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7720.ko 2023-06-08T03:39:55.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7840.ko 2023-06-08T03:39:55.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/navman.ko 2023-06-08T03:39:55.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/omninet.ko 2023-06-08T03:39:55.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/opticon.ko 2023-06-08T03:39:55.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/option.ko 2023-06-08T03:39:55.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/oti6858.ko 2023-06-08T03:39:55.335 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/pl2303.ko 2023-06-08T03:39:55.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcaux.ko 2023-06-08T03:39:55.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcserial.ko 2023-06-08T03:39:55.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/quatech2.ko 2023-06-08T03:39:55.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/safe_serial.ko 2023-06-08T03:39:55.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/sierra.ko 2023-06-08T03:39:55.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-08T03:39:55.336 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ssu100.ko 2023-06-08T03:39:55.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/symbolserial.ko 2023-06-08T03:39:55.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-08T03:39:55.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-08T03:39:55.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_debug.ko 2023-06-08T03:39:55.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-08T03:39:55.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/visor.ko 2023-06-08T03:39:55.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/whiteheat.ko 2023-06-08T03:39:55.337 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-08T03:39:55.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage 2023-06-08T03:39:55.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/uas.ko 2023-06-08T03:39:55.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-08T03:39:55.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-08T03:39:55.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-08T03:39:55.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-08T03:39:55.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-08T03:39:55.338 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-08T03:39:55.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-08T03:39:55.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-karma.ko 2023-06-08T03:39:55.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-08T03:39:55.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-08T03:39:55.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-08T03:39:55.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-08T03:39:55.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-08T03:39:55.339 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/usb-storage.ko 2023-06-08T03:39:55.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip 2023-06-08T03:39:55.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-08T03:39:55.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-08T03:39:55.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-08T03:39:55.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio 2023-06-08T03:39:55.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci 2023-06-08T03:39:55.340 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-08T03:39:55.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-08T03:39:55.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio.ko 2023-06-08T03:39:55.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-08T03:39:55.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost 2023-06-08T03:39:55.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost.ko 2023-06-08T03:39:55.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-08T03:39:55.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_net.ko 2023-06-08T03:39:55.341 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_scsi.ko 2023-06-08T03:39:55.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video 2023-06-08T03:39:55.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight 2023-06-08T03:39:55.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/apple_bl.ko 2023-06-08T03:39:55.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lcd.ko 2023-06-08T03:39:55.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-08T03:39:55.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio 2023-06-08T03:39:55.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio.ko 2023-06-08T03:39:55.342 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_balloon.ko 2023-06-08T03:39:55.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_mmio.ko 2023-06-08T03:39:55.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_pci.ko 2023-06-08T03:39:55.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-06-08T03:39:55.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-06-08T03:39:55.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_ring.ko 2023-06-08T03:39:55.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1 2023-06-08T03:39:55.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters 2023-06-08T03:39:55.343 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2482.ko 2023-06-08T03:39:55.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2490.ko 2023-06-08T03:39:55.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves 2023-06-08T03:39:55.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-08T03:39:55.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-08T03:39:55.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-08T03:39:55.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-08T03:39:55.344 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-08T03:39:55.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-08T03:39:55.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-08T03:39:55.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-08T03:39:55.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-08T03:39:55.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-08T03:39:55.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-08T03:39:55.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/wire.ko 2023-06-08T03:39:55.345 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog 2023-06-08T03:39:55.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-08T03:39:55.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-08T03:39:55.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-08T03:39:55.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/hpwdt.ko 2023-06-08T03:39:55.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/i6300esb.ko 2023-06-08T03:39:55.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-08T03:39:55.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-08T03:39:55.346 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ib700wdt.ko 2023-06-08T03:39:55.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ibmasr.ko 2023-06-08T03:39:55.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-08T03:39:55.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-08T03:39:55.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it87_wdt.ko 2023-06-08T03:39:55.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/machzwd.ko 2023-06-08T03:39:55.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/nv_tco.ko 2023-06-08T03:39:55.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-08T03:39:55.347 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-08T03:39:55.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-08T03:39:55.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-08T03:39:55.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/softdog.ko 2023-06-08T03:39:55.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-08T03:39:55.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/via_wdt.ko 2023-06-08T03:39:55.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-08T03:39:55.348 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-08T03:39:55.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-08T03:39:55.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wdt_pci.ko 2023-06-08T03:39:55.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/xen_wdt.ko 2023-06-08T03:39:55.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen 2023-06-08T03:39:55.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-acpi-processor.ko 2023-06-08T03:39:55.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-evtchn.ko 2023-06-08T03:39:55.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntalloc.ko 2023-06-08T03:39:55.349 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntdev.ko 2023-06-08T03:39:55.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback 2023-06-08T03:39:55.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-08T03:39:55.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-privcmd.ko 2023-06-08T03:39:55.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs 2023-06-08T03:39:55.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-08T03:39:55.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs 2023-06-08T03:39:55.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p 2023-06-08T03:39:55.350 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/9p.ko 2023-06-08T03:39:55.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs 2023-06-08T03:39:55.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/affs.ko 2023-06-08T03:39:55.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs 2023-06-08T03:39:55.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/befs.ko 2023-06-08T03:39:55.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/binfmt_misc.ko 2023-06-08T03:39:55.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs 2023-06-08T03:39:55.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/btrfs.ko 2023-06-08T03:39:55.351 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles 2023-06-08T03:39:55.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/cachefiles.ko 2023-06-08T03:39:55.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph 2023-06-08T03:39:55.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ceph.ko 2023-06-08T03:39:55.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs 2023-06-08T03:39:55.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/cifs.ko 2023-06-08T03:39:55.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda 2023-06-08T03:39:55.352 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/coda.ko 2023-06-08T03:39:55.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs 2023-06-08T03:39:55.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/cramfs.ko 2023-06-08T03:39:55.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm 2023-06-08T03:39:55.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/dlm.ko 2023-06-08T03:39:55.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ecryptfs 2023-06-08T03:39:55.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ecryptfs/ecryptfs.ko 2023-06-08T03:39:55.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs 2023-06-08T03:39:55.353 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/f2fs.ko 2023-06-08T03:39:55.354 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat 2023-06-08T03:39:55.354 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/fat.ko 2023-06-08T03:39:55.354 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/msdos.ko 2023-06-08T03:39:55.354 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/vfat.ko 2023-06-08T03:39:55.354 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache 2023-06-08T03:39:55.354 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/fscache.ko 2023-06-08T03:39:55.354 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse 2023-06-08T03:39:55.354 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/cuse.ko 2023-06-08T03:39:55.355 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/fuse.ko 2023-06-08T03:39:55.355 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2 2023-06-08T03:39:55.355 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/gfs2.ko 2023-06-08T03:39:55.355 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs 2023-06-08T03:39:55.355 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/hfs.ko 2023-06-08T03:39:55.355 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus 2023-06-08T03:39:55.355 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/hfsplus.ko 2023-06-08T03:39:55.355 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs 2023-06-08T03:39:55.356 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/isofs.ko 2023-06-08T03:39:55.356 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs 2023-06-08T03:39:55.356 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/jfs.ko 2023-06-08T03:39:55.356 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd 2023-06-08T03:39:55.356 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/lockd.ko 2023-06-08T03:39:55.356 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix 2023-06-08T03:39:55.356 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/minix.ko 2023-06-08T03:39:55.357 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs 2023-06-08T03:39:55.357 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/netfs.ko 2023-06-08T03:39:55.357 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs 2023-06-08T03:39:55.357 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout 2023-06-08T03:39:55.357 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-08T03:39:55.357 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout 2023-06-08T03:39:55.357 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-08T03:39:55.357 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout 2023-06-08T03:39:55.358 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-08T03:39:55.358 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfs.ko 2023-06-08T03:39:55.358 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv3.ko 2023-06-08T03:39:55.358 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv4.ko 2023-06-08T03:39:55.358 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common 2023-06-08T03:39:55.358 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/grace.ko 2023-06-08T03:39:55.358 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/nfs_acl.ko 2023-06-08T03:39:55.359 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd 2023-06-08T03:39:55.359 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/nfsd.ko 2023-06-08T03:39:55.359 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2 2023-06-08T03:39:55.359 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/nilfs2.ko 2023-06-08T03:39:55.359 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls 2023-06-08T03:39:55.359 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-celtic.ko 2023-06-08T03:39:55.359 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-centeuro.ko 2023-06-08T03:39:55.359 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-croatian.ko 2023-06-08T03:39:55.360 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-cyrillic.ko 2023-06-08T03:39:55.360 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-gaelic.ko 2023-06-08T03:39:55.360 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-greek.ko 2023-06-08T03:39:55.360 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-iceland.ko 2023-06-08T03:39:55.360 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-inuit.ko 2023-06-08T03:39:55.360 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-roman.ko 2023-06-08T03:39:55.360 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-romanian.ko 2023-06-08T03:39:55.360 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-turkish.ko 2023-06-08T03:39:55.361 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1250.ko 2023-06-08T03:39:55.361 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1251.ko 2023-06-08T03:39:55.361 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1255.ko 2023-06-08T03:39:55.361 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp737.ko 2023-06-08T03:39:55.361 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp775.ko 2023-06-08T03:39:55.361 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp850.ko 2023-06-08T03:39:55.361 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp852.ko 2023-06-08T03:39:55.361 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp855.ko 2023-06-08T03:39:55.362 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp857.ko 2023-06-08T03:39:55.362 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp860.ko 2023-06-08T03:39:55.362 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp861.ko 2023-06-08T03:39:55.362 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp862.ko 2023-06-08T03:39:55.362 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp863.ko 2023-06-08T03:39:55.362 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp864.ko 2023-06-08T03:39:55.362 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp865.ko 2023-06-08T03:39:55.362 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp866.ko 2023-06-08T03:39:55.363 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp869.ko 2023-06-08T03:39:55.363 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp874.ko 2023-06-08T03:39:55.363 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp932.ko 2023-06-08T03:39:55.363 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp936.ko 2023-06-08T03:39:55.363 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp949.ko 2023-06-08T03:39:55.363 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp950.ko 2023-06-08T03:39:55.363 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_euc-jp.ko 2023-06-08T03:39:55.364 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-1.ko 2023-06-08T03:39:55.364 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-13.ko 2023-06-08T03:39:55.364 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-14.ko 2023-06-08T03:39:55.364 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-15.ko 2023-06-08T03:39:55.364 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-2.ko 2023-06-08T03:39:55.364 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-3.ko 2023-06-08T03:39:55.364 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-4.ko 2023-06-08T03:39:55.364 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-5.ko 2023-06-08T03:39:55.365 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-6.ko 2023-06-08T03:39:55.365 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-7.ko 2023-06-08T03:39:55.365 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-9.ko 2023-06-08T03:39:55.365 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-r.ko 2023-06-08T03:39:55.365 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-ru.ko 2023-06-08T03:39:55.365 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-u.ko 2023-06-08T03:39:55.365 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_utf8.ko 2023-06-08T03:39:55.365 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2 2023-06-08T03:39:55.366 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster 2023-06-08T03:39:55.366 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-08T03:39:55.366 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm 2023-06-08T03:39:55.366 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-08T03:39:55.366 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs 2023-06-08T03:39:55.366 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-08T03:39:55.366 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2.ko 2023-06-08T03:39:55.366 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-08T03:39:55.367 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-08T03:39:55.367 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-08T03:39:55.367 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs 2023-06-08T03:39:55.367 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/overlay.ko 2023-06-08T03:39:55.367 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore 2023-06-08T03:39:55.367 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ramoops.ko 2023-06-08T03:39:55.367 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs 2023-06-08T03:39:55.367 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/reiserfs.ko 2023-06-08T03:39:55.368 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs 2023-06-08T03:39:55.368 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/romfs.ko 2023-06-08T03:39:55.368 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common 2023-06-08T03:39:55.368 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_arc4.ko 2023-06-08T03:39:55.368 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_md4.ko 2023-06-08T03:39:55.368 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs 2023-06-08T03:39:55.368 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/squashfs.ko 2023-06-08T03:39:55.368 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv 2023-06-08T03:39:55.369 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/sysv.ko 2023-06-08T03:39:55.369 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf 2023-06-08T03:39:55.369 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/udf.ko 2023-06-08T03:39:55.369 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs 2023-06-08T03:39:55.369 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ufs.ko 2023-06-08T03:39:55.369 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs 2023-06-08T03:39:55.369 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/xfs.ko 2023-06-08T03:39:55.370 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel 2023-06-08T03:39:55.370 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/rcu 2023-06-08T03:39:55.370 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/rcu/rcutorture.ko 2023-06-08T03:39:55.370 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/torture.ko 2023-06-08T03:39:55.370 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/trace 2023-06-08T03:39:55.370 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-06-08T03:39:55.370 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib 2023-06-08T03:39:55.370 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/asn1_encoder.ko 2023-06-08T03:39:55.371 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc-itu-t.ko 2023-06-08T03:39:55.371 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc8.ko 2023-06-08T03:39:55.371 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto 2023-06-08T03:39:55.371 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libarc4.ko 2023-06-08T03:39:55.371 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libdes.ko 2023-06-08T03:39:55.371 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/libcrc32c.ko 2023-06-08T03:39:55.371 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lru_cache.ko 2023-06-08T03:39:55.371 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4 2023-06-08T03:39:55.372 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4_compress.ko 2023-06-08T03:39:55.372 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4hc_compress.ko 2023-06-08T03:39:55.372 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math 2023-06-08T03:39:55.372 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/cordic.ko 2023-06-08T03:39:55.372 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6 2023-06-08T03:39:55.372 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/raid6_pq.ko 2023-06-08T03:39:55.372 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon 2023-06-08T03:39:55.373 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-08T03:39:55.373 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_bm.ko 2023-06-08T03:39:55.373 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_fsm.ko 2023-06-08T03:39:55.373 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_kmp.ko 2023-06-08T03:39:55.373 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/zstd 2023-06-08T03:39:55.373 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/zstd/zstd_compress.ko 2023-06-08T03:39:55.373 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm 2023-06-08T03:39:55.373 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/hwpoison-inject.ko 2023-06-08T03:39:55.374 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net 2023-06-08T03:39:55.374 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan 2023-06-08T03:39:55.374 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/6lowpan.ko 2023-06-08T03:39:55.374 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_dest.ko 2023-06-08T03:39:55.374 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_fragment.ko 2023-06-08T03:39:55.374 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_hop.ko 2023-06-08T03:39:55.374 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-08T03:39:55.374 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_mobility.ko 2023-06-08T03:39:55.375 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_routing.ko 2023-06-08T03:39:55.375 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_udp.ko 2023-06-08T03:39:55.375 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802 2023-06-08T03:39:55.375 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/garp.ko 2023-06-08T03:39:55.375 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/mrp.ko 2023-06-08T03:39:55.375 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/p8022.ko 2023-06-08T03:39:55.375 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/psnap.ko 2023-06-08T03:39:55.376 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/stp.ko 2023-06-08T03:39:55.376 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q 2023-06-08T03:39:55.376 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/8021q.ko 2023-06-08T03:39:55.376 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p 2023-06-08T03:39:55.376 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet.ko 2023-06-08T03:39:55.376 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_fd.ko 2023-06-08T03:39:55.376 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_rdma.ko 2023-06-08T03:39:55.376 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_virtio.ko 2023-06-08T03:39:55.377 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv 2023-06-08T03:39:55.377 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/batman-adv.ko 2023-06-08T03:39:55.377 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge 2023-06-08T03:39:55.377 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/br_netfilter.ko 2023-06-08T03:39:55.377 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/bridge.ko 2023-06-08T03:39:55.377 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter 2023-06-08T03:39:55.377 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-08T03:39:55.377 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-08T03:39:55.378 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-08T03:39:55.378 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-08T03:39:55.378 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-08T03:39:55.378 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-08T03:39:55.378 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-08T03:39:55.378 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-08T03:39:55.378 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-08T03:39:55.379 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-08T03:39:55.379 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-08T03:39:55.379 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-08T03:39:55.379 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-08T03:39:55.379 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-08T03:39:55.379 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-08T03:39:55.379 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-08T03:39:55.379 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-08T03:39:55.380 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-08T03:39:55.380 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-08T03:39:55.380 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-08T03:39:55.380 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtables.ko 2023-06-08T03:39:55.380 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-06-08T03:39:55.380 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-08T03:39:55.380 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-08T03:39:55.380 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph 2023-06-08T03:39:55.381 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/libceph.ko 2023-06-08T03:39:55.381 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core 2023-06-08T03:39:55.381 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/failover.ko 2023-06-08T03:39:55.381 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/pktgen.ko 2023-06-08T03:39:55.381 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp 2023-06-08T03:39:55.381 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp.ko 2023-06-08T03:39:55.381 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_diag.ko 2023-06-08T03:39:55.382 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv4.ko 2023-06-08T03:39:55.382 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv6.ko 2023-06-08T03:39:55.382 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dns_resolver 2023-06-08T03:39:55.382 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dns_resolver/dns_resolver.ko 2023-06-08T03:39:55.382 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa 2023-06-08T03:39:55.382 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/dsa_core.ko 2023-06-08T03:39:55.382 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_brcm.ko 2023-06-08T03:39:55.382 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_dsa.ko 2023-06-08T03:39:55.383 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_none.ko 2023-06-08T03:39:55.383 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_trailer.ko 2023-06-08T03:39:55.383 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154 2023-06-08T03:39:55.383 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan 2023-06-08T03:39:55.383 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-08T03:39:55.383 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154.ko 2023-06-08T03:39:55.383 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-08T03:39:55.383 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4 2023-06-08T03:39:55.384 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ah4.ko 2023-06-08T03:39:55.384 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/esp4.ko 2023-06-08T03:39:55.384 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/fou.ko 2023-06-08T03:39:55.384 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/gre.ko 2023-06-08T03:39:55.384 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/inet_diag.ko 2023-06-08T03:39:55.384 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_gre.ko 2023-06-08T03:39:55.384 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_tunnel.ko 2023-06-08T03:39:55.384 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_vti.ko 2023-06-08T03:39:55.385 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipcomp.ko 2023-06-08T03:39:55.385 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipip.ko 2023-06-08T03:39:55.385 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter 2023-06-08T03:39:55.385 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-08T03:39:55.385 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-08T03:39:55.385 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-08T03:39:55.385 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-08T03:39:55.386 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-08T03:39:55.386 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-08T03:39:55.386 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-08T03:39:55.386 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-08T03:39:55.386 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-08T03:39:55.386 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-08T03:39:55.386 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-08T03:39:55.386 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-08T03:39:55.387 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-08T03:39:55.387 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-08T03:39:55.387 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-08T03:39:55.387 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-08T03:39:55.387 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-08T03:39:55.387 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-08T03:39:55.387 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-08T03:39:55.387 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-08T03:39:55.388 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-08T03:39:55.388 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_bic.ko 2023-06-08T03:39:55.388 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_dctcp.ko 2023-06-08T03:39:55.388 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_diag.ko 2023-06-08T03:39:55.388 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_highspeed.ko 2023-06-08T03:39:55.388 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_htcp.ko 2023-06-08T03:39:55.388 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_hybla.ko 2023-06-08T03:39:55.389 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_illinois.ko 2023-06-08T03:39:55.389 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_lp.ko 2023-06-08T03:39:55.389 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_scalable.ko 2023-06-08T03:39:55.389 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_vegas.ko 2023-06-08T03:39:55.389 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_veno.ko 2023-06-08T03:39:55.389 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_westwood.ko 2023-06-08T03:39:55.389 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_yeah.ko 2023-06-08T03:39:55.389 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tunnel4.ko 2023-06-08T03:39:55.390 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_diag.ko 2023-06-08T03:39:55.390 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_tunnel.ko 2023-06-08T03:39:55.390 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-08T03:39:55.390 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6 2023-06-08T03:39:55.390 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ah6.ko 2023-06-08T03:39:55.390 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/esp6.ko 2023-06-08T03:39:55.390 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/fou6.ko 2023-06-08T03:39:55.391 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_tunnel.ko 2023-06-08T03:39:55.391 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-08T03:39:55.391 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_vti.ko 2023-06-08T03:39:55.391 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ipcomp6.ko 2023-06-08T03:39:55.391 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter 2023-06-08T03:39:55.391 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-08T03:39:55.391 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-08T03:39:55.391 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-08T03:39:55.392 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-08T03:39:55.392 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-08T03:39:55.392 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-08T03:39:55.392 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-08T03:39:55.392 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-08T03:39:55.392 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-08T03:39:55.392 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-08T03:39:55.393 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-08T03:39:55.393 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-08T03:39:55.393 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-08T03:39:55.393 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-08T03:39:55.393 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-08T03:39:55.393 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-08T03:39:55.393 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-08T03:39:55.393 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-08T03:39:55.394 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-08T03:39:55.394 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-08T03:39:55.394 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-08T03:39:55.394 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-08T03:39:55.394 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-08T03:39:55.394 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-08T03:39:55.394 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/sit.ko 2023-06-08T03:39:55.394 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/tunnel6.ko 2023-06-08T03:39:55.395 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-08T03:39:55.395 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key 2023-06-08T03:39:55.395 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/af_key.ko 2023-06-08T03:39:55.395 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp 2023-06-08T03:39:55.395 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_core.ko 2023-06-08T03:39:55.395 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-08T03:39:55.395 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_eth.ko 2023-06-08T03:39:55.396 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip.ko 2023-06-08T03:39:55.396 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip6.ko 2023-06-08T03:39:55.396 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_netlink.ko 2023-06-08T03:39:55.396 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ppp.ko 2023-06-08T03:39:55.396 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc 2023-06-08T03:39:55.396 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc.ko 2023-06-08T03:39:55.396 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154 2023-06-08T03:39:55.396 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/mac802154.ko 2023-06-08T03:39:55.397 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls 2023-06-08T03:39:55.397 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/mpls_gso.ko 2023-06-08T03:39:55.397 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter 2023-06-08T03:39:55.397 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset 2023-06-08T03:39:55.397 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set.ko 2023-06-08T03:39:55.397 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-08T03:39:55.397 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-08T03:39:55.397 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-08T03:39:55.398 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-08T03:39:55.398 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-08T03:39:55.398 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-08T03:39:55.398 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-08T03:39:55.398 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-08T03:39:55.398 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-08T03:39:55.398 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-08T03:39:55.399 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-08T03:39:55.399 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-08T03:39:55.399 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-08T03:39:55.399 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-08T03:39:55.399 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-08T03:39:55.399 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs 2023-06-08T03:39:55.399 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-08T03:39:55.400 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-08T03:39:55.400 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-08T03:39:55.400 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-08T03:39:55.401 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-08T03:39:55.401 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-08T03:39:55.401 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-08T03:39:55.401 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-08T03:39:55.401 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-08T03:39:55.402 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-08T03:39:55.402 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-08T03:39:55.402 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-08T03:39:55.402 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-08T03:39:55.402 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-08T03:39:55.402 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conncount.ko 2023-06-08T03:39:55.402 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack.ko 2023-06-08T03:39:55.403 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-08T03:39:55.403 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-08T03:39:55.403 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-08T03:39:55.403 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-08T03:39:55.403 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-08T03:39:55.403 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-08T03:39:55.403 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-08T03:39:55.404 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-08T03:39:55.404 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-08T03:39:55.404 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-08T03:39:55.404 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-08T03:39:55.404 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-08T03:39:55.404 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-08T03:39:55.404 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table.ko 2023-06-08T03:39:55.404 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-08T03:39:55.405 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_log_syslog.ko 2023-06-08T03:39:55.405 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat.ko 2023-06-08T03:39:55.405 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-08T03:39:55.405 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-08T03:39:55.405 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_irc.ko 2023-06-08T03:39:55.405 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_sip.ko 2023-06-08T03:39:55.405 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-08T03:39:55.406 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-08T03:39:55.406 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_tables.ko 2023-06-08T03:39:55.406 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink.ko 2023-06-08T03:39:55.406 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-08T03:39:55.406 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_log.ko 2023-06-08T03:39:55.406 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-08T03:39:55.406 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-08T03:39:55.406 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_chain_nat.ko 2023-06-08T03:39:55.407 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_compat.ko 2023-06-08T03:39:55.407 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_ct.ko 2023-06-08T03:39:55.407 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-08T03:39:55.407 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fib.ko 2023-06-08T03:39:55.407 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-08T03:39:55.407 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_hash.ko 2023-06-08T03:39:55.407 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_limit.ko 2023-06-08T03:39:55.407 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_log.ko 2023-06-08T03:39:55.408 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_masq.ko 2023-06-08T03:39:55.408 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_nat.ko 2023-06-08T03:39:55.408 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_numgen.ko 2023-06-08T03:39:55.408 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_queue.ko 2023-06-08T03:39:55.408 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_quota.ko 2023-06-08T03:39:55.408 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_redir.ko 2023-06-08T03:39:55.408 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject.ko 2023-06-08T03:39:55.409 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject_inet.ko 2023-06-08T03:39:55.409 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_socket.ko 2023-06-08T03:39:55.409 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_tunnel.ko 2023-06-08T03:39:55.409 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_AUDIT.ko 2023-06-08T03:39:55.409 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-08T03:39:55.409 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-08T03:39:55.409 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-08T03:39:55.409 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CT.ko 2023-06-08T03:39:55.410 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_DSCP.ko 2023-06-08T03:39:55.410 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HL.ko 2023-06-08T03:39:55.410 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HMARK.ko 2023-06-08T03:39:55.410 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-08T03:39:55.410 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LED.ko 2023-06-08T03:39:55.410 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LOG.ko 2023-06-08T03:39:55.410 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-08T03:39:55.410 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NETMAP.ko 2023-06-08T03:39:55.411 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFLOG.ko 2023-06-08T03:39:55.411 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-08T03:39:55.411 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_RATEEST.ko 2023-06-08T03:39:55.411 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-08T03:39:55.411 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_SECMARK.ko 2023-06-08T03:39:55.412 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-08T03:39:55.412 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-08T03:39:55.412 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TEE.ko 2023-06-08T03:39:55.412 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TPROXY.ko 2023-06-08T03:39:55.412 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TRACE.ko 2023-06-08T03:39:55.412 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_addrtype.ko 2023-06-08T03:39:55.412 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_bpf.ko 2023-06-08T03:39:55.413 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cgroup.ko 2023-06-08T03:39:55.413 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cluster.ko 2023-06-08T03:39:55.413 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_comment.ko 2023-06-08T03:39:55.413 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connbytes.ko 2023-06-08T03:39:55.413 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlabel.ko 2023-06-08T03:39:55.413 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlimit.ko 2023-06-08T03:39:55.414 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connmark.ko 2023-06-08T03:39:55.414 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_conntrack.ko 2023-06-08T03:39:55.414 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cpu.ko 2023-06-08T03:39:55.414 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dccp.ko 2023-06-08T03:39:55.414 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_devgroup.ko 2023-06-08T03:39:55.414 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dscp.ko 2023-06-08T03:39:55.415 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ecn.ko 2023-06-08T03:39:55.415 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_esp.ko 2023-06-08T03:39:55.415 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hashlimit.ko 2023-06-08T03:39:55.415 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_helper.ko 2023-06-08T03:39:55.415 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hl.ko 2023-06-08T03:39:55.415 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipcomp.ko 2023-06-08T03:39:55.415 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_iprange.ko 2023-06-08T03:39:55.416 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipvs.ko 2023-06-08T03:39:55.416 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_l2tp.ko 2023-06-08T03:39:55.416 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_length.ko 2023-06-08T03:39:55.416 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_limit.ko 2023-06-08T03:39:55.416 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mac.ko 2023-06-08T03:39:55.416 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mark.ko 2023-06-08T03:39:55.416 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_multiport.ko 2023-06-08T03:39:55.416 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nat.ko 2023-06-08T03:39:55.417 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nfacct.ko 2023-06-08T03:39:55.417 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_osf.ko 2023-06-08T03:39:55.417 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_owner.ko 2023-06-08T03:39:55.417 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_physdev.ko 2023-06-08T03:39:55.417 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_pkttype.ko 2023-06-08T03:39:55.417 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_policy.ko 2023-06-08T03:39:55.417 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_quota.ko 2023-06-08T03:39:55.417 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_rateest.ko 2023-06-08T03:39:55.418 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_realm.ko 2023-06-08T03:39:55.418 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_recent.ko 2023-06-08T03:39:55.418 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_sctp.ko 2023-06-08T03:39:55.418 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_set.ko 2023-06-08T03:39:55.418 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_socket.ko 2023-06-08T03:39:55.418 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_state.ko 2023-06-08T03:39:55.418 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_statistic.ko 2023-06-08T03:39:55.419 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_string.ko 2023-06-08T03:39:55.419 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpmss.ko 2023-06-08T03:39:55.419 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_time.ko 2023-06-08T03:39:55.419 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_u32.ko 2023-06-08T03:39:55.419 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink 2023-06-08T03:39:55.419 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/netlink_diag.ko 2023-06-08T03:39:55.419 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh 2023-06-08T03:39:55.419 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/nsh.ko 2023-06-08T03:39:55.420 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch 2023-06-08T03:39:55.420 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/openvswitch.ko 2023-06-08T03:39:55.420 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-geneve.ko 2023-06-08T03:39:55.420 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-gre.ko 2023-06-08T03:39:55.420 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-vxlan.ko 2023-06-08T03:39:55.420 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet 2023-06-08T03:39:55.420 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/af_packet_diag.ko 2023-06-08T03:39:55.420 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds 2023-06-08T03:39:55.421 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds.ko 2023-06-08T03:39:55.421 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_rdma.ko 2023-06-08T03:39:55.421 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_tcp.ko 2023-06-08T03:39:55.421 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched 2023-06-08T03:39:55.421 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_csum.ko 2023-06-08T03:39:55.421 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_gact.ko 2023-06-08T03:39:55.421 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_ipt.ko 2023-06-08T03:39:55.421 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_mirred.ko 2023-06-08T03:39:55.422 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_nat.ko 2023-06-08T03:39:55.422 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_pedit.ko 2023-06-08T03:39:55.422 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_police.ko 2023-06-08T03:39:55.422 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_simple.ko 2023-06-08T03:39:55.422 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_skbedit.ko 2023-06-08T03:39:55.422 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_vlan.ko 2023-06-08T03:39:55.422 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_basic.ko 2023-06-08T03:39:55.422 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_bpf.ko 2023-06-08T03:39:55.423 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_flow.ko 2023-06-08T03:39:55.423 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_fw.ko 2023-06-08T03:39:55.423 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_route.ko 2023-06-08T03:39:55.423 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_u32.ko 2023-06-08T03:39:55.423 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_cmp.ko 2023-06-08T03:39:55.423 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_ipset.ko 2023-06-08T03:39:55.423 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_meta.ko 2023-06-08T03:39:55.424 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_nbyte.ko 2023-06-08T03:39:55.424 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_text.ko 2023-06-08T03:39:55.424 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_u32.ko 2023-06-08T03:39:55.424 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_choke.ko 2023-06-08T03:39:55.424 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_codel.ko 2023-06-08T03:39:55.424 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_drr.ko 2023-06-08T03:39:55.424 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq.ko 2023-06-08T03:39:55.424 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_gred.ko 2023-06-08T03:39:55.425 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hfsc.ko 2023-06-08T03:39:55.425 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hhf.ko 2023-06-08T03:39:55.425 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_htb.ko 2023-06-08T03:39:55.425 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_ingress.ko 2023-06-08T03:39:55.425 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio.ko 2023-06-08T03:39:55.425 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio_lib.ko 2023-06-08T03:39:55.425 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_multiq.ko 2023-06-08T03:39:55.426 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_netem.ko 2023-06-08T03:39:55.426 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_pie.ko 2023-06-08T03:39:55.426 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_plug.ko 2023-06-08T03:39:55.426 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_prio.ko 2023-06-08T03:39:55.426 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_qfq.ko 2023-06-08T03:39:55.426 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_red.ko 2023-06-08T03:39:55.426 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfb.ko 2023-06-08T03:39:55.426 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfq.ko 2023-06-08T03:39:55.427 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_tbf.ko 2023-06-08T03:39:55.427 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_teql.ko 2023-06-08T03:39:55.427 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp 2023-06-08T03:39:55.427 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp.ko 2023-06-08T03:39:55.427 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp_diag.ko 2023-06-08T03:39:55.427 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc 2023-06-08T03:39:55.427 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss 2023-06-08T03:39:55.427 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-08T03:39:55.428 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-08T03:39:55.428 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/sunrpc.ko 2023-06-08T03:39:55.428 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma 2023-06-08T03:39:55.428 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-08T03:39:55.428 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc 2023-06-08T03:39:55.428 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/diag.ko 2023-06-08T03:39:55.428 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/tipc.ko 2023-06-08T03:39:55.429 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix 2023-06-08T03:39:55.429 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/unix_diag.ko 2023-06-08T03:39:55.429 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock 2023-06-08T03:39:55.429 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-08T03:39:55.429 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-08T03:39:55.429 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock.ko 2023-06-08T03:39:55.429 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-08T03:39:55.429 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-08T03:39:55.430 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm 2023-06-08T03:39:55.430 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-08T03:39:55.430 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security 2023-06-08T03:39:55.430 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security/keys 2023-06-08T03:39:55.430 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security/keys/encrypted-keys 2023-06-08T03:39:55.430 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-06-08T03:39:55.430 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security/keys/trusted-keys 2023-06-08T03:39:55.430 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security/keys/trusted-keys/trusted.ko 2023-06-08T03:39:55.431 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt 2023-06-08T03:39:55.431 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib 2023-06-08T03:39:55.431 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/irqbypass.ko 2023-06-08T03:39:55.431 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias 2023-06-08T03:39:55.431 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias.bin 2023-06-08T03:39:55.431 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin 2023-06-08T03:39:55.431 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.bin 2023-06-08T03:39:55.431 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.modinfo 2023-06-08T03:39:55.432 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep 2023-06-08T03:39:55.432 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep.bin 2023-06-08T03:39:55.432 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.devname 2023-06-08T03:39:55.432 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.order 2023-06-08T03:39:55.432 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.softdep 2023-06-08T03:39:55.432 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols 2023-06-08T03:39:55.432 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols.bin 2023-06-08T03:39:55.433 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:39:55.433 DEBUG:teuthology.orchestra.run.smithi169:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-06-08T03:39:55.460 INFO:teuthology.orchestra.run.smithi169.stdout:postinstall scriptlet (using /bin/sh): 2023-06-08T03:39:55.460 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 -a -r /boot/System.map-6.4.0-rc2-g10b2f20a4f46 ]; then 2023-06-08T03:39:55.461 INFO:teuthology.orchestra.run.smithi169.stdout:cp /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 /boot/.vmlinuz-6.4.0-rc2-g10b2f20a4f46-rpm 2023-06-08T03:39:55.461 INFO:teuthology.orchestra.run.smithi169.stdout:cp /boot/System.map-6.4.0-rc2-g10b2f20a4f46 /boot/.System.map-6.4.0-rc2-g10b2f20a4f46-rpm 2023-06-08T03:39:55.461 INFO:teuthology.orchestra.run.smithi169.stdout:rm -f /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 /boot/System.map-6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:39:55.461 INFO:teuthology.orchestra.run.smithi169.stdout:/sbin/installkernel 6.4.0-rc2-g10b2f20a4f46 /boot/.vmlinuz-6.4.0-rc2-g10b2f20a4f46-rpm /boot/.System.map-6.4.0-rc2-g10b2f20a4f46-rpm 2023-06-08T03:39:55.461 INFO:teuthology.orchestra.run.smithi169.stdout:rm -f /boot/.vmlinuz-6.4.0-rc2-g10b2f20a4f46-rpm /boot/.System.map-6.4.0-rc2-g10b2f20a4f46-rpm 2023-06-08T03:39:55.461 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2023-06-08T03:39:55.461 INFO:teuthology.orchestra.run.smithi169.stdout:preuninstall scriptlet (using /bin/sh): 2023-06-08T03:39:55.462 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-06-08T03:39:55.462 INFO:teuthology.orchestra.run.smithi169.stdout:new-kernel-pkg --remove 6.4.0-rc2-g10b2f20a4f46 --rminitrd --initrdfile=/boot/initramfs-6.4.0-rc2-g10b2f20a4f46.img 2023-06-08T03:39:55.462 INFO:teuthology.orchestra.run.smithi169.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-06-08T03:39:55.462 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-install remove 6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:39:55.462 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2023-06-08T03:39:55.462 INFO:teuthology.orchestra.run.smithi169.stdout:postuninstall scriptlet (using /bin/sh): 2023-06-08T03:39:55.462 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -x /sbin/update-bootloader ]; then 2023-06-08T03:39:55.462 INFO:teuthology.orchestra.run.smithi169.stdout:/sbin/update-bootloader --remove 6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:39:55.463 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2023-06-08T03:39:55.464 DEBUG:teuthology.orchestra.run.smithi169:> sudo rpm -qi grub2-tools 2023-06-08T03:39:55.552 INFO:teuthology.orchestra.run.smithi169.stdout:Name : grub2-tools 2023-06-08T03:39:55.552 INFO:teuthology.orchestra.run.smithi169.stdout:Epoch : 1 2023-06-08T03:39:55.552 INFO:teuthology.orchestra.run.smithi169.stdout:Version : 2.02 2023-06-08T03:39:55.552 INFO:teuthology.orchestra.run.smithi169.stdout:Release : 129.el8 2023-06-08T03:39:55.553 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: x86_64 2023-06-08T03:39:55.553 INFO:teuthology.orchestra.run.smithi169.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-06-08T03:39:55.553 INFO:teuthology.orchestra.run.smithi169.stdout:Group : System Environment/Base 2023-06-08T03:39:55.553 INFO:teuthology.orchestra.run.smithi169.stdout:Size : 9265586 2023-06-08T03:39:55.553 INFO:teuthology.orchestra.run.smithi169.stdout:License : GPLv3+ 2023-06-08T03:39:55.553 INFO:teuthology.orchestra.run.smithi169.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-06-08T03:39:55.553 INFO:teuthology.orchestra.run.smithi169.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-06-08T03:39:55.553 INFO:teuthology.orchestra.run.smithi169.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-06-08T03:39:55.554 INFO:teuthology.orchestra.run.smithi169.stdout:Build Host : kbuilder.bsys.centos.org 2023-06-08T03:39:55.554 INFO:teuthology.orchestra.run.smithi169.stdout:Relocations : (not relocatable) 2023-06-08T03:39:55.554 INFO:teuthology.orchestra.run.smithi169.stdout:Packager : CentOS BuildSystem 2023-06-08T03:39:55.554 INFO:teuthology.orchestra.run.smithi169.stdout:Vendor : CentOS 2023-06-08T03:39:55.554 INFO:teuthology.orchestra.run.smithi169.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-08T03:39:55.554 INFO:teuthology.orchestra.run.smithi169.stdout:Summary : Support tools for GRUB. 2023-06-08T03:39:55.554 INFO:teuthology.orchestra.run.smithi169.stdout:Description : 2023-06-08T03:39:55.555 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T03:39:55.555 INFO:teuthology.orchestra.run.smithi169.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-08T03:39:55.555 INFO:teuthology.orchestra.run.smithi169.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-08T03:39:55.555 INFO:teuthology.orchestra.run.smithi169.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-08T03:39:55.555 INFO:teuthology.orchestra.run.smithi169.stdout:hardware devices. 2023-06-08T03:39:55.555 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T03:39:55.555 INFO:teuthology.orchestra.run.smithi169.stdout:This subpackage provides tools for support of all platforms. 2023-06-08T03:39:55.556 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-08T03:39:55.556 INFO:teuthology.task.kernel:Updating grub on smithi169 to boot 6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:39:55.557 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-08T03:39:59.742 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2023-06-08T03:40:02.037 INFO:teuthology.orchestra.run.smithi169.stderr:done 2023-06-08T03:40:02.044 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2023-06-08T03:40:02.081 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.JoXOcRzfxE 2023-06-08T03:40:02.082 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JoXOcRzfxE 2023-06-08T03:40:02.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.JoXOcRzfxE 2023-06-08T03:40:02.313 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.JoXOcRzfxE is 6KB 2023-06-08T03:40:02.362 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.JoXOcRzfxE 2023-06-08T03:40:02.379 DEBUG:teuthology.orchestra.run.smithi169:> sudo /bin/ls /boot/loader/entries || true 2023-06-08T03:40:02.445 INFO:teuthology.orchestra.run.smithi169.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-06-08T03:40:02.445 INFO:teuthology.orchestra.run.smithi169.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-06-08T03:40:02.446 INFO:teuthology.orchestra.run.smithi169.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-06-08T03:40:02.446 INFO:teuthology.orchestra.run.smithi169.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-rc2-g10b2f20a4f46.conf 2023-06-08T03:40:02.447 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:40:02.629 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2023-06-08T03:40:07.141 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-06-08T03:40:07.142 DEBUG:teuthology.orchestra.run.smithi016:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-06-08T03:40:07.234 INFO:teuthology.orchestra.run.smithi016.stdout:/boot/System.map-6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:40:07.234 INFO:teuthology.orchestra.run.smithi016.stdout:/boot/config-6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:40:07.234 INFO:teuthology.orchestra.run.smithi016.stdout:/boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:40:07.234 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:40:07.235 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel 2023-06-08T03:40:07.235 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch 2023-06-08T03:40:07.235 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86 2023-06-08T03:40:07.235 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto 2023-06-08T03:40:07.235 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-08T03:40:07.235 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-08T03:40:07.235 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-08T03:40:07.236 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-08T03:40:07.236 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-08T03:40:07.236 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-08T03:40:07.236 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-08T03:40:07.236 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crc32c-intel.ko 2023-06-08T03:40:07.236 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-08T03:40:07.237 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-08T03:40:07.237 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-08T03:40:07.237 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-08T03:40:07.237 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-08T03:40:07.237 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-08T03:40:07.237 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-08T03:40:07.237 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-08T03:40:07.237 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-08T03:40:07.238 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-08T03:40:07.238 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-08T03:40:07.238 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-08T03:40:07.238 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel 2023-06-08T03:40:07.238 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu 2023-06-08T03:40:07.238 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce 2023-06-08T03:40:07.238 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-08T03:40:07.239 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm 2023-06-08T03:40:07.239 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-08T03:40:07.239 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-08T03:40:07.239 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm.ko 2023-06-08T03:40:07.239 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto 2023-06-08T03:40:07.239 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ansi_cprng.ko 2023-06-08T03:40:07.239 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/anubis.ko 2023-06-08T03:40:07.239 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/arc4.ko 2023-06-08T03:40:07.240 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx 2023-06-08T03:40:07.240 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_memcpy.ko 2023-06-08T03:40:07.240 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_pq.ko 2023-06-08T03:40:07.240 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-08T03:40:07.240 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_tx.ko 2023-06-08T03:40:07.240 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_xor.ko 2023-06-08T03:40:07.240 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/raid6test.ko 2023-06-08T03:40:07.240 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authenc.ko 2023-06-08T03:40:07.241 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authencesn.ko 2023-06-08T03:40:07.241 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blake2b_generic.ko 2023-06-08T03:40:07.241 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_common.ko 2023-06-08T03:40:07.241 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_generic.ko 2023-06-08T03:40:07.241 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/camellia_generic.ko 2023-06-08T03:40:07.241 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast5_generic.ko 2023-06-08T03:40:07.241 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast6_generic.ko 2023-06-08T03:40:07.242 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast_common.ko 2023-06-08T03:40:07.242 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ccm.ko 2023-06-08T03:40:07.242 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cmac.ko 2023-06-08T03:40:07.242 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crc32_generic.ko 2023-06-08T03:40:07.242 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_engine.ko 2023-06-08T03:40:07.242 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_user.ko 2023-06-08T03:40:07.242 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cts.ko 2023-06-08T03:40:07.242 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/des_generic.ko 2023-06-08T03:40:07.243 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/dh_generic.ko 2023-06-08T03:40:07.243 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/echainiv.ko 2023-06-08T03:40:07.243 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/essiv.ko 2023-06-08T03:40:07.243 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/fcrypt.ko 2023-06-08T03:40:07.243 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/khazad.ko 2023-06-08T03:40:07.244 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4.ko 2023-06-08T03:40:07.244 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4hc.ko 2023-06-08T03:40:07.244 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/md4.ko 2023-06-08T03:40:07.244 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/michael_mic.ko 2023-06-08T03:40:07.244 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcbc.ko 2023-06-08T03:40:07.244 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcrypt.ko 2023-06-08T03:40:07.244 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/rmd160.ko 2023-06-08T03:40:07.245 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/seed.ko 2023-06-08T03:40:07.245 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/serpent_generic.ko 2023-06-08T03:40:07.245 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tcrypt.ko 2023-06-08T03:40:07.245 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tea.ko 2023-06-08T03:40:07.245 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_common.ko 2023-06-08T03:40:07.245 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_generic.ko 2023-06-08T03:40:07.245 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/vmac.ko 2023-06-08T03:40:07.245 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/wp512.ko 2023-06-08T03:40:07.246 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xcbc.ko 2023-06-08T03:40:07.246 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xor.ko 2023-06-08T03:40:07.246 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xxhash_generic.ko 2023-06-08T03:40:07.246 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers 2023-06-08T03:40:07.246 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi 2023-06-08T03:40:07.246 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-08T03:40:07.246 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_pad.ko 2023-06-08T03:40:07.247 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/custom_method.ko 2023-06-08T03:40:07.247 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ec_sys.ko 2023-06-08T03:40:07.247 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/platform_profile.ko 2023-06-08T03:40:07.247 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbs.ko 2023-06-08T03:40:07.248 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbshc.ko 2023-06-08T03:40:07.248 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/video.ko 2023-06-08T03:40:07.248 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata 2023-06-08T03:40:07.248 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/acard-ahci.ko 2023-06-08T03:40:07.249 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci_platform.ko 2023-06-08T03:40:07.249 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ata_generic.ko 2023-06-08T03:40:07.249 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci_platform.ko 2023-06-08T03:40:07.249 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_acpi.ko 2023-06-08T03:40:07.249 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ali.ko 2023-06-08T03:40:07.249 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_amd.ko 2023-06-08T03:40:07.249 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_artop.ko 2023-06-08T03:40:07.250 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atiixp.ko 2023-06-08T03:40:07.250 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atp867x.ko 2023-06-08T03:40:07.250 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd640.ko 2023-06-08T03:40:07.250 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd64x.ko 2023-06-08T03:40:07.250 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cypress.ko 2023-06-08T03:40:07.250 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_efar.ko 2023-06-08T03:40:07.250 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt366.ko 2023-06-08T03:40:07.250 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt37x.ko 2023-06-08T03:40:07.251 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-08T03:40:07.251 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-08T03:40:07.251 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it8213.ko 2023-06-08T03:40:07.251 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it821x.ko 2023-06-08T03:40:07.251 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_jmicron.ko 2023-06-08T03:40:07.251 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_marvell.ko 2023-06-08T03:40:07.251 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_mpiix.ko 2023-06-08T03:40:07.251 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_netcell.ko 2023-06-08T03:40:07.252 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ninja32.ko 2023-06-08T03:40:07.252 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87410.ko 2023-06-08T03:40:07.252 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87415.ko 2023-06-08T03:40:07.252 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_oldpiix.ko 2023-06-08T03:40:07.252 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_opti.ko 2023-06-08T03:40:07.252 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_optidma.ko 2023-06-08T03:40:07.252 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pcmcia.ko 2023-06-08T03:40:07.253 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-08T03:40:07.253 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-08T03:40:07.253 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_piccolo.ko 2023-06-08T03:40:07.253 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rdc.ko 2023-06-08T03:40:07.253 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sch.ko 2023-06-08T03:40:07.253 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_serverworks.ko 2023-06-08T03:40:07.253 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sil680.ko 2023-06-08T03:40:07.254 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sis.ko 2023-06-08T03:40:07.254 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sl82c105.ko 2023-06-08T03:40:07.254 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_triflex.ko 2023-06-08T03:40:07.254 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_via.ko 2023-06-08T03:40:07.255 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pdc_adma.ko 2023-06-08T03:40:07.255 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_inic162x.ko 2023-06-08T03:40:07.255 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_mv.ko 2023-06-08T03:40:07.255 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_nv.ko 2023-06-08T03:40:07.255 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_promise.ko 2023-06-08T03:40:07.255 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_qstor.ko 2023-06-08T03:40:07.255 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil.ko 2023-06-08T03:40:07.255 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil24.ko 2023-06-08T03:40:07.256 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sis.ko 2023-06-08T03:40:07.256 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_svw.ko 2023-06-08T03:40:07.256 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sx4.ko 2023-06-08T03:40:07.256 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_uli.ko 2023-06-08T03:40:07.256 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_via.ko 2023-06-08T03:40:07.256 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_vsc.ko 2023-06-08T03:40:07.256 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay 2023-06-08T03:40:07.257 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ks0108.ko 2023-06-08T03:40:07.257 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/base 2023-06-08T03:40:07.257 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/base/regmap 2023-06-08T03:40:07.257 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/base/regmap/regmap-i2c.ko 2023-06-08T03:40:07.257 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma 2023-06-08T03:40:07.257 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/bcma.ko 2023-06-08T03:40:07.257 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block 2023-06-08T03:40:07.257 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe 2023-06-08T03:40:07.258 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/aoe.ko 2023-06-08T03:40:07.258 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/brd.ko 2023-06-08T03:40:07.258 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd 2023-06-08T03:40:07.258 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/drbd.ko 2023-06-08T03:40:07.258 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/floppy.ko 2023-06-08T03:40:07.258 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/loop.ko 2023-06-08T03:40:07.258 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx 2023-06-08T03:40:07.259 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-08T03:40:07.259 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/nbd.ko 2023-06-08T03:40:07.259 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk 2023-06-08T03:40:07.259 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/null_blk.ko 2023-06-08T03:40:07.259 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/pktcdvd.ko 2023-06-08T03:40:07.259 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/rbd.ko 2023-06-08T03:40:07.259 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/virtio_blk.ko 2023-06-08T03:40:07.260 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback 2023-06-08T03:40:07.260 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-08T03:40:07.260 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkfront.ko 2023-06-08T03:40:07.260 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram 2023-06-08T03:40:07.260 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/zram.ko 2023-06-08T03:40:07.260 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char 2023-06-08T03:40:07.260 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hangcheck-timer.ko 2023-06-08T03:40:07.261 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random 2023-06-08T03:40:07.261 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-08T03:40:07.261 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-08T03:40:07.261 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-08T03:40:07.261 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/via-rng.ko 2023-06-08T03:40:07.261 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-08T03:40:07.261 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi 2023-06-08T03:40:07.261 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-08T03:40:07.262 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-08T03:40:07.262 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-08T03:40:07.262 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-08T03:40:07.262 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-08T03:40:07.262 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-08T03:40:07.262 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/lp.ko 2023-06-08T03:40:07.262 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave 2023-06-08T03:40:07.263 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/mwave.ko 2023-06-08T03:40:07.263 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ppdev.ko 2023-06-08T03:40:07.263 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tlclk.ko 2023-06-08T03:40:07.263 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm 2023-06-08T03:40:07.263 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm.ko 2023-06-08T03:40:07.263 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-08T03:40:07.263 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-08T03:40:07.264 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-08T03:40:07.264 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_tis.ko 2023-06-08T03:40:07.264 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-06-08T03:40:07.264 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/uv_mmtimer.ko 2023-06-08T03:40:07.264 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/virtio_console.ko 2023-06-08T03:40:07.264 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq 2023-06-08T03:40:07.264 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-06-08T03:40:07.264 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-08T03:40:07.265 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-08T03:40:07.265 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-06-08T03:40:07.265 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/powernow-k8.ko 2023-06-08T03:40:07.265 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-08T03:40:07.265 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto 2023-06-08T03:40:07.265 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp 2023-06-08T03:40:07.265 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-08T03:40:07.265 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp.ko 2023-06-08T03:40:07.266 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel 2023-06-08T03:40:07.266 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat 2023-06-08T03:40:07.266 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common 2023-06-08T03:40:07.266 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-08T03:40:07.266 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-06-08T03:40:07.266 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-08T03:40:07.266 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-aes.ko 2023-06-08T03:40:07.267 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-sha.ko 2023-06-08T03:40:07.267 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio 2023-06-08T03:40:07.267 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-08T03:40:07.267 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca 2023-06-08T03:40:07.267 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/dca.ko 2023-06-08T03:40:07.267 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/devfreq 2023-06-08T03:40:07.267 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-06-08T03:40:07.267 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma 2023-06-08T03:40:07.268 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw 2023-06-08T03:40:07.268 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-08T03:40:07.268 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat 2023-06-08T03:40:07.268 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-08T03:40:07.268 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac 2023-06-08T03:40:07.268 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/amd64_edac.ko 2023-06-08T03:40:07.269 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/e752x_edac.ko 2023-06-08T03:40:07.269 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/edac_mce_amd.ko 2023-06-08T03:40:07.269 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3000_edac.ko 2023-06-08T03:40:07.270 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3200_edac.ko 2023-06-08T03:40:07.270 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5100_edac.ko 2023-06-08T03:40:07.270 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5400_edac.ko 2023-06-08T03:40:07.270 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7300_edac.ko 2023-06-08T03:40:07.270 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7core_edac.ko 2023-06-08T03:40:07.270 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i82975x_edac.ko 2023-06-08T03:40:07.271 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ie31200_edac.ko 2023-06-08T03:40:07.271 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/sb_edac.ko 2023-06-08T03:40:07.271 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/x38_edac.ko 2023-06-08T03:40:07.271 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware 2023-06-08T03:40:07.271 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/edd.ko 2023-06-08T03:40:07.271 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-08T03:40:07.271 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio 2023-06-08T03:40:07.272 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ich.ko 2023-06-08T03:40:07.272 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-08T03:40:07.272 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid 2023-06-08T03:40:07.272 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-appleir.ko 2023-06-08T03:40:07.272 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-aureal.ko 2023-06-08T03:40:07.272 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-axff.ko 2023-06-08T03:40:07.272 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-dr.ko 2023-06-08T03:40:07.273 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elecom.ko 2023-06-08T03:40:07.273 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elo.ko 2023-06-08T03:40:07.273 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-emsff.ko 2023-06-08T03:40:07.273 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gaff.ko 2023-06-08T03:40:07.273 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gt683r.ko 2023-06-08T03:40:07.273 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gyration.ko 2023-06-08T03:40:07.273 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-08T03:40:07.274 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-08T03:40:07.274 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtekff.ko 2023-06-08T03:40:07.274 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-hyperv.ko 2023-06-08T03:40:07.274 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-icade.ko 2023-06-08T03:40:07.274 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-keytouch.ko 2023-06-08T03:40:07.274 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kye.ko 2023-06-08T03:40:07.274 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lcpower.ko 2023-06-08T03:40:07.275 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-led.ko 2023-06-08T03:40:07.275 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lenovo.ko 2023-06-08T03:40:07.275 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-08T03:40:07.275 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-08T03:40:07.275 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-multitouch.ko 2023-06-08T03:40:07.275 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ortek.ko 2023-06-08T03:40:07.275 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-penmount.ko 2023-06-08T03:40:07.276 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-petalynx.ko 2023-06-08T03:40:07.277 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-picolcd.ko 2023-06-08T03:40:07.277 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-pl.ko 2023-06-08T03:40:07.277 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-plantronics.ko 2023-06-08T03:40:07.277 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-primax.ko 2023-06-08T03:40:07.277 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-rmi.ko 2023-06-08T03:40:07.277 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-08T03:40:07.277 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-common.ko 2023-06-08T03:40:07.278 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-08T03:40:07.278 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-08T03:40:07.278 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-08T03:40:07.278 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-08T03:40:07.278 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-08T03:40:07.278 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-08T03:40:07.278 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-08T03:40:07.279 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-08T03:40:07.279 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-08T03:40:07.279 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat.ko 2023-06-08T03:40:07.279 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-saitek.ko 2023-06-08T03:40:07.279 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-samsung.ko 2023-06-08T03:40:07.279 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-08T03:40:07.279 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sjoy.ko 2023-06-08T03:40:07.280 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sony.ko 2023-06-08T03:40:07.280 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-speedlink.ko 2023-06-08T03:40:07.280 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-steelseries.ko 2023-06-08T03:40:07.280 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sunplus.ko 2023-06-08T03:40:07.280 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-08T03:40:07.280 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tivo.ko 2023-06-08T03:40:07.280 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tmff.ko 2023-06-08T03:40:07.281 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-topseed.ko 2023-06-08T03:40:07.281 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-twinhan.ko 2023-06-08T03:40:07.281 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-uclogic.ko 2023-06-08T03:40:07.281 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-waltop.ko 2023-06-08T03:40:07.281 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-wiimote.ko 2023-06-08T03:40:07.281 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-xinmo.ko 2023-06-08T03:40:07.281 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zpff.ko 2023-06-08T03:40:07.282 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zydacron.ko 2023-06-08T03:40:07.282 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/uhid.ko 2023-06-08T03:40:07.282 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/wacom.ko 2023-06-08T03:40:07.282 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv 2023-06-08T03:40:07.282 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_balloon.ko 2023-06-08T03:40:07.282 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_utils.ko 2023-06-08T03:40:07.282 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_vmbus.ko 2023-06-08T03:40:07.283 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon 2023-06-08T03:40:07.283 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru.ko 2023-06-08T03:40:07.283 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru3.ko 2023-06-08T03:40:07.283 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-08T03:40:07.283 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7414.ko 2023-06-08T03:40:07.283 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7418.ko 2023-06-08T03:40:07.284 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adc128d818.ko 2023-06-08T03:40:07.284 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1025.ko 2023-06-08T03:40:07.284 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1026.ko 2023-06-08T03:40:07.284 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1029.ko 2023-06-08T03:40:07.284 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1031.ko 2023-06-08T03:40:07.284 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm9240.ko 2023-06-08T03:40:07.284 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ads7828.ko 2023-06-08T03:40:07.285 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7410.ko 2023-06-08T03:40:07.285 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7411.ko 2023-06-08T03:40:07.285 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7462.ko 2023-06-08T03:40:07.285 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7470.ko 2023-06-08T03:40:07.285 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7475.ko 2023-06-08T03:40:07.285 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7x10.ko 2023-06-08T03:40:07.285 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/amc6821.ko 2023-06-08T03:40:07.286 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/applesmc.ko 2023-06-08T03:40:07.286 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asb100.ko 2023-06-08T03:40:07.286 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asc7621.ko 2023-06-08T03:40:07.286 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-08T03:40:07.286 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/atxp1.ko 2023-06-08T03:40:07.286 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/coretemp.ko 2023-06-08T03:40:07.287 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-08T03:40:07.287 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dme1737.ko 2023-06-08T03:40:07.287 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds1621.ko 2023-06-08T03:40:07.287 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds620.ko 2023-06-08T03:40:07.287 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc1403.ko 2023-06-08T03:40:07.288 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc6w201.ko 2023-06-08T03:40:07.288 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71805f.ko 2023-06-08T03:40:07.288 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71882fg.ko 2023-06-08T03:40:07.288 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f75375s.ko 2023-06-08T03:40:07.288 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fam15h_power.ko 2023-06-08T03:40:07.288 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fschmd.ko 2023-06-08T03:40:07.288 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g760a.ko 2023-06-08T03:40:07.289 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g762.ko 2023-06-08T03:40:07.289 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl518sm.ko 2023-06-08T03:40:07.289 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl520sm.ko 2023-06-08T03:40:07.289 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-08T03:40:07.289 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5500_temp.ko 2023-06-08T03:40:07.289 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5k_amb.ko 2023-06-08T03:40:07.289 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmaem.ko 2023-06-08T03:40:07.290 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmpex.ko 2023-06-08T03:40:07.290 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina209.ko 2023-06-08T03:40:07.290 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina2xx.ko 2023-06-08T03:40:07.290 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/it87.ko 2023-06-08T03:40:07.290 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k10temp.ko 2023-06-08T03:40:07.290 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k8temp.ko 2023-06-08T03:40:07.290 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lineage-pem.ko 2023-06-08T03:40:07.290 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm63.ko 2023-06-08T03:40:07.291 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm73.ko 2023-06-08T03:40:07.291 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm75.ko 2023-06-08T03:40:07.291 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm77.ko 2023-06-08T03:40:07.291 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm78.ko 2023-06-08T03:40:07.291 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm80.ko 2023-06-08T03:40:07.291 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm83.ko 2023-06-08T03:40:07.291 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm85.ko 2023-06-08T03:40:07.292 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm87.ko 2023-06-08T03:40:07.292 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm90.ko 2023-06-08T03:40:07.292 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm92.ko 2023-06-08T03:40:07.292 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm93.ko 2023-06-08T03:40:07.292 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95234.ko 2023-06-08T03:40:07.292 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95241.ko 2023-06-08T03:40:07.292 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95245.ko 2023-06-08T03:40:07.292 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc2945.ko 2023-06-08T03:40:07.293 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4151.ko 2023-06-08T03:40:07.293 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4215.ko 2023-06-08T03:40:07.293 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4222.ko 2023-06-08T03:40:07.293 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4245.ko 2023-06-08T03:40:07.293 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4260.ko 2023-06-08T03:40:07.293 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4261.ko 2023-06-08T03:40:07.294 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max16065.ko 2023-06-08T03:40:07.294 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1619.ko 2023-06-08T03:40:07.294 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1668.ko 2023-06-08T03:40:07.294 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max197.ko 2023-06-08T03:40:07.294 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6639.ko 2023-06-08T03:40:07.294 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6650.ko 2023-06-08T03:40:07.294 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6697.ko 2023-06-08T03:40:07.294 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mcp3021.ko 2023-06-08T03:40:07.295 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6683.ko 2023-06-08T03:40:07.295 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775-core.ko 2023-06-08T03:40:07.295 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775.ko 2023-06-08T03:40:07.295 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct7802.ko 2023-06-08T03:40:07.295 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87360.ko 2023-06-08T03:40:07.295 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87427.ko 2023-06-08T03:40:07.295 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pcf8591.ko 2023-06-08T03:40:07.295 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus 2023-06-08T03:40:07.296 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-08T03:40:07.296 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-08T03:40:07.296 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-08T03:40:07.296 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-08T03:40:07.296 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-08T03:40:07.296 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-08T03:40:07.296 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-08T03:40:07.297 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-08T03:40:07.297 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-08T03:40:07.297 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-08T03:40:07.297 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-08T03:40:07.297 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-08T03:40:07.298 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/powr1220.ko 2023-06-08T03:40:07.298 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5627.ko 2023-06-08T03:40:07.298 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5636.ko 2023-06-08T03:40:07.298 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-08T03:40:07.298 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht15.ko 2023-06-08T03:40:07.298 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht21.ko 2023-06-08T03:40:07.298 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/shtc1.ko 2023-06-08T03:40:07.299 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sis5595.ko 2023-06-08T03:40:07.299 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47b397.ko 2023-06-08T03:40:07.299 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m1.ko 2023-06-08T03:40:07.299 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m192.ko 2023-06-08T03:40:07.299 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/thmc50.ko 2023-06-08T03:40:07.299 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp102.ko 2023-06-08T03:40:07.299 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp103.ko 2023-06-08T03:40:07.299 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp401.ko 2023-06-08T03:40:07.300 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp421.ko 2023-06-08T03:40:07.300 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via-cputemp.ko 2023-06-08T03:40:07.300 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via686a.ko 2023-06-08T03:40:07.300 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt1211.ko 2023-06-08T03:40:07.300 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt8231.ko 2023-06-08T03:40:07.300 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627ehf.ko 2023-06-08T03:40:07.300 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627hf.ko 2023-06-08T03:40:07.301 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83781d.ko 2023-06-08T03:40:07.301 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83791d.ko 2023-06-08T03:40:07.301 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83792d.ko 2023-06-08T03:40:07.301 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83793.ko 2023-06-08T03:40:07.301 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83795.ko 2023-06-08T03:40:07.301 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l785ts.ko 2023-06-08T03:40:07.301 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l786ng.ko 2023-06-08T03:40:07.301 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c 2023-06-08T03:40:07.302 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos 2023-06-08T03:40:07.302 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-08T03:40:07.302 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-08T03:40:07.302 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses 2023-06-08T03:40:07.302 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-08T03:40:07.302 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-08T03:40:07.302 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-08T03:40:07.303 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-08T03:40:07.303 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-08T03:40:07.303 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-08T03:40:07.303 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-08T03:40:07.303 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-08T03:40:07.303 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-08T03:40:07.303 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-08T03:40:07.303 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-08T03:40:07.304 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-08T03:40:07.304 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-08T03:40:07.304 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-08T03:40:07.304 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-08T03:40:07.304 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-08T03:40:07.304 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-08T03:40:07.304 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-08T03:40:07.305 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-08T03:40:07.305 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-08T03:40:07.305 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-08T03:40:07.305 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-08T03:40:07.305 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-08T03:40:07.305 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-dev.ko 2023-06-08T03:40:07.305 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-mux.ko 2023-06-08T03:40:07.305 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-06-08T03:40:07.306 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-smbus.ko 2023-06-08T03:40:07.306 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-stub.ko 2023-06-08T03:40:07.306 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband 2023-06-08T03:40:07.306 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core 2023-06-08T03:40:07.306 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-08T03:40:07.306 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_core.ko 2023-06-08T03:40:07.306 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-08T03:40:07.307 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-08T03:40:07.307 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-08T03:40:07.307 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-08T03:40:07.307 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-08T03:40:07.307 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw 2023-06-08T03:40:07.307 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4 2023-06-08T03:40:07.307 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-08T03:40:07.307 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4 2023-06-08T03:40:07.308 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-08T03:40:07.308 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5 2023-06-08T03:40:07.308 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-08T03:40:07.308 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca 2023-06-08T03:40:07.308 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-08T03:40:07.308 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp 2023-06-08T03:40:07.308 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib 2023-06-08T03:40:07.309 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-08T03:40:07.309 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser 2023-06-08T03:40:07.309 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-08T03:40:07.309 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert 2023-06-08T03:40:07.309 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-08T03:40:07.309 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp 2023-06-08T03:40:07.309 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-08T03:40:07.310 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt 2023-06-08T03:40:07.310 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-08T03:40:07.310 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input 2023-06-08T03:40:07.310 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport 2023-06-08T03:40:07.310 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-08T03:40:07.310 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-08T03:40:07.310 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/gameport.ko 2023-06-08T03:40:07.310 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/lightning.ko 2023-06-08T03:40:07.311 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ns558.ko 2023-06-08T03:40:07.311 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/joydev.ko 2023-06-08T03:40:07.311 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard 2023-06-08T03:40:07.311 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-08T03:40:07.311 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse 2023-06-08T03:40:07.311 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/appletouch.ko 2023-06-08T03:40:07.311 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/bcm5974.ko 2023-06-08T03:40:07.311 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/cyapatp.ko 2023-06-08T03:40:07.312 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-08T03:40:07.312 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/sermouse.ko 2023-06-08T03:40:07.312 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-08T03:40:07.312 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-08T03:40:07.312 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-08T03:40:07.312 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4 2023-06-08T03:40:07.312 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-08T03:40:07.312 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio 2023-06-08T03:40:07.313 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/altera_ps2.ko 2023-06-08T03:40:07.313 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/arc_ps2.ko 2023-06-08T03:40:07.313 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-08T03:40:07.313 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serio_raw.ko 2023-06-08T03:40:07.313 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/sparse-keymap.ko 2023-06-08T03:40:07.313 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu 2023-06-08T03:40:07.313 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd 2023-06-08T03:40:07.314 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-08T03:40:07.314 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds 2023-06-08T03:40:07.314 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-blinkm.ko 2023-06-08T03:40:07.314 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3530.ko 2023-06-08T03:40:07.314 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp3944.ko 2023-06-08T03:40:07.314 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-ss4200.ko 2023-06-08T03:40:07.314 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger 2023-06-08T03:40:07.314 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-08T03:40:07.315 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-08T03:40:07.315 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-08T03:40:07.315 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-08T03:40:07.315 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-08T03:40:07.315 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-08T03:40:07.315 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-08T03:40:07.315 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-08T03:40:07.316 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md 2023-06-08T03:40:07.316 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache 2023-06-08T03:40:07.316 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/bcache.ko 2023-06-08T03:40:07.316 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bio-prison.ko 2023-06-08T03:40:07.316 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache-smq.ko 2023-06-08T03:40:07.316 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache.ko 2023-06-08T03:40:07.316 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-crypt.ko 2023-06-08T03:40:07.316 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-delay.ko 2023-06-08T03:40:07.317 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-flakey.ko 2023-06-08T03:40:07.317 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log-userspace.ko 2023-06-08T03:40:07.317 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-multipath.ko 2023-06-08T03:40:07.317 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-queue-length.ko 2023-06-08T03:40:07.317 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-raid.ko 2023-06-08T03:40:07.317 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-round-robin.ko 2023-06-08T03:40:07.317 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-service-time.ko 2023-06-08T03:40:07.318 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-switch.ko 2023-06-08T03:40:07.318 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-thin-pool.ko 2023-06-08T03:40:07.318 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-verity.ko 2023-06-08T03:40:07.318 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/faulty.ko 2023-06-08T03:40:07.318 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/linear.ko 2023-06-08T03:40:07.318 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/multipath.ko 2023-06-08T03:40:07.318 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data 2023-06-08T03:40:07.318 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-08T03:40:07.319 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid0.ko 2023-06-08T03:40:07.319 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid1.ko 2023-06-08T03:40:07.319 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid10.ko 2023-06-08T03:40:07.319 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid456.ko 2023-06-08T03:40:07.319 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message 2023-06-08T03:40:07.319 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion 2023-06-08T03:40:07.319 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptbase.ko 2023-06-08T03:40:07.319 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptctl.ko 2023-06-08T03:40:07.320 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptfc.ko 2023-06-08T03:40:07.320 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptlan.ko 2023-06-08T03:40:07.320 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptsas.ko 2023-06-08T03:40:07.320 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptscsih.ko 2023-06-08T03:40:07.320 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptspi.ko 2023-06-08T03:40:07.320 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd 2023-06-08T03:40:07.320 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_ich.ko 2023-06-08T03:40:07.321 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_sch.ko 2023-06-08T03:40:07.321 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mfd-core.ko 2023-06-08T03:40:07.321 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/sm501.ko 2023-06-08T03:40:07.321 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/viperboard.ko 2023-06-08T03:40:07.321 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/vx855.ko 2023-06-08T03:40:07.321 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wl1273-core.ko 2023-06-08T03:40:07.321 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc 2023-06-08T03:40:07.321 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl 2023-06-08T03:40:07.322 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-08T03:40:07.322 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds9802als.ko 2023-06-08T03:40:07.322 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds990x.ko 2023-06-08T03:40:07.322 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/bh1770glc.ko 2023-06-08T03:40:07.322 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710 2023-06-08T03:40:07.322 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/cb710.ko 2023-06-08T03:40:07.322 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom 2023-06-08T03:40:07.322 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/at24.ko 2023-06-08T03:40:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-08T03:40:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-08T03:40:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/max6875.ko 2023-06-08T03:40:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/enclosure.ko 2023-06-08T03:40:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hpilo.ko 2023-06-08T03:40:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29003.ko 2023-06-08T03:40:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29020.ko 2023-06-08T03:40:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d 2023-06-08T03:40:07.324 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-08T03:40:07.324 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-08T03:40:07.324 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei 2023-06-08T03:40:07.324 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-me.ko 2023-06-08T03:40:07.324 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-txe.ko 2023-06-08T03:40:07.324 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei.ko 2023-06-08T03:40:07.324 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-gru 2023-06-08T03:40:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-gru/gru.ko 2023-06-08T03:40:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-xp 2023-06-08T03:40:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-xp/xp.ko 2023-06-08T03:40:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-xp/xpc.ko 2023-06-08T03:40:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-06-08T03:40:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_7xx1.ko 2023-06-08T03:40:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_core.ko 2023-06-08T03:40:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tsl2550.ko 2023-06-08T03:40:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_balloon.ko 2023-06-08T03:40:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci 2023-06-08T03:40:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-08T03:40:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net 2023-06-08T03:40:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding 2023-06-08T03:40:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/bonding.ko 2023-06-08T03:40:07.326 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa 2023-06-08T03:40:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53 2023-06-08T03:40:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-08T03:40:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-08T03:40:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-08T03:40:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx 2023-06-08T03:40:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-08T03:40:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dummy.ko 2023-06-08T03:40:07.327 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/eql.ko 2023-06-08T03:40:07.328 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet 2023-06-08T03:40:07.328 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com 2023-06-08T03:40:07.328 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-08T03:40:07.328 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-08T03:40:07.328 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-08T03:40:07.328 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-08T03:40:07.328 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390 2023-06-08T03:40:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-08T03:40:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-08T03:40:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-08T03:40:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-08T03:40:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec 2023-06-08T03:40:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-08T03:40:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere 2023-06-08T03:40:07.329 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-08T03:40:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon 2023-06-08T03:40:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-08T03:40:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera 2023-06-08T03:40:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-08T03:40:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd 2023-06-08T03:40:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-08T03:40:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-08T03:40:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-08T03:40:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros 2023-06-08T03:40:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx 2023-06-08T03:40:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-08T03:40:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c 2023-06-08T03:40:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-08T03:40:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e 2023-06-08T03:40:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-08T03:40:07.332 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx 2023-06-08T03:40:07.332 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-08T03:40:07.332 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-08T03:40:07.332 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom 2023-06-08T03:40:07.332 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-08T03:40:07.332 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-08T03:40:07.332 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-06-08T03:40:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-08T03:40:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-08T03:40:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet 2023-06-08T03:40:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-08T03:40:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-08T03:40:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade 2023-06-08T03:40:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna 2023-06-08T03:40:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-08T03:40:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio 2023-06-08T03:40:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb 2023-06-08T03:40:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-08T03:40:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-06-08T03:40:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-08T03:40:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-06-08T03:40:07.334 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-08T03:40:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-06-08T03:40:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-08T03:40:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-06-08T03:40:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-08T03:40:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco 2023-06-08T03:40:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic 2023-06-08T03:40:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-08T03:40:07.335 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec 2023-06-08T03:40:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip 2023-06-08T03:40:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-08T03:40:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-08T03:40:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-08T03:40:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-08T03:40:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-08T03:40:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-08T03:40:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink 2023-06-08T03:40:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-08T03:40:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-08T03:40:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dnet.ko 2023-06-08T03:40:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex 2023-06-08T03:40:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet 2023-06-08T03:40:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-08T03:40:07.337 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ethoc.ko 2023-06-08T03:40:07.338 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fealnx.ko 2023-06-08T03:40:07.338 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel 2023-06-08T03:40:07.338 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-08T03:40:07.338 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000 2023-06-08T03:40:07.338 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-08T03:40:07.338 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e 2023-06-08T03:40:07.338 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-08T03:40:07.338 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k 2023-06-08T03:40:07.339 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-08T03:40:07.339 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e 2023-06-08T03:40:07.339 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-08T03:40:07.339 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf 2023-06-08T03:40:07.339 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-08T03:40:07.339 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb 2023-06-08T03:40:07.339 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-08T03:40:07.340 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf 2023-06-08T03:40:07.340 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-08T03:40:07.340 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe 2023-06-08T03:40:07.340 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-08T03:40:07.340 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf 2023-06-08T03:40:07.340 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-08T03:40:07.340 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/jme.ko 2023-06-08T03:40:07.341 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell 2023-06-08T03:40:07.341 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-08T03:40:07.341 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-08T03:40:07.341 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-08T03:40:07.341 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox 2023-06-08T03:40:07.341 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4 2023-06-08T03:40:07.341 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-08T03:40:07.341 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-08T03:40:07.342 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5 2023-06-08T03:40:07.342 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-06-08T03:40:07.342 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-08T03:40:07.342 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel 2023-06-08T03:40:07.342 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-08T03:40:07.342 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom 2023-06-08T03:40:07.342 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge 2023-06-08T03:40:07.343 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-08T03:40:07.343 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi 2023-06-08T03:40:07.343 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-08T03:40:07.343 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-08T03:40:07.343 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion 2023-06-08T03:40:07.343 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-08T03:40:07.343 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia 2023-06-08T03:40:07.343 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-08T03:40:07.344 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines 2023-06-08T03:40:07.344 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-08T03:40:07.344 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-08T03:40:07.344 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic 2023-06-08T03:40:07.344 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen 2023-06-08T03:40:07.344 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-08T03:40:07.344 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-08T03:40:07.344 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-06-08T03:40:07.345 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-08T03:40:07.345 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc 2023-06-08T03:40:07.345 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-08T03:40:07.345 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek 2023-06-08T03:40:07.345 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-08T03:40:07.345 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-08T03:40:07.345 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-08T03:40:07.346 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-08T03:40:07.346 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rocker 2023-06-08T03:40:07.346 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-06-08T03:40:07.346 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc 2023-06-08T03:40:07.346 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-08T03:40:07.346 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan 2023-06-08T03:40:07.346 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-08T03:40:07.346 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis 2023-06-08T03:40:07.347 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-08T03:40:07.347 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-08T03:40:07.347 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc 2023-06-08T03:40:07.347 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-08T03:40:07.347 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-08T03:40:07.347 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-08T03:40:07.347 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-08T03:40:07.347 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro 2023-06-08T03:40:07.348 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac 2023-06-08T03:40:07.348 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-08T03:40:07.348 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-08T03:40:07.348 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun 2023-06-08T03:40:07.348 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-08T03:40:07.348 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-08T03:40:07.348 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-08T03:40:07.349 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-08T03:40:07.349 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti 2023-06-08T03:40:07.349 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-08T03:40:07.349 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti 2023-06-08T03:40:07.349 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-08T03:40:07.349 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via 2023-06-08T03:40:07.349 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-08T03:40:07.350 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-08T03:40:07.350 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet 2023-06-08T03:40:07.350 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-08T03:40:07.350 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-08T03:40:07.350 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom 2023-06-08T03:40:07.350 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-08T03:40:07.350 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/geneve.ko 2023-06-08T03:40:07.350 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv 2023-06-08T03:40:07.351 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-08T03:40:07.351 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154 2023-06-08T03:40:07.351 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-08T03:40:07.351 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ifb.ko 2023-06-08T03:40:07.351 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan 2023-06-08T03:40:07.351 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-08T03:40:07.351 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvlan.ko 2023-06-08T03:40:07.351 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvtap.ko 2023-06-08T03:40:07.352 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio 2023-06-08T03:40:07.352 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio.ko 2023-06-08T03:40:07.352 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-08T03:40:07.352 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-08T03:40:07.352 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mii.ko 2023-06-08T03:40:07.352 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/net_failover.ko 2023-06-08T03:40:07.352 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/netconsole.ko 2023-06-08T03:40:07.353 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/nlmon.ko 2023-06-08T03:40:07.353 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs 2023-06-08T03:40:07.353 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-08T03:40:07.353 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-08T03:40:07.353 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy 2023-06-08T03:40:07.353 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/amd.ko 2023-06-08T03:40:07.353 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-08T03:40:07.353 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-06-08T03:40:07.354 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-08T03:40:07.354 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm87xx.ko 2023-06-08T03:40:07.354 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/broadcom.ko 2023-06-08T03:40:07.354 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/cicada.ko 2023-06-08T03:40:07.354 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/davicom.ko 2023-06-08T03:40:07.354 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/dp83640.ko 2023-06-08T03:40:07.354 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/et1011c.ko 2023-06-08T03:40:07.354 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/icplus.ko 2023-06-08T03:40:07.355 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/lxt.ko 2023-06-08T03:40:07.355 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/marvell.ko 2023-06-08T03:40:07.355 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/micrel.ko 2023-06-08T03:40:07.355 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/national.ko 2023-06-08T03:40:07.355 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/phylink.ko 2023-06-08T03:40:07.355 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/qsemi.ko 2023-06-08T03:40:07.355 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/realtek.ko 2023-06-08T03:40:07.355 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/smsc.ko 2023-06-08T03:40:07.356 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ste10Xp.ko 2023-06-08T03:40:07.356 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/vitesse.ko 2023-06-08T03:40:07.356 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp 2023-06-08T03:40:07.356 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-08T03:40:07.356 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_async.ko 2023-06-08T03:40:07.356 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-08T03:40:07.356 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_generic.ko 2023-06-08T03:40:07.357 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-08T03:40:07.357 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-08T03:40:07.357 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppoe.ko 2023-06-08T03:40:07.357 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppox.ko 2023-06-08T03:40:07.357 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pptp.ko 2023-06-08T03:40:07.357 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip 2023-06-08T03:40:07.357 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/slhc.ko 2023-06-08T03:40:07.357 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/slip.ko 2023-06-08T03:40:07.358 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sungem_phy.ko 2023-06-08T03:40:07.358 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/tap.ko 2023-06-08T03:40:07.358 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team 2023-06-08T03:40:07.358 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team.ko 2023-06-08T03:40:07.358 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-08T03:40:07.358 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-08T03:40:07.358 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-08T03:40:07.358 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_random.ko 2023-06-08T03:40:07.359 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-08T03:40:07.359 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/tun.ko 2023-06-08T03:40:07.359 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/veth.ko 2023-06-08T03:40:07.359 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/virtio_net.ko 2023-06-08T03:40:07.359 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3 2023-06-08T03:40:07.359 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-08T03:40:07.359 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan 2023-06-08T03:40:07.360 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/vxlan.ko 2023-06-08T03:40:07.360 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback 2023-06-08T03:40:07.360 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-08T03:40:07.360 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netfront.ko 2023-06-08T03:40:07.360 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb 2023-06-08T03:40:07.360 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ntb.ko 2023-06-08T03:40:07.360 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme 2023-06-08T03:40:07.361 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host 2023-06-08T03:40:07.361 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme-core.ko 2023-06-08T03:40:07.361 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme.ko 2023-06-08T03:40:07.361 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport 2023-06-08T03:40:07.361 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport.ko 2023-06-08T03:40:07.361 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_cs.ko 2023-06-08T03:40:07.361 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_pc.ko 2023-06-08T03:40:07.362 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_serial.ko 2023-06-08T03:40:07.362 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci 2023-06-08T03:40:07.362 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug 2023-06-08T03:40:07.362 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-08T03:40:07.362 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/pcie 2023-06-08T03:40:07.362 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/pcie/aer_inject.ko 2023-06-08T03:40:07.362 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/xen-pcifront.ko 2023-06-08T03:40:07.362 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia 2023-06-08T03:40:07.363 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/i82092.ko 2023-06-08T03:40:07.363 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pd6729.ko 2023-06-08T03:40:07.363 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-08T03:40:07.363 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl 2023-06-08T03:40:07.363 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel 2023-06-08T03:40:07.363 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-08T03:40:07.363 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform 2023-06-08T03:40:07.364 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86 2023-06-08T03:40:07.364 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-08T03:40:07.364 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acerhdf.ko 2023-06-08T03:40:07.364 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-08T03:40:07.364 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-08T03:40:07.364 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-08T03:40:07.364 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-08T03:40:07.364 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-08T03:40:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-08T03:40:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-08T03:40:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-08T03:40:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-08T03:40:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/hdaps.ko 2023-06-08T03:40:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel 2023-06-08T03:40:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-08T03:40:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel_ips.ko 2023-06-08T03:40:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-08T03:40:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-08T03:40:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-08T03:40:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-08T03:40:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-08T03:40:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-08T03:40:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-08T03:40:07.367 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-08T03:40:07.367 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-08T03:40:07.367 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi.ko 2023-06-08T03:40:07.367 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap 2023-06-08T03:40:07.367 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-08T03:40:07.367 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-08T03:40:07.367 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps 2023-06-08T03:40:07.367 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients 2023-06-08T03:40:07.368 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-08T03:40:07.368 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-08T03:40:07.368 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps_parport.ko 2023-06-08T03:40:07.368 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/pps_core.ko 2023-06-08T03:40:07.368 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp 2023-06-08T03:40:07.368 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp.ko 2023-06-08T03:40:07.368 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp_kvm.ko 2023-06-08T03:40:07.369 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc 2023-06-08T03:40:07.369 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-08T03:40:07.369 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-08T03:40:07.369 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-08T03:40:07.369 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-08T03:40:07.369 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-08T03:40:07.369 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-08T03:40:07.369 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-08T03:40:07.370 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-08T03:40:07.370 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-08T03:40:07.370 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-08T03:40:07.370 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-08T03:40:07.370 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-em3027.ko 2023-06-08T03:40:07.370 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-08T03:40:07.370 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-08T03:40:07.370 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-08T03:40:07.371 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-08T03:40:07.371 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-08T03:40:07.371 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-08T03:40:07.371 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max6900.ko 2023-06-08T03:40:07.371 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-08T03:40:07.371 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-08T03:40:07.371 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-08T03:40:07.371 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-08T03:40:07.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-08T03:40:07.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-08T03:40:07.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-08T03:40:07.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-08T03:40:07.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-08T03:40:07.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-08T03:40:07.372 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-08T03:40:07.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-08T03:40:07.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-x1205.ko 2023-06-08T03:40:07.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi 2023-06-08T03:40:07.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-9xxx.ko 2023-06-08T03:40:07.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-sas.ko 2023-06-08T03:40:07.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-xxxx.ko 2023-06-08T03:40:07.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/BusLogic.ko 2023-06-08T03:40:07.373 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/a100u2w.ko 2023-06-08T03:40:07.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid 2023-06-08T03:40:07.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-08T03:40:07.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/advansys.ko 2023-06-08T03:40:07.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx 2023-06-08T03:40:07.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-08T03:40:07.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-08T03:40:07.374 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/am53c974.ko 2023-06-08T03:40:07.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr 2023-06-08T03:40:07.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-08T03:40:07.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/atp870u.ko 2023-06-08T03:40:07.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi 2023-06-08T03:40:07.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-08T03:40:07.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa 2023-06-08T03:40:07.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/bfa.ko 2023-06-08T03:40:07.375 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc 2023-06-08T03:40:07.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-08T03:40:07.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i 2023-06-08T03:40:07.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-08T03:40:07.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ch.ko 2023-06-08T03:40:07.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor 2023-06-08T03:40:07.376 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-08T03:40:07.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi 2023-06-08T03:40:07.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i 2023-06-08T03:40:07.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-08T03:40:07.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i 2023-06-08T03:40:07.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-08T03:40:07.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-08T03:40:07.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dc395x.ko 2023-06-08T03:40:07.377 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/device_handler 2023-06-08T03:40:07.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-06-08T03:40:07.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-06-08T03:40:07.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-06-08T03:40:07.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-06-08T03:40:07.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dmx3191d.ko 2023-06-08T03:40:07.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r 2023-06-08T03:40:07.378 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-08T03:40:07.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esp_scsi.ko 2023-06-08T03:40:07.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe 2023-06-08T03:40:07.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-08T03:40:07.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-08T03:40:07.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic 2023-06-08T03:40:07.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/fnic.ko 2023-06-08T03:40:07.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hpsa.ko 2023-06-08T03:40:07.379 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hptiop.ko 2023-06-08T03:40:07.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hv_storvsc.ko 2023-06-08T03:40:07.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/initio.ko 2023-06-08T03:40:07.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ipr.ko 2023-06-08T03:40:07.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ips.ko 2023-06-08T03:40:07.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci 2023-06-08T03:40:07.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/isci.ko 2023-06-08T03:40:07.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-08T03:40:07.380 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-08T03:40:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc 2023-06-08T03:40:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/libfc.ko 2023-06-08T03:40:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi.ko 2023-06-08T03:40:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-08T03:40:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas 2023-06-08T03:40:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/libsas.ko 2023-06-08T03:40:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc 2023-06-08T03:40:07.381 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-08T03:40:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid 2023-06-08T03:40:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid.ko 2023-06-08T03:40:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-08T03:40:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-08T03:40:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-08T03:40:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas 2023-06-08T03:40:07.382 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-08T03:40:07.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas 2023-06-08T03:40:07.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-08T03:40:07.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvumi.ko 2023-06-08T03:40:07.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001 2023-06-08T03:40:07.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-08T03:40:07.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pmcraid.ko 2023-06-08T03:40:07.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla1280.ko 2023-06-08T03:40:07.383 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx 2023-06-08T03:40:07.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-08T03:40:07.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-08T03:40:07.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx 2023-06-08T03:40:07.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-08T03:40:07.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/raid_class.ko 2023-06-08T03:40:07.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_debug.ko 2023-06-08T03:40:07.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-08T03:40:07.384 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-08T03:40:07.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-08T03:40:07.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-08T03:40:07.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-08T03:40:07.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ses.ko 2023-06-08T03:40:07.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/st.ko 2023-06-08T03:40:07.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/stex.ko 2023-06-08T03:40:07.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2 2023-06-08T03:40:07.385 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-08T03:40:07.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/virtio_scsi.ko 2023-06-08T03:40:07.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-08T03:40:07.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/wd719x.ko 2023-06-08T03:40:07.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb 2023-06-08T03:40:07.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ssb.ko 2023-06-08T03:40:07.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target 2023-06-08T03:40:07.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi 2023-06-08T03:40:07.386 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-08T03:40:07.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback 2023-06-08T03:40:07.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-08T03:40:07.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_file.ko 2023-06-08T03:40:07.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_iblock.ko 2023-06-08T03:40:07.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_mod.ko 2023-06-08T03:40:07.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_pscsi.ko 2023-06-08T03:40:07.387 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_user.ko 2023-06-08T03:40:07.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc 2023-06-08T03:40:07.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-08T03:40:07.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal 2023-06-08T03:40:07.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel 2023-06-08T03:40:07.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal 2023-06-08T03:40:07.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-08T03:40:07.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-08T03:40:07.388 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-08T03:40:07.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-08T03:40:07.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-08T03:40:07.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-08T03:40:07.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-08T03:40:07.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-08T03:40:07.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-08T03:40:07.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-08T03:40:07.389 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-08T03:40:07.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-08T03:40:07.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-08T03:40:07.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-08T03:40:07.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-08T03:40:07.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty 2023-06-08T03:40:07.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless 2023-06-08T03:40:07.390 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-08T03:40:07.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_gsm.ko 2023-06-08T03:40:07.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_hdlc.ko 2023-06-08T03:40:07.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/nozomi.ko 2023-06-08T03:40:07.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial 2023-06-08T03:40:07.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250 2023-06-08T03:40:07.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-08T03:40:07.391 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/arc_uart.ko 2023-06-08T03:40:07.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm 2023-06-08T03:40:07.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-08T03:40:07.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/synclink_gt.ko 2023-06-08T03:40:07.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs 2023-06-08T03:40:07.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core 2023-06-08T03:40:07.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-08T03:40:07.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host 2023-06-08T03:40:07.392 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-08T03:40:07.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio 2023-06-08T03:40:07.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio.ko 2023-06-08T03:40:07.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_aec.ko 2023-06-08T03:40:07.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_cif.ko 2023-06-08T03:40:07.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pci_generic.ko 2023-06-08T03:40:07.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_sercos3.ko 2023-06-08T03:40:07.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb 2023-06-08T03:40:07.393 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class 2023-06-08T03:40:07.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-acm.ko 2023-06-08T03:40:07.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-08T03:40:07.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usblp.ko 2023-06-08T03:40:07.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usbtmc.ko 2023-06-08T03:40:07.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host 2023-06-08T03:40:07.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-08T03:40:07.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image 2023-06-08T03:40:07.394 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/mdc800.ko 2023-06-08T03:40:07.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/microtek.ko 2023-06-08T03:40:07.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc 2023-06-08T03:40:07.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/adutux.ko 2023-06-08T03:40:07.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/appledisplay.ko 2023-06-08T03:40:07.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi26.ko 2023-06-08T03:40:07.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi62.ko 2023-06-08T03:40:07.395 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ezusb.ko 2023-06-08T03:40:07.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/idmouse.ko 2023-06-08T03:40:07.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/iowarrior.ko 2023-06-08T03:40:07.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-08T03:40:07.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ldusb.ko 2023-06-08T03:40:07.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/legousbtower.ko 2023-06-08T03:40:07.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga 2023-06-08T03:40:07.396 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-08T03:40:07.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-08T03:40:07.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usb3503.ko 2023-06-08T03:40:07.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usblcd.ko 2023-06-08T03:40:07.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-08T03:40:07.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/uss720.ko 2023-06-08T03:40:07.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/yurex.ko 2023-06-08T03:40:07.397 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy 2023-06-08T03:40:07.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-generic.ko 2023-06-08T03:40:07.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial 2023-06-08T03:40:07.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/aircable.ko 2023-06-08T03:40:07.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ark3116.ko 2023-06-08T03:40:07.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-08T03:40:07.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ch341.ko 2023-06-08T03:40:07.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cp210x.ko 2023-06-08T03:40:07.398 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cyberjack.ko 2023-06-08T03:40:07.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-08T03:40:07.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-08T03:40:07.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/empeg.ko 2023-06-08T03:40:07.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-08T03:40:07.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-08T03:40:07.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-08T03:40:07.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_ti.ko 2023-06-08T03:40:07.399 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipaq.ko 2023-06-08T03:40:07.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipw.ko 2023-06-08T03:40:07.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ir-usb.ko 2023-06-08T03:40:07.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-08T03:40:07.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan.ko 2023-06-08T03:40:07.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-08T03:40:07.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-08T03:40:07.400 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-08T03:40:07.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mct_u232.ko 2023-06-08T03:40:07.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7720.ko 2023-06-08T03:40:07.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7840.ko 2023-06-08T03:40:07.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/navman.ko 2023-06-08T03:40:07.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/omninet.ko 2023-06-08T03:40:07.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/opticon.ko 2023-06-08T03:40:07.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/option.ko 2023-06-08T03:40:07.401 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/oti6858.ko 2023-06-08T03:40:07.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/pl2303.ko 2023-06-08T03:40:07.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcaux.ko 2023-06-08T03:40:07.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcserial.ko 2023-06-08T03:40:07.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/quatech2.ko 2023-06-08T03:40:07.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/safe_serial.ko 2023-06-08T03:40:07.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/sierra.ko 2023-06-08T03:40:07.402 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-08T03:40:07.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ssu100.ko 2023-06-08T03:40:07.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/symbolserial.ko 2023-06-08T03:40:07.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-08T03:40:07.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-08T03:40:07.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_debug.ko 2023-06-08T03:40:07.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-08T03:40:07.403 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/visor.ko 2023-06-08T03:40:07.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/whiteheat.ko 2023-06-08T03:40:07.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-08T03:40:07.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage 2023-06-08T03:40:07.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/uas.ko 2023-06-08T03:40:07.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-08T03:40:07.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-08T03:40:07.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-08T03:40:07.404 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-08T03:40:07.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-08T03:40:07.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-08T03:40:07.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-08T03:40:07.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-karma.ko 2023-06-08T03:40:07.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-08T03:40:07.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-08T03:40:07.405 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-08T03:40:07.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-08T03:40:07.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-08T03:40:07.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/usb-storage.ko 2023-06-08T03:40:07.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip 2023-06-08T03:40:07.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-08T03:40:07.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-08T03:40:07.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-08T03:40:07.406 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio 2023-06-08T03:40:07.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci 2023-06-08T03:40:07.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-08T03:40:07.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-08T03:40:07.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio.ko 2023-06-08T03:40:07.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-08T03:40:07.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost 2023-06-08T03:40:07.407 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost.ko 2023-06-08T03:40:07.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-08T03:40:07.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_net.ko 2023-06-08T03:40:07.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_scsi.ko 2023-06-08T03:40:07.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video 2023-06-08T03:40:07.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight 2023-06-08T03:40:07.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/apple_bl.ko 2023-06-08T03:40:07.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lcd.ko 2023-06-08T03:40:07.408 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-08T03:40:07.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio 2023-06-08T03:40:07.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio.ko 2023-06-08T03:40:07.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_balloon.ko 2023-06-08T03:40:07.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_mmio.ko 2023-06-08T03:40:07.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_pci.ko 2023-06-08T03:40:07.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-06-08T03:40:07.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-06-08T03:40:07.409 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/virtio/virtio_ring.ko 2023-06-08T03:40:07.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1 2023-06-08T03:40:07.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters 2023-06-08T03:40:07.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2482.ko 2023-06-08T03:40:07.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2490.ko 2023-06-08T03:40:07.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves 2023-06-08T03:40:07.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-08T03:40:07.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-08T03:40:07.410 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-08T03:40:07.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-08T03:40:07.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-08T03:40:07.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-08T03:40:07.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-08T03:40:07.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-08T03:40:07.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-08T03:40:07.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-08T03:40:07.411 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-08T03:40:07.412 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/wire.ko 2023-06-08T03:40:07.412 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog 2023-06-08T03:40:07.412 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-08T03:40:07.412 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-08T03:40:07.412 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-08T03:40:07.412 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/hpwdt.ko 2023-06-08T03:40:07.412 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/i6300esb.ko 2023-06-08T03:40:07.413 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-08T03:40:07.413 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-08T03:40:07.413 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ib700wdt.ko 2023-06-08T03:40:07.413 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ibmasr.ko 2023-06-08T03:40:07.413 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-08T03:40:07.413 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-08T03:40:07.413 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it87_wdt.ko 2023-06-08T03:40:07.413 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/machzwd.ko 2023-06-08T03:40:07.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/nv_tco.ko 2023-06-08T03:40:07.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-08T03:40:07.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-08T03:40:07.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-08T03:40:07.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-08T03:40:07.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/softdog.ko 2023-06-08T03:40:07.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-08T03:40:07.414 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/via_wdt.ko 2023-06-08T03:40:07.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-08T03:40:07.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-08T03:40:07.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-08T03:40:07.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wdt_pci.ko 2023-06-08T03:40:07.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/xen_wdt.ko 2023-06-08T03:40:07.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen 2023-06-08T03:40:07.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-acpi-processor.ko 2023-06-08T03:40:07.415 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-evtchn.ko 2023-06-08T03:40:07.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntalloc.ko 2023-06-08T03:40:07.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntdev.ko 2023-06-08T03:40:07.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback 2023-06-08T03:40:07.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-08T03:40:07.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-privcmd.ko 2023-06-08T03:40:07.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs 2023-06-08T03:40:07.416 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-08T03:40:07.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs 2023-06-08T03:40:07.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p 2023-06-08T03:40:07.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/9p.ko 2023-06-08T03:40:07.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs 2023-06-08T03:40:07.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/affs.ko 2023-06-08T03:40:07.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs 2023-06-08T03:40:07.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/befs.ko 2023-06-08T03:40:07.417 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/binfmt_misc.ko 2023-06-08T03:40:07.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs 2023-06-08T03:40:07.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/btrfs.ko 2023-06-08T03:40:07.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles 2023-06-08T03:40:07.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/cachefiles.ko 2023-06-08T03:40:07.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph 2023-06-08T03:40:07.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ceph.ko 2023-06-08T03:40:07.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs 2023-06-08T03:40:07.418 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/cifs.ko 2023-06-08T03:40:07.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda 2023-06-08T03:40:07.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/coda.ko 2023-06-08T03:40:07.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs 2023-06-08T03:40:07.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/cramfs.ko 2023-06-08T03:40:07.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm 2023-06-08T03:40:07.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/dlm.ko 2023-06-08T03:40:07.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ecryptfs 2023-06-08T03:40:07.419 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ecryptfs/ecryptfs.ko 2023-06-08T03:40:07.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs 2023-06-08T03:40:07.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/f2fs.ko 2023-06-08T03:40:07.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat 2023-06-08T03:40:07.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/fat.ko 2023-06-08T03:40:07.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/msdos.ko 2023-06-08T03:40:07.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/vfat.ko 2023-06-08T03:40:07.420 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache 2023-06-08T03:40:07.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/fscache.ko 2023-06-08T03:40:07.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse 2023-06-08T03:40:07.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/cuse.ko 2023-06-08T03:40:07.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/fuse.ko 2023-06-08T03:40:07.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2 2023-06-08T03:40:07.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/gfs2.ko 2023-06-08T03:40:07.421 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs 2023-06-08T03:40:07.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/hfs.ko 2023-06-08T03:40:07.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus 2023-06-08T03:40:07.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/hfsplus.ko 2023-06-08T03:40:07.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs 2023-06-08T03:40:07.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/isofs.ko 2023-06-08T03:40:07.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs 2023-06-08T03:40:07.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/jfs.ko 2023-06-08T03:40:07.422 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd 2023-06-08T03:40:07.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/lockd.ko 2023-06-08T03:40:07.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix 2023-06-08T03:40:07.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/minix.ko 2023-06-08T03:40:07.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs 2023-06-08T03:40:07.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/netfs.ko 2023-06-08T03:40:07.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs 2023-06-08T03:40:07.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout 2023-06-08T03:40:07.423 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-08T03:40:07.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout 2023-06-08T03:40:07.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-08T03:40:07.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout 2023-06-08T03:40:07.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-08T03:40:07.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfs.ko 2023-06-08T03:40:07.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv3.ko 2023-06-08T03:40:07.424 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv4.ko 2023-06-08T03:40:07.425 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common 2023-06-08T03:40:07.425 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/grace.ko 2023-06-08T03:40:07.425 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/nfs_acl.ko 2023-06-08T03:40:07.425 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd 2023-06-08T03:40:07.425 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/nfsd.ko 2023-06-08T03:40:07.425 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2 2023-06-08T03:40:07.425 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/nilfs2.ko 2023-06-08T03:40:07.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls 2023-06-08T03:40:07.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-celtic.ko 2023-06-08T03:40:07.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-centeuro.ko 2023-06-08T03:40:07.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-croatian.ko 2023-06-08T03:40:07.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-cyrillic.ko 2023-06-08T03:40:07.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-gaelic.ko 2023-06-08T03:40:07.426 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-greek.ko 2023-06-08T03:40:07.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-iceland.ko 2023-06-08T03:40:07.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-inuit.ko 2023-06-08T03:40:07.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-roman.ko 2023-06-08T03:40:07.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-romanian.ko 2023-06-08T03:40:07.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-turkish.ko 2023-06-08T03:40:07.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1250.ko 2023-06-08T03:40:07.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1251.ko 2023-06-08T03:40:07.427 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1255.ko 2023-06-08T03:40:07.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp737.ko 2023-06-08T03:40:07.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp775.ko 2023-06-08T03:40:07.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp850.ko 2023-06-08T03:40:07.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp852.ko 2023-06-08T03:40:07.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp855.ko 2023-06-08T03:40:07.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp857.ko 2023-06-08T03:40:07.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp860.ko 2023-06-08T03:40:07.428 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp861.ko 2023-06-08T03:40:07.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp862.ko 2023-06-08T03:40:07.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp863.ko 2023-06-08T03:40:07.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp864.ko 2023-06-08T03:40:07.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp865.ko 2023-06-08T03:40:07.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp866.ko 2023-06-08T03:40:07.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp869.ko 2023-06-08T03:40:07.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp874.ko 2023-06-08T03:40:07.429 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp932.ko 2023-06-08T03:40:07.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp936.ko 2023-06-08T03:40:07.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp949.ko 2023-06-08T03:40:07.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp950.ko 2023-06-08T03:40:07.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_euc-jp.ko 2023-06-08T03:40:07.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-1.ko 2023-06-08T03:40:07.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-13.ko 2023-06-08T03:40:07.430 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-14.ko 2023-06-08T03:40:07.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-15.ko 2023-06-08T03:40:07.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-2.ko 2023-06-08T03:40:07.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-3.ko 2023-06-08T03:40:07.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-4.ko 2023-06-08T03:40:07.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-5.ko 2023-06-08T03:40:07.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-6.ko 2023-06-08T03:40:07.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-7.ko 2023-06-08T03:40:07.431 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-9.ko 2023-06-08T03:40:07.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-r.ko 2023-06-08T03:40:07.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-ru.ko 2023-06-08T03:40:07.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-u.ko 2023-06-08T03:40:07.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_utf8.ko 2023-06-08T03:40:07.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2 2023-06-08T03:40:07.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster 2023-06-08T03:40:07.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-08T03:40:07.432 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm 2023-06-08T03:40:07.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-08T03:40:07.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs 2023-06-08T03:40:07.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-08T03:40:07.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2.ko 2023-06-08T03:40:07.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-08T03:40:07.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-08T03:40:07.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-08T03:40:07.433 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs 2023-06-08T03:40:07.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/overlay.ko 2023-06-08T03:40:07.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore 2023-06-08T03:40:07.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ramoops.ko 2023-06-08T03:40:07.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs 2023-06-08T03:40:07.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/reiserfs.ko 2023-06-08T03:40:07.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs 2023-06-08T03:40:07.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/romfs.ko 2023-06-08T03:40:07.434 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common 2023-06-08T03:40:07.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_arc4.ko 2023-06-08T03:40:07.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_md4.ko 2023-06-08T03:40:07.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs 2023-06-08T03:40:07.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/squashfs.ko 2023-06-08T03:40:07.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv 2023-06-08T03:40:07.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/sysv.ko 2023-06-08T03:40:07.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf 2023-06-08T03:40:07.435 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/udf.ko 2023-06-08T03:40:07.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs 2023-06-08T03:40:07.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ufs.ko 2023-06-08T03:40:07.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs 2023-06-08T03:40:07.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/xfs.ko 2023-06-08T03:40:07.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel 2023-06-08T03:40:07.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/rcu 2023-06-08T03:40:07.436 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/rcu/rcutorture.ko 2023-06-08T03:40:07.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/torture.ko 2023-06-08T03:40:07.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/trace 2023-06-08T03:40:07.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-06-08T03:40:07.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib 2023-06-08T03:40:07.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/asn1_encoder.ko 2023-06-08T03:40:07.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc-itu-t.ko 2023-06-08T03:40:07.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc8.ko 2023-06-08T03:40:07.437 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto 2023-06-08T03:40:07.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libarc4.ko 2023-06-08T03:40:07.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libdes.ko 2023-06-08T03:40:07.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/libcrc32c.ko 2023-06-08T03:40:07.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lru_cache.ko 2023-06-08T03:40:07.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4 2023-06-08T03:40:07.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4_compress.ko 2023-06-08T03:40:07.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4hc_compress.ko 2023-06-08T03:40:07.438 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math 2023-06-08T03:40:07.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/cordic.ko 2023-06-08T03:40:07.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6 2023-06-08T03:40:07.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/raid6_pq.ko 2023-06-08T03:40:07.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon 2023-06-08T03:40:07.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-08T03:40:07.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_bm.ko 2023-06-08T03:40:07.439 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_fsm.ko 2023-06-08T03:40:07.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_kmp.ko 2023-06-08T03:40:07.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/zstd 2023-06-08T03:40:07.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/zstd/zstd_compress.ko 2023-06-08T03:40:07.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm 2023-06-08T03:40:07.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/hwpoison-inject.ko 2023-06-08T03:40:07.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net 2023-06-08T03:40:07.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan 2023-06-08T03:40:07.440 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/6lowpan.ko 2023-06-08T03:40:07.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_dest.ko 2023-06-08T03:40:07.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_fragment.ko 2023-06-08T03:40:07.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_hop.ko 2023-06-08T03:40:07.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-08T03:40:07.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_mobility.ko 2023-06-08T03:40:07.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_routing.ko 2023-06-08T03:40:07.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_udp.ko 2023-06-08T03:40:07.441 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802 2023-06-08T03:40:07.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/garp.ko 2023-06-08T03:40:07.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/mrp.ko 2023-06-08T03:40:07.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/p8022.ko 2023-06-08T03:40:07.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/psnap.ko 2023-06-08T03:40:07.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/stp.ko 2023-06-08T03:40:07.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q 2023-06-08T03:40:07.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/8021q.ko 2023-06-08T03:40:07.442 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p 2023-06-08T03:40:07.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet.ko 2023-06-08T03:40:07.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_fd.ko 2023-06-08T03:40:07.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_rdma.ko 2023-06-08T03:40:07.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_virtio.ko 2023-06-08T03:40:07.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv 2023-06-08T03:40:07.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/batman-adv.ko 2023-06-08T03:40:07.443 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge 2023-06-08T03:40:07.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/br_netfilter.ko 2023-06-08T03:40:07.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/bridge.ko 2023-06-08T03:40:07.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter 2023-06-08T03:40:07.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-08T03:40:07.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-08T03:40:07.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-08T03:40:07.444 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-08T03:40:07.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-08T03:40:07.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-08T03:40:07.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-08T03:40:07.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-08T03:40:07.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-08T03:40:07.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-08T03:40:07.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-08T03:40:07.445 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-08T03:40:07.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-08T03:40:07.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-08T03:40:07.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-08T03:40:07.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-08T03:40:07.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-08T03:40:07.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-08T03:40:07.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-08T03:40:07.446 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-08T03:40:07.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtables.ko 2023-06-08T03:40:07.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-06-08T03:40:07.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-08T03:40:07.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-08T03:40:07.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph 2023-06-08T03:40:07.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/libceph.ko 2023-06-08T03:40:07.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core 2023-06-08T03:40:07.447 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/failover.ko 2023-06-08T03:40:07.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/pktgen.ko 2023-06-08T03:40:07.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp 2023-06-08T03:40:07.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp.ko 2023-06-08T03:40:07.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_diag.ko 2023-06-08T03:40:07.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv4.ko 2023-06-08T03:40:07.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv6.ko 2023-06-08T03:40:07.448 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dns_resolver 2023-06-08T03:40:07.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dns_resolver/dns_resolver.ko 2023-06-08T03:40:07.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa 2023-06-08T03:40:07.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/dsa_core.ko 2023-06-08T03:40:07.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_brcm.ko 2023-06-08T03:40:07.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_dsa.ko 2023-06-08T03:40:07.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_none.ko 2023-06-08T03:40:07.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_trailer.ko 2023-06-08T03:40:07.449 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154 2023-06-08T03:40:07.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan 2023-06-08T03:40:07.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-08T03:40:07.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154.ko 2023-06-08T03:40:07.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-08T03:40:07.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4 2023-06-08T03:40:07.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ah4.ko 2023-06-08T03:40:07.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/esp4.ko 2023-06-08T03:40:07.450 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/fou.ko 2023-06-08T03:40:07.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/gre.ko 2023-06-08T03:40:07.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/inet_diag.ko 2023-06-08T03:40:07.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_gre.ko 2023-06-08T03:40:07.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_tunnel.ko 2023-06-08T03:40:07.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_vti.ko 2023-06-08T03:40:07.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipcomp.ko 2023-06-08T03:40:07.451 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipip.ko 2023-06-08T03:40:07.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter 2023-06-08T03:40:07.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-08T03:40:07.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-08T03:40:07.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-08T03:40:07.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-08T03:40:07.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-08T03:40:07.452 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-08T03:40:07.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-08T03:40:07.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-08T03:40:07.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-08T03:40:07.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-08T03:40:07.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-08T03:40:07.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-08T03:40:07.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-08T03:40:07.453 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-08T03:40:07.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-08T03:40:07.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-08T03:40:07.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-08T03:40:07.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-08T03:40:07.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-08T03:40:07.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-08T03:40:07.454 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-08T03:40:07.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_bic.ko 2023-06-08T03:40:07.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_dctcp.ko 2023-06-08T03:40:07.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_diag.ko 2023-06-08T03:40:07.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_highspeed.ko 2023-06-08T03:40:07.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_htcp.ko 2023-06-08T03:40:07.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_hybla.ko 2023-06-08T03:40:07.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_illinois.ko 2023-06-08T03:40:07.455 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_lp.ko 2023-06-08T03:40:07.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_scalable.ko 2023-06-08T03:40:07.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_vegas.ko 2023-06-08T03:40:07.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_veno.ko 2023-06-08T03:40:07.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_westwood.ko 2023-06-08T03:40:07.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_yeah.ko 2023-06-08T03:40:07.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tunnel4.ko 2023-06-08T03:40:07.456 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_diag.ko 2023-06-08T03:40:07.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_tunnel.ko 2023-06-08T03:40:07.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-08T03:40:07.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6 2023-06-08T03:40:07.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ah6.ko 2023-06-08T03:40:07.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/esp6.ko 2023-06-08T03:40:07.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/fou6.ko 2023-06-08T03:40:07.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_tunnel.ko 2023-06-08T03:40:07.457 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-08T03:40:07.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_vti.ko 2023-06-08T03:40:07.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ipcomp6.ko 2023-06-08T03:40:07.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter 2023-06-08T03:40:07.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-08T03:40:07.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-08T03:40:07.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-08T03:40:07.458 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-08T03:40:07.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-08T03:40:07.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-08T03:40:07.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-08T03:40:07.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-08T03:40:07.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-08T03:40:07.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-08T03:40:07.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-08T03:40:07.459 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-08T03:40:07.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-08T03:40:07.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-08T03:40:07.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-08T03:40:07.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-08T03:40:07.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-08T03:40:07.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-08T03:40:07.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-08T03:40:07.460 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-08T03:40:07.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-08T03:40:07.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-08T03:40:07.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-08T03:40:07.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-08T03:40:07.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/sit.ko 2023-06-08T03:40:07.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/tunnel6.ko 2023-06-08T03:40:07.461 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-08T03:40:07.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key 2023-06-08T03:40:07.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/af_key.ko 2023-06-08T03:40:07.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp 2023-06-08T03:40:07.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_core.ko 2023-06-08T03:40:07.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-08T03:40:07.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_eth.ko 2023-06-08T03:40:07.462 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip.ko 2023-06-08T03:40:07.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip6.ko 2023-06-08T03:40:07.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_netlink.ko 2023-06-08T03:40:07.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ppp.ko 2023-06-08T03:40:07.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc 2023-06-08T03:40:07.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc.ko 2023-06-08T03:40:07.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154 2023-06-08T03:40:07.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/mac802154.ko 2023-06-08T03:40:07.463 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls 2023-06-08T03:40:07.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/mpls_gso.ko 2023-06-08T03:40:07.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter 2023-06-08T03:40:07.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset 2023-06-08T03:40:07.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set.ko 2023-06-08T03:40:07.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-08T03:40:07.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-08T03:40:07.464 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-08T03:40:07.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-08T03:40:07.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-08T03:40:07.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-08T03:40:07.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-08T03:40:07.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-08T03:40:07.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-08T03:40:07.465 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-08T03:40:07.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-08T03:40:07.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-08T03:40:07.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-08T03:40:07.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-08T03:40:07.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-08T03:40:07.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs 2023-06-08T03:40:07.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-08T03:40:07.466 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-08T03:40:07.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-08T03:40:07.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-08T03:40:07.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-08T03:40:07.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-08T03:40:07.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-08T03:40:07.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-08T03:40:07.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-08T03:40:07.467 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-08T03:40:07.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-08T03:40:07.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-08T03:40:07.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-08T03:40:07.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-08T03:40:07.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conncount.ko 2023-06-08T03:40:07.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack.ko 2023-06-08T03:40:07.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-08T03:40:07.468 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-08T03:40:07.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-08T03:40:07.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-08T03:40:07.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-08T03:40:07.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-08T03:40:07.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-08T03:40:07.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-08T03:40:07.469 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-08T03:40:07.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-08T03:40:07.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-08T03:40:07.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-08T03:40:07.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-08T03:40:07.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table.ko 2023-06-08T03:40:07.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-08T03:40:07.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_log_syslog.ko 2023-06-08T03:40:07.470 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat.ko 2023-06-08T03:40:07.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-08T03:40:07.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-08T03:40:07.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_irc.ko 2023-06-08T03:40:07.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_sip.ko 2023-06-08T03:40:07.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-08T03:40:07.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-08T03:40:07.471 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_tables.ko 2023-06-08T03:40:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink.ko 2023-06-08T03:40:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-08T03:40:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_log.ko 2023-06-08T03:40:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-08T03:40:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-08T03:40:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_chain_nat.ko 2023-06-08T03:40:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_compat.ko 2023-06-08T03:40:07.472 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_ct.ko 2023-06-08T03:40:07.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-08T03:40:07.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fib.ko 2023-06-08T03:40:07.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-08T03:40:07.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_hash.ko 2023-06-08T03:40:07.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_limit.ko 2023-06-08T03:40:07.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_log.ko 2023-06-08T03:40:07.473 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_masq.ko 2023-06-08T03:40:07.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_nat.ko 2023-06-08T03:40:07.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_numgen.ko 2023-06-08T03:40:07.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_queue.ko 2023-06-08T03:40:07.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_quota.ko 2023-06-08T03:40:07.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_redir.ko 2023-06-08T03:40:07.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject.ko 2023-06-08T03:40:07.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject_inet.ko 2023-06-08T03:40:07.474 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_socket.ko 2023-06-08T03:40:07.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_tunnel.ko 2023-06-08T03:40:07.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_AUDIT.ko 2023-06-08T03:40:07.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-08T03:40:07.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-08T03:40:07.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-08T03:40:07.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CT.ko 2023-06-08T03:40:07.475 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_DSCP.ko 2023-06-08T03:40:07.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HL.ko 2023-06-08T03:40:07.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HMARK.ko 2023-06-08T03:40:07.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-08T03:40:07.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LED.ko 2023-06-08T03:40:07.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LOG.ko 2023-06-08T03:40:07.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-08T03:40:07.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NETMAP.ko 2023-06-08T03:40:07.476 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFLOG.ko 2023-06-08T03:40:07.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-08T03:40:07.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_RATEEST.ko 2023-06-08T03:40:07.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-08T03:40:07.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_SECMARK.ko 2023-06-08T03:40:07.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-08T03:40:07.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-08T03:40:07.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TEE.ko 2023-06-08T03:40:07.477 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TPROXY.ko 2023-06-08T03:40:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TRACE.ko 2023-06-08T03:40:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_addrtype.ko 2023-06-08T03:40:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_bpf.ko 2023-06-08T03:40:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cgroup.ko 2023-06-08T03:40:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cluster.ko 2023-06-08T03:40:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_comment.ko 2023-06-08T03:40:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connbytes.ko 2023-06-08T03:40:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlabel.ko 2023-06-08T03:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlimit.ko 2023-06-08T03:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connmark.ko 2023-06-08T03:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_conntrack.ko 2023-06-08T03:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cpu.ko 2023-06-08T03:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dccp.ko 2023-06-08T03:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_devgroup.ko 2023-06-08T03:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dscp.ko 2023-06-08T03:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ecn.ko 2023-06-08T03:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_esp.ko 2023-06-08T03:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hashlimit.ko 2023-06-08T03:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_helper.ko 2023-06-08T03:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hl.ko 2023-06-08T03:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipcomp.ko 2023-06-08T03:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_iprange.ko 2023-06-08T03:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipvs.ko 2023-06-08T03:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_l2tp.ko 2023-06-08T03:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_length.ko 2023-06-08T03:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_limit.ko 2023-06-08T03:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mac.ko 2023-06-08T03:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mark.ko 2023-06-08T03:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_multiport.ko 2023-06-08T03:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nat.ko 2023-06-08T03:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nfacct.ko 2023-06-08T03:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_osf.ko 2023-06-08T03:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_owner.ko 2023-06-08T03:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_physdev.ko 2023-06-08T03:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_pkttype.ko 2023-06-08T03:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_policy.ko 2023-06-08T03:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_quota.ko 2023-06-08T03:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_rateest.ko 2023-06-08T03:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_realm.ko 2023-06-08T03:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_recent.ko 2023-06-08T03:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_sctp.ko 2023-06-08T03:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_set.ko 2023-06-08T03:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_socket.ko 2023-06-08T03:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_state.ko 2023-06-08T03:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_statistic.ko 2023-06-08T03:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_string.ko 2023-06-08T03:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpmss.ko 2023-06-08T03:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_time.ko 2023-06-08T03:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_u32.ko 2023-06-08T03:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink 2023-06-08T03:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/netlink_diag.ko 2023-06-08T03:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh 2023-06-08T03:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/nsh.ko 2023-06-08T03:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch 2023-06-08T03:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/openvswitch.ko 2023-06-08T03:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-geneve.ko 2023-06-08T03:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-gre.ko 2023-06-08T03:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-vxlan.ko 2023-06-08T03:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet 2023-06-08T03:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/af_packet_diag.ko 2023-06-08T03:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds 2023-06-08T03:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds.ko 2023-06-08T03:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_rdma.ko 2023-06-08T03:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_tcp.ko 2023-06-08T03:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched 2023-06-08T03:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_csum.ko 2023-06-08T03:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_gact.ko 2023-06-08T03:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_ipt.ko 2023-06-08T03:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_mirred.ko 2023-06-08T03:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_nat.ko 2023-06-08T03:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_pedit.ko 2023-06-08T03:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_police.ko 2023-06-08T03:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_simple.ko 2023-06-08T03:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_skbedit.ko 2023-06-08T03:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_vlan.ko 2023-06-08T03:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_basic.ko 2023-06-08T03:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_bpf.ko 2023-06-08T03:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_flow.ko 2023-06-08T03:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_fw.ko 2023-06-08T03:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_route.ko 2023-06-08T03:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_u32.ko 2023-06-08T03:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_cmp.ko 2023-06-08T03:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_ipset.ko 2023-06-08T03:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_meta.ko 2023-06-08T03:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_nbyte.ko 2023-06-08T03:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_text.ko 2023-06-08T03:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_u32.ko 2023-06-08T03:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_choke.ko 2023-06-08T03:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_codel.ko 2023-06-08T03:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_drr.ko 2023-06-08T03:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq.ko 2023-06-08T03:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_gred.ko 2023-06-08T03:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hfsc.ko 2023-06-08T03:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hhf.ko 2023-06-08T03:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_htb.ko 2023-06-08T03:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_ingress.ko 2023-06-08T03:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio.ko 2023-06-08T03:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio_lib.ko 2023-06-08T03:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_multiq.ko 2023-06-08T03:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_netem.ko 2023-06-08T03:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_pie.ko 2023-06-08T03:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_plug.ko 2023-06-08T03:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_prio.ko 2023-06-08T03:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_qfq.ko 2023-06-08T03:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_red.ko 2023-06-08T03:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfb.ko 2023-06-08T03:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfq.ko 2023-06-08T03:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_tbf.ko 2023-06-08T03:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_teql.ko 2023-06-08T03:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp 2023-06-08T03:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp.ko 2023-06-08T03:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp_diag.ko 2023-06-08T03:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc 2023-06-08T03:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss 2023-06-08T03:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-08T03:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-08T03:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/sunrpc.ko 2023-06-08T03:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma 2023-06-08T03:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-08T03:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc 2023-06-08T03:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/diag.ko 2023-06-08T03:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/tipc.ko 2023-06-08T03:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix 2023-06-08T03:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/unix_diag.ko 2023-06-08T03:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock 2023-06-08T03:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-08T03:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-08T03:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock.ko 2023-06-08T03:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-08T03:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-08T03:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm 2023-06-08T03:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-08T03:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security 2023-06-08T03:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security/keys 2023-06-08T03:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security/keys/encrypted-keys 2023-06-08T03:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-06-08T03:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security/keys/trusted-keys 2023-06-08T03:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/security/keys/trusted-keys/trusted.ko 2023-06-08T03:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt 2023-06-08T03:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib 2023-06-08T03:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/irqbypass.ko 2023-06-08T03:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias 2023-06-08T03:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias.bin 2023-06-08T03:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin 2023-06-08T03:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.bin 2023-06-08T03:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.modinfo 2023-06-08T03:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep 2023-06-08T03:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep.bin 2023-06-08T03:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.devname 2023-06-08T03:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.order 2023-06-08T03:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.softdep 2023-06-08T03:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols 2023-06-08T03:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout:/lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols.bin 2023-06-08T03:40:07.498 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:40:07.498 DEBUG:teuthology.orchestra.run.smithi016:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-06-08T03:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout:postinstall scriptlet (using /bin/sh): 2023-06-08T03:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 -a -r /boot/System.map-6.4.0-rc2-g10b2f20a4f46 ]; then 2023-06-08T03:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout:cp /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 /boot/.vmlinuz-6.4.0-rc2-g10b2f20a4f46-rpm 2023-06-08T03:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout:cp /boot/System.map-6.4.0-rc2-g10b2f20a4f46 /boot/.System.map-6.4.0-rc2-g10b2f20a4f46-rpm 2023-06-08T03:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout:rm -f /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 /boot/System.map-6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/installkernel 6.4.0-rc2-g10b2f20a4f46 /boot/.vmlinuz-6.4.0-rc2-g10b2f20a4f46-rpm /boot/.System.map-6.4.0-rc2-g10b2f20a4f46-rpm 2023-06-08T03:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout:rm -f /boot/.vmlinuz-6.4.0-rc2-g10b2f20a4f46-rpm /boot/.System.map-6.4.0-rc2-g10b2f20a4f46-rpm 2023-06-08T03:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout:fi 2023-06-08T03:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout:preuninstall scriptlet (using /bin/sh): 2023-06-08T03:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-06-08T03:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout:new-kernel-pkg --remove 6.4.0-rc2-g10b2f20a4f46 --rminitrd --initrdfile=/boot/initramfs-6.4.0-rc2-g10b2f20a4f46.img 2023-06-08T03:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-06-08T03:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-install remove 6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout:fi 2023-06-08T03:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout:postuninstall scriptlet (using /bin/sh): 2023-06-08T03:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout:if [ -x /sbin/update-bootloader ]; then 2023-06-08T03:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout:/sbin/update-bootloader --remove 6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout:fi 2023-06-08T03:40:07.530 DEBUG:teuthology.orchestra.run.smithi016:> sudo rpm -qi grub2-tools 2023-06-08T03:40:07.621 INFO:teuthology.orchestra.run.smithi016.stdout:Name : grub2-tools 2023-06-08T03:40:07.622 INFO:teuthology.orchestra.run.smithi016.stdout:Epoch : 1 2023-06-08T03:40:07.622 INFO:teuthology.orchestra.run.smithi016.stdout:Version : 2.02 2023-06-08T03:40:07.622 INFO:teuthology.orchestra.run.smithi016.stdout:Release : 129.el8 2023-06-08T03:40:07.622 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: x86_64 2023-06-08T03:40:07.623 INFO:teuthology.orchestra.run.smithi016.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-06-08T03:40:07.623 INFO:teuthology.orchestra.run.smithi016.stdout:Group : System Environment/Base 2023-06-08T03:40:07.623 INFO:teuthology.orchestra.run.smithi016.stdout:Size : 9265586 2023-06-08T03:40:07.623 INFO:teuthology.orchestra.run.smithi016.stdout:License : GPLv3+ 2023-06-08T03:40:07.623 INFO:teuthology.orchestra.run.smithi016.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-06-08T03:40:07.624 INFO:teuthology.orchestra.run.smithi016.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-06-08T03:40:07.624 INFO:teuthology.orchestra.run.smithi016.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-06-08T03:40:07.624 INFO:teuthology.orchestra.run.smithi016.stdout:Build Host : kbuilder.bsys.centos.org 2023-06-08T03:40:07.625 INFO:teuthology.orchestra.run.smithi016.stdout:Relocations : (not relocatable) 2023-06-08T03:40:07.625 INFO:teuthology.orchestra.run.smithi016.stdout:Packager : CentOS BuildSystem 2023-06-08T03:40:07.625 INFO:teuthology.orchestra.run.smithi016.stdout:Vendor : CentOS 2023-06-08T03:40:07.625 INFO:teuthology.orchestra.run.smithi016.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-08T03:40:07.626 INFO:teuthology.orchestra.run.smithi016.stdout:Summary : Support tools for GRUB. 2023-06-08T03:40:07.626 INFO:teuthology.orchestra.run.smithi016.stdout:Description : 2023-06-08T03:40:07.626 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:40:07.626 INFO:teuthology.orchestra.run.smithi016.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-08T03:40:07.627 INFO:teuthology.orchestra.run.smithi016.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-08T03:40:07.627 INFO:teuthology.orchestra.run.smithi016.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-08T03:40:07.628 INFO:teuthology.orchestra.run.smithi016.stdout:hardware devices. 2023-06-08T03:40:07.628 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:40:07.628 INFO:teuthology.orchestra.run.smithi016.stdout:This subpackage provides tools for support of all platforms. 2023-06-08T03:40:07.630 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-08T03:40:07.631 INFO:teuthology.task.kernel:Updating grub on smithi016 to boot 6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:40:07.631 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-08T03:40:12.527 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2023-06-08T03:40:14.607 INFO:teuthology.orchestra.run.smithi016.stderr:done 2023-06-08T03:40:14.608 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2023-06-08T03:40:14.662 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.jH5EqCkPvR 2023-06-08T03:40:14.662 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jH5EqCkPvR 2023-06-08T03:40:14.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.jH5EqCkPvR 2023-06-08T03:40:14.852 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.jH5EqCkPvR is 6KB 2023-06-08T03:40:14.876 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.jH5EqCkPvR 2023-06-08T03:40:14.898 DEBUG:teuthology.orchestra.run.smithi016:> sudo /bin/ls /boot/loader/entries || true 2023-06-08T03:40:14.978 INFO:teuthology.orchestra.run.smithi016.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-06-08T03:40:14.978 INFO:teuthology.orchestra.run.smithi016.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-06-08T03:40:14.979 INFO:teuthology.orchestra.run.smithi016.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-06-08T03:40:14.979 INFO:teuthology.orchestra.run.smithi016.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-rc2-g10b2f20a4f46.conf 2023-06-08T03:40:14.980 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:40:15.128 DEBUG:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2023-06-08T03:40:32.649 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-06-08T03:40:32.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-06-08T03:40:32.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:40:45.140 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-06-08T03:40:45.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-06-08T03:40:45.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:40:51.188 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-06-08T03:41:03.472 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-06-08T03:41:21.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-06-08T03:41:21.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:41:33.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-06-08T03:41:33.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:41:39.571 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-06-08T03:41:49.429 DEBUG:teuthology.orchestra.run.smithi016:> true 2023-06-08T03:41:49.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-06-08T03:41:49.845 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-rc2-g10b2f20a4f46"... 2023-06-08T03:41:49.845 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2023-06-08T03:41:49.893 INFO:teuthology.orchestra.run.smithi016.stdout:6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:41:49.893 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc2-g10b2f20a4f46 vs 6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:41:49.894 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-08T03:41:49.894 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-06-08T03:41:50.895 DEBUG:teuthology.parallel:result is None 2023-06-08T03:42:09.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-06-08T03:42:09.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:42:09.928 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-06-08T03:42:10.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-06-08T03:42:10.345 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-rc2-g10b2f20a4f46"... 2023-06-08T03:42:10.345 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2023-06-08T03:42:10.390 INFO:teuthology.orchestra.run.smithi169.stdout:6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:42:10.391 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc2-g10b2f20a4f46 vs 6.4.0-rc2-g10b2f20a4f46 2023-06-08T03:42:10.391 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-08T03:42:10.391 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-06-08T03:42:11.392 DEBUG:teuthology.parallel:result is None 2023-06-08T03:42:11.393 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-08T03:42:11.405 INFO:teuthology.task.internal:Creating test directory... 2023-06-08T03:42:11.406 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-08T03:42:11.412 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-08T03:42:11.462 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-08T03:42:11.469 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-08T03:42:11.528 INFO:teuthology.task.internal:Creating archive directory... 2023-06-08T03:42:11.528 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-08T03:42:11.533 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-08T03:42:11.770 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-08T03:42:11.779 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-08T03:42:11.780 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-08T03:42:11.787 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-08T03:42:11.915 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-08T03:42:11.916 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-08T03:42:11.958 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-08T03:42:11.965 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-08T03:42:11.969 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-08T03:42:11.985 INFO:teuthology.task.internal:Configuring sudo... 2023-06-08T03:42:11.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-08T03:42:11.991 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-08T03:42:12.063 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-08T03:42:12.073 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-08T03:42:12.074 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-08T03:42:12.080 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-08T03:42:12.126 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-08T03:42:12.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-08T03:42:12.305 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-08T03:42:12.382 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-08T03:42:12.450 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T03:42:12.451 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-08T03:42:12.523 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-08T03:42:12.601 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-08T03:42:12.671 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-08T03:42:12.750 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-08T03:42:12.818 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T03:42:12.819 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-08T03:42:12.888 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2023-06-08T03:42:12.892 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2023-06-08T03:42:13.012 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-08T03:42:13.055 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-08T03:42:13.465 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-08T03:42:13.479 INFO:teuthology.task.internal:Starting timer... 2023-06-08T03:42:13.480 INFO:teuthology.run_tasks:Running task pcp... 2023-06-08T03:42:13.497 INFO:teuthology.run_tasks:Running task selinux... 2023-06-08T03:42:13.505 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-06-08T03:42:13.506 DEBUG:teuthology.orchestra.run.smithi016:> sudo service auditd rotate 2023-06-08T03:42:13.638 INFO:teuthology.orchestra.run.smithi016.stdout:Rotating logs: 2023-06-08T03:42:13.641 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2023-06-08T03:42:13.757 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2023-06-08T03:42:13.762 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-08T03:42:13.762 DEBUG:teuthology.orchestra.run.smithi016:> /usr/sbin/getenforce 2023-06-08T03:42:13.812 INFO:teuthology.orchestra.run.smithi016.stdout:Permissive 2023-06-08T03:42:13.813 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2023-06-08T03:42:13.878 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2023-06-08T03:42:13.878 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi016.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2023-06-08T03:42:13.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-08T03:42:13.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T03:42:13.949 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-08T03:42:14.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T03:42:14.019 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-08T03:42:14.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo /usr/sbin/setenforce permissive 2023-06-08T03:42:14.088 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2023-06-08T03:42:14.156 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-08T03:42:14.166 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-06-08T03:42:14.167 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-08T03:42:14.188 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-08T03:42:14.190 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-08T03:51:55.404 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2023-06-08T03:51:55.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-06-08T03:51:55.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:51:55.488 DEBUG:teuthology.orchestra.run.smithi016:> true 2023-06-08T03:51:55.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-06-08T03:51:55.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-08T03:51:55.688 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-06-08T03:51:55.805 INFO:teuthology.run_tasks:Running task clock... 2023-06-08T03:51:55.814 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-08T03:51:55.815 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-08T03:51:55.816 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-08T03:51:55.820 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-08T03:51:55.820 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-08T03:51:55.890 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-08T03:51:55.918 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-08T03:51:55.924 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-08T03:51:55.951 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-08T03:51:56.013 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: ntpd: command not found 2023-06-08T03:51:56.035 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2023-06-08T03:51:56.042 INFO:teuthology.orchestra.run.smithi016.stdout:506 Cannot talk to daemon 2023-06-08T03:51:56.063 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2023-06-08T03:51:56.075 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-08T03:51:56.096 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-08T03:51:56.108 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-08T03:51:56.128 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-08T03:51:56.194 INFO:teuthology.orchestra.run.smithi016.stderr:bash: ntpq: command not found 2023-06-08T03:51:56.201 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-08T03:51:56.201 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2023-06-08T03:51:56.201 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:51:56.201 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:51:56.202 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:51:56.202 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:51:56.215 INFO:teuthology.orchestra.run.smithi169.stderr:bash: ntpq: command not found 2023-06-08T03:51:56.223 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-08T03:51:56.223 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2023-06-08T03:51:56.223 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:51:56.223 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:51:56.223 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:51:56.223 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-08T03:51:56.224 INFO:teuthology.run_tasks:Running task install... 2023-06-08T03:51:56.232 DEBUG:teuthology.task.install:project ceph 2023-06-08T03:51:56.233 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}} 2023-06-08T03:51:56.233 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'} 2023-06-08T03:51:56.233 INFO:teuthology.task.install:Using flavor: default 2023-06-08T03:51:56.239 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-08T03:51:56.239 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-08T03:51:56.239 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'tag': None, 'wait_for_package': False} 2023-06-08T03:51:56.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-08T03:51:56.242 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'tag': None, 'wait_for_package': False} 2023-06-08T03:51:56.242 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-08T03:51:56.463 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/ 2023-06-08T03:51:56.463 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4313.ga02638f8 2023-06-08T03:51:56.473 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/ 2023-06-08T03:51:56.473 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4313.ga02638f8 2023-06-08T03:51:56.747 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-08T03:51:56.747 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T03:51:56.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-08T03:51:56.819 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-08T03:51:56.820 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T03:51:56.820 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-08T03:51:56.821 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-08T03:51:56.821 DEBUG:teuthology.orchestra.run.smithi016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a02638f808b8fe11bccdd01222c0e6e2eb71120b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-08T03:51:56.892 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-08T03:51:56.892 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a02638f808b8fe11bccdd01222c0e6e2eb71120b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-08T03:51:56.933 DEBUG:teuthology.orchestra.run.smithi016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-08T03:51:57.002 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-08T03:51:57.028 DEBUG:teuthology.orchestra.run.smithi016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-08T03:51:57.097 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-08T03:51:57.098 INFO:teuthology.orchestra.run.smithi016.stdout:check_obsoletes = 1 2023-06-08T03:51:57.100 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum clean all 2023-06-08T03:51:57.166 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2023-06-08T03:51:57.169 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2023-06-08T03:51:57.455 INFO:teuthology.orchestra.run.smithi016.stdout:66 files removed 2023-06-08T03:51:57.491 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-08T03:51:57.500 INFO:teuthology.orchestra.run.smithi169.stdout:66 files removed 2023-06-08T03:51:57.537 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-08T03:51:58.534 INFO:teuthology.orchestra.run.smithi016.stdout:ceph packages for x86_64 182 kB/s | 80 kB 00:00 2023-06-08T03:51:58.599 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 164 kB/s | 80 kB 00:00 2023-06-08T03:51:58.952 INFO:teuthology.orchestra.run.smithi016.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-06-08T03:51:59.016 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-06-08T03:51:59.392 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 4.3 kB/s | 1.5 kB 00:00 2023-06-08T03:51:59.419 INFO:teuthology.orchestra.run.smithi016.stdout:ceph source packages 3.4 kB/s | 1.5 kB 00:00 2023-06-08T03:52:01.901 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - AppStream 12 MB/s | 29 MB 00:02 2023-06-08T03:52:02.469 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 8 - AppStream 9.7 MB/s | 29 MB 00:03 2023-06-08T03:52:09.884 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 38 MB 00:02 2023-06-08T03:52:10.969 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 38 MB 00:02 2023-06-08T03:52:16.467 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - Extras 26 kB/s | 18 kB 00:00 2023-06-08T03:52:16.952 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 6.6 kB 00:00 2023-06-08T03:52:17.703 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 8 - PowerTools 9.9 MB/s | 6.0 MB 00:00 2023-06-08T03:52:17.894 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 8 - Extras 46 kB/s | 18 kB 00:00 2023-06-08T03:52:18.587 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.6 kB 00:00 2023-06-08T03:52:19.363 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 8 - PowerTools 9.8 MB/s | 6.0 MB 00:00 2023-06-08T03:52:21.621 INFO:teuthology.orchestra.run.smithi169.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-06-08T03:52:22.673 INFO:teuthology.orchestra.run.smithi016.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2023-06-08T03:52:24.465 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 16 MB 00:01 2023-06-08T03:52:29.082 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 416 kB/s | 24 kB 00:00 2023-06-08T03:52:33.274 INFO:teuthology.orchestra.run.smithi016.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-08T03:52:33.275 INFO:teuthology.orchestra.run.smithi016.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-08T03:52:33.288 INFO:teuthology.orchestra.run.smithi016.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-06-08T03:52:33.288 INFO:teuthology.orchestra.run.smithi016.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-06-08T03:52:33.289 INFO:teuthology.orchestra.run.smithi016.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-06-08T03:52:33.290 INFO:teuthology.orchestra.run.smithi016.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-06-08T03:52:33.291 INFO:teuthology.orchestra.run.smithi016.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-08T03:52:33.294 INFO:teuthology.orchestra.run.smithi016.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-08T03:52:33.296 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-08T03:52:33.297 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-08T03:52:33.491 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2023-06-08T03:52:33.506 INFO:teuthology.orchestra.run.smithi016.stdout:==================================================================================================== 2023-06-08T03:52:33.506 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2023-06-08T03:52:33.507 INFO:teuthology.orchestra.run.smithi016.stdout:==================================================================================================== 2023-06-08T03:52:33.507 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2023-06-08T03:52:33.507 INFO:teuthology.orchestra.run.smithi016.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-06-08T03:52:33.507 INFO:teuthology.orchestra.run.smithi016.stdout: ceph x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.4 k 2023-06-08T03:52:33.507 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 5.4 M 2023-06-08T03:52:33.507 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 848 k 2023-06-08T03:52:33.507 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 166 k 2023-06-08T03:52:33.507 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 1.5 M 2023-06-08T03:52:33.508 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 128 k 2023-06-08T03:52:33.508 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 1.7 M 2023-06-08T03:52:33.508 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 7.4 M 2023-06-08T03:52:33.508 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 47 k 2023-06-08T03:52:33.508 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 13 M 2023-06-08T03:52:33.508 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 41 M 2023-06-08T03:52:33.508 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 258 k 2023-06-08T03:52:33.509 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 160 k 2023-06-08T03:52:33.509 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 258 k 2023-06-08T03:52:33.509 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 18 k 2023-06-08T03:52:33.509 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-06-08T03:52:33.509 INFO:teuthology.orchestra.run.smithi016.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-06-08T03:52:33.509 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-06-08T03:52:33.509 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 31 k 2023-06-08T03:52:33.509 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 771 k 2023-06-08T03:52:33.510 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 139 k 2023-06-08T03:52:33.510 INFO:teuthology.orchestra.run.smithi016.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-06-08T03:52:33.510 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-06-08T03:52:33.510 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-06-08T03:52:33.510 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-06-08T03:52:33.510 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-06-08T03:52:33.510 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-06-08T03:52:33.510 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 197 k 2023-06-08T03:52:33.511 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 370 k 2023-06-08T03:52:33.511 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 365 k 2023-06-08T03:52:33.511 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 107 k 2023-06-08T03:52:33.511 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 94 k 2023-06-08T03:52:33.511 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.4 M 2023-06-08T03:52:33.511 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 179 k 2023-06-08T03:52:33.511 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel x86_64 5.0.0-11.el8 baseos 74 k 2023-06-08T03:52:33.512 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrading: 2023-06-08T03:52:33.512 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-6.el8 baseos 143 k 2023-06-08T03:52:33.512 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-06-08T03:52:33.512 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-06-08T03:52:33.512 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-06-08T03:52:33.512 INFO:teuthology.orchestra.run.smithi016.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-06-08T03:52:33.512 INFO:teuthology.orchestra.run.smithi016.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-06-08T03:52:33.512 INFO:teuthology.orchestra.run.smithi016.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-06-08T03:52:33.513 INFO:teuthology.orchestra.run.smithi016.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-06-08T03:52:33.513 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.7 M 2023-06-08T03:52:33.513 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.6 M 2023-06-08T03:52:33.513 INFO:teuthology.orchestra.run.smithi016.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-06-08T03:52:33.513 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-06-08T03:52:33.513 INFO:teuthology.orchestra.run.smithi016.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-06-08T03:52:33.513 INFO:teuthology.orchestra.run.smithi016.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-06-08T03:52:33.513 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs x86_64 5.0.0-11.el8 baseos 1.1 M 2023-06-08T03:52:33.514 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2023-06-08T03:52:33.514 INFO:teuthology.orchestra.run.smithi016.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-06-08T03:52:33.514 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 22 M 2023-06-08T03:52:33.514 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 23 k 2023-06-08T03:52:33.514 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 2.3 M 2023-06-08T03:52:33.514 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 240 k 2023-06-08T03:52:33.514 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 4.6 M 2023-06-08T03:52:33.514 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 18 M 2023-06-08T03:52:33.515 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 15 k 2023-06-08T03:52:33.515 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 24 k 2023-06-08T03:52:33.515 INFO:teuthology.orchestra.run.smithi016.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-06-08T03:52:33.515 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-08T03:52:33.515 INFO:teuthology.orchestra.run.smithi016.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-06-08T03:52:33.515 INFO:teuthology.orchestra.run.smithi016.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-06-08T03:52:33.515 INFO:teuthology.orchestra.run.smithi016.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-06-08T03:52:33.516 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 137 k 2023-06-08T03:52:33.516 INFO:teuthology.orchestra.run.smithi016.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-06-08T03:52:33.516 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-06-08T03:52:33.516 INFO:teuthology.orchestra.run.smithi016.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-08T03:52:33.516 INFO:teuthology.orchestra.run.smithi016.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-06-08T03:52:33.516 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-06-08T03:52:33.516 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-06-08T03:52:33.516 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 473 k 2023-06-08T03:52:33.517 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-06-08T03:52:33.517 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.5 M 2023-06-08T03:52:33.517 INFO:teuthology.orchestra.run.smithi016.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-06-08T03:52:33.517 INFO:teuthology.orchestra.run.smithi016.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-06-08T03:52:33.517 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-08T03:52:33.517 INFO:teuthology.orchestra.run.smithi016.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-06-08T03:52:33.517 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-06-08T03:52:33.517 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-06-08T03:52:33.518 INFO:teuthology.orchestra.run.smithi016.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-06-08T03:52:33.518 INFO:teuthology.orchestra.run.smithi016.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-06-08T03:52:33.518 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-06-08T03:52:33.518 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-06-08T03:52:33.518 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-06-08T03:52:33.518 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-06-08T03:52:33.518 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-08T03:52:33.518 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-06-08T03:52:33.519 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-08T03:52:33.519 INFO:teuthology.orchestra.run.smithi016.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-08T03:52:33.519 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-08T03:52:33.519 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 45 k 2023-06-08T03:52:33.519 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 119 k 2023-06-08T03:52:33.519 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-08T03:52:33.519 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi x86_64 1.11.5-5.el8 baseos 237 k 2023-06-08T03:52:33.519 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-08T03:52:33.520 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-08T03:52:33.520 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography x86_64 3.2.1-5.el8 baseos 559 k 2023-06-08T03:52:33.520 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-08T03:52:33.520 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-08T03:52:33.520 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-08T03:52:33.520 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-06-08T03:52:33.520 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-06-08T03:52:33.521 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-06-08T03:52:33.521 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-06-08T03:52:33.521 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-08T03:52:33.521 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-08T03:52:33.521 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-06-08T03:52:33.521 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-06-08T03:52:33.521 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-08T03:52:33.521 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-08T03:52:33.522 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-06-08T03:52:33.522 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-06-08T03:52:33.522 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-06-08T03:52:33.522 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-08T03:52:33.522 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-08T03:52:33.522 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-06-08T03:52:33.522 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-06-08T03:52:33.522 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-06-08T03:52:33.523 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-06-08T03:52:33.523 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-06-08T03:52:33.523 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-06-08T03:52:33.523 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-08T03:52:33.523 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-06-08T03:52:33.523 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-08T03:52:33.523 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-08T03:52:33.523 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-06-08T03:52:33.524 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-08T03:52:33.524 INFO:teuthology.orchestra.run.smithi016.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-08T03:52:33.524 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-08T03:52:33.524 INFO:teuthology.orchestra.run.smithi016.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-08T03:52:33.524 INFO:teuthology.orchestra.run.smithi016.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-08T03:52:33.524 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-08T03:52:33.524 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-08T03:52:33.524 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-08T03:52:33.525 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-06-08T03:52:33.525 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-08T03:52:33.525 INFO:teuthology.orchestra.run.smithi016.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-06-08T03:52:33.525 INFO:teuthology.orchestra.run.smithi016.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-08T03:52:33.525 INFO:teuthology.orchestra.run.smithi016.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-06-08T03:52:33.525 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-06-08T03:52:33.525 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-06-08T03:52:33.526 INFO:teuthology.orchestra.run.smithi016.stdout:Enabling module streams: 2023-06-08T03:52:33.526 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql 10 2023-06-08T03:52:33.526 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:52:33.526 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2023-06-08T03:52:33.526 INFO:teuthology.orchestra.run.smithi016.stdout:==================================================================================================== 2023-06-08T03:52:33.526 INFO:teuthology.orchestra.run.smithi016.stdout:Install 128 Packages 2023-06-08T03:52:33.526 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 15 Packages 2023-06-08T03:52:33.526 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:52:33.527 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 204 M 2023-06-08T03:52:33.527 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2023-06-08T03:52:34.067 INFO:teuthology.orchestra.run.smithi016.stdout:(1/143): ceph-18.0.0-4313.ga02638f8.el8.x86_64. 25 kB/s | 6.4 kB 00:00 2023-06-08T03:52:35.175 INFO:teuthology.orchestra.run.smithi016.stdout:(2/143): ceph-fuse-18.0.0-4313.ga02638f8.el8.x8 765 kB/s | 848 kB 00:01 2023-06-08T03:52:35.500 INFO:teuthology.orchestra.run.smithi016.stdout:(3/143): ceph-immutable-object-cache-18.0.0-431 510 kB/s | 166 kB 00:00 2023-06-08T03:52:35.784 INFO:teuthology.orchestra.run.smithi016.stdout:(4/143): ceph-base-18.0.0-4313.ga02638f8.el8.x8 2.7 MB/s | 5.4 MB 00:01 2023-06-08T03:52:36.084 INFO:teuthology.orchestra.run.smithi016.stdout:(5/143): ceph-mgr-18.0.0-4313.ga02638f8.el8.x86 5.2 MB/s | 1.5 MB 00:00 2023-06-08T03:52:37.101 INFO:teuthology.orchestra.run.smithi016.stdout:(6/143): ceph-mon-18.0.0-4313.ga02638f8.el8.x86 4.5 MB/s | 4.6 MB 00:01 2023-06-08T03:52:37.735 INFO:teuthology.orchestra.run.smithi016.stdout:(7/143): ceph-mds-18.0.0-4313.ga02638f8.el8.x86 1.0 MB/s | 2.3 MB 00:02 2023-06-08T03:52:38.744 INFO:teuthology.orchestra.run.smithi016.stdout:(8/143): ceph-common-18.0.0-4313.ga02638f8.el8. 4.4 MB/s | 22 MB 00:04 2023-06-08T03:52:38.802 INFO:teuthology.orchestra.run.smithi016.stdout:(9/143): ceph-selinux-18.0.0-4313.ga02638f8.el8 417 kB/s | 24 kB 00:00 2023-06-08T03:52:40.278 INFO:teuthology.orchestra.run.smithi016.stdout:(10/143): ceph-osd-18.0.0-4313.ga02638f8.el8.x8 5.6 MB/s | 18 MB 00:03 2023-06-08T03:52:40.344 INFO:teuthology.orchestra.run.smithi016.stdout:(11/143): cephfs-mirror-18.0.0-4313.ga02638f8.e 3.8 MB/s | 258 kB 00:00 2023-06-08T03:52:40.428 INFO:teuthology.orchestra.run.smithi016.stdout:(12/143): libcephfs-devel-18.0.0-4313.ga02638f8 373 kB/s | 31 kB 00:00 2023-06-08T03:52:40.645 INFO:teuthology.orchestra.run.smithi016.stdout:(13/143): libcephfs2-18.0.0-4313.ga02638f8.el8. 3.5 MB/s | 771 kB 00:00 2023-06-08T03:52:40.729 INFO:teuthology.orchestra.run.smithi016.stdout:(14/143): libcephsqlite-18.0.0-4313.ga02638f8.e 1.6 MB/s | 137 kB 00:00 2023-06-08T03:52:40.812 INFO:teuthology.orchestra.run.smithi016.stdout:(15/143): librados-devel-18.0.0-4313.ga02638f8. 1.6 MB/s | 139 kB 00:00 2023-06-08T03:52:40.979 INFO:teuthology.orchestra.run.smithi016.stdout:(16/143): libradosstriper1-18.0.0-4313.ga02638f 2.8 MB/s | 473 kB 00:00 2023-06-08T03:52:43.038 INFO:teuthology.orchestra.run.smithi016.stdout:(17/143): librgw2-18.0.0-4313.ga02638f8.el8.x86 3.2 MB/s | 6.5 MB 00:02 2023-06-08T03:52:43.130 INFO:teuthology.orchestra.run.smithi016.stdout:(18/143): python3-ceph-argparse-18.0.0-4313.ga0 491 kB/s | 45 kB 00:00 2023-06-08T03:52:43.221 INFO:teuthology.orchestra.run.smithi016.stdout:(19/143): python3-ceph-common-18.0.0-4313.ga026 1.3 MB/s | 119 kB 00:00 2023-06-08T03:52:43.322 INFO:teuthology.orchestra.run.smithi016.stdout:(20/143): python3-cephfs-18.0.0-4313.ga02638f8. 1.9 MB/s | 197 kB 00:00 2023-06-08T03:52:43.480 INFO:teuthology.orchestra.run.smithi016.stdout:(21/143): python3-rados-18.0.0-4313.ga02638f8.e 2.3 MB/s | 370 kB 00:00 2023-06-08T03:52:43.655 INFO:teuthology.orchestra.run.smithi016.stdout:(22/143): python3-rbd-18.0.0-4313.ga02638f8.el8 2.0 MB/s | 365 kB 00:00 2023-06-08T03:52:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:(23/143): python3-rgw-18.0.0-4313.ga02638f8.el8 1.0 MB/s | 107 kB 00:00 2023-06-08T03:52:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:(24/143): rbd-fuse-18.0.0-4313.ga02638f8.el8.x8 948 kB/s | 94 kB 00:00 2023-06-08T03:52:45.139 INFO:teuthology.orchestra.run.smithi016.stdout:(25/143): rbd-mirror-18.0.0-4313.ga02638f8.el8. 2.7 MB/s | 3.4 MB 00:01 2023-06-08T03:52:45.231 INFO:teuthology.orchestra.run.smithi016.stdout:(26/143): rbd-nbd-18.0.0-4313.ga02638f8.el8.x86 1.9 MB/s | 179 kB 00:00 2023-06-08T03:52:45.323 INFO:teuthology.orchestra.run.smithi016.stdout:(27/143): ceph-grafana-dashboards-18.0.0-4313.g 252 kB/s | 23 kB 00:00 2023-06-08T03:52:45.424 INFO:teuthology.orchestra.run.smithi016.stdout:(28/143): ceph-mgr-cephadm-18.0.0-4313.ga02638f 1.2 MB/s | 128 kB 00:00 2023-06-08T03:52:46.074 INFO:teuthology.orchestra.run.smithi016.stdout:(29/143): ceph-mgr-dashboard-18.0.0-4313.ga0263 2.6 MB/s | 1.7 MB 00:00 2023-06-08T03:52:47.691 INFO:teuthology.orchestra.run.smithi016.stdout:(30/143): ceph-radosgw-18.0.0-4313.ga02638f8.el 1.3 MB/s | 13 MB 00:09 2023-06-08T03:52:48.275 INFO:teuthology.orchestra.run.smithi016.stdout:(31/143): ceph-test-18.0.0-4313.ga02638f8.el8.x 4.3 MB/s | 41 MB 00:09 2023-06-08T03:52:48.300 INFO:teuthology.orchestra.run.smithi016.stdout:(32/143): ceph-mgr-modules-core-18.0.0-4313.ga0 395 kB/s | 240 kB 00:00 2023-06-08T03:52:48.358 INFO:teuthology.orchestra.run.smithi016.stdout:(33/143): ceph-mgr-rook-18.0.0-4313.ga02638f8.e 571 kB/s | 47 kB 00:00 2023-06-08T03:52:48.392 INFO:teuthology.orchestra.run.smithi016.stdout:(34/143): ceph-prometheus-alerts-18.0.0-4313.ga 158 kB/s | 15 kB 00:00 2023-06-08T03:52:48.492 INFO:teuthology.orchestra.run.smithi016.stdout:(35/143): ceph-volume-18.0.0-4313.ga02638f8.el8 1.9 MB/s | 258 kB 00:00 2023-06-08T03:52:48.559 INFO:teuthology.orchestra.run.smithi016.stdout:(36/143): cephfs-top-18.0.0-4313.ga02638f8.el8. 270 kB/s | 18 kB 00:00 2023-06-08T03:52:48.618 INFO:teuthology.orchestra.run.smithi016.stdout:(37/143): cephadm-18.0.0-4313.ga02638f8.el8.noa 708 kB/s | 160 kB 00:00 2023-06-08T03:52:48.785 INFO:teuthology.orchestra.run.smithi016.stdout:(38/143): ceph-mgr-diskprediction-local-18.0.0- 2.7 MB/s | 7.4 MB 00:02 2023-06-08T03:52:49.160 INFO:teuthology.orchestra.run.smithi016.stdout:(39/143): automake-1.16.1-7.el8.noarch.rpm 1.2 MB/s | 713 kB 00:00 2023-06-08T03:52:49.260 INFO:teuthology.orchestra.run.smithi016.stdout:(40/143): flex-2.6.1-9.el8.x86_64.rpm 673 kB/s | 320 kB 00:00 2023-06-08T03:52:49.294 INFO:teuthology.orchestra.run.smithi016.stdout:(41/143): bison-3.0.4-10.el8.x86_64.rpm 1.0 MB/s | 688 kB 00:00 2023-06-08T03:52:49.320 INFO:teuthology.orchestra.run.smithi016.stdout:(42/143): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2023-06-08T03:52:49.370 INFO:teuthology.orchestra.run.smithi016.stdout:(43/143): libpq-13.5-1.el8.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2023-06-08T03:52:49.403 INFO:teuthology.orchestra.run.smithi016.stdout:(44/143): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-06-08T03:52:49.470 INFO:teuthology.orchestra.run.smithi016.stdout:(45/143): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2023-06-08T03:52:49.504 INFO:teuthology.orchestra.run.smithi016.stdout:(46/143): libtool-2.4.6-25.el8.x86_64.rpm 3.8 MB/s | 709 kB 00:00 2023-06-08T03:52:49.529 INFO:teuthology.orchestra.run.smithi016.stdout:(47/143): oniguruma-6.8.2-2.el8.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2023-06-08T03:52:49.855 INFO:teuthology.orchestra.run.smithi016.stdout:(48/143): postgresql-10.23-1.module_el8+300+2c5 4.8 MB/s | 1.6 MB 00:00 2023-06-08T03:52:50.038 INFO:teuthology.orchestra.run.smithi016.stdout:(49/143): postgresql-contrib-10.23-1.module_el8 4.8 MB/s | 903 kB 00:00 2023-06-08T03:52:50.255 INFO:teuthology.orchestra.run.smithi016.stdout:(50/143): openblas-threads-0.3.15-4.el8.x86_64. 6.5 MB/s | 4.9 MB 00:00 2023-06-08T03:52:50.472 INFO:teuthology.orchestra.run.smithi016.stdout:(51/143): openblas-0.3.15-4.el8.x86_64.rpm 4.7 MB/s | 4.7 MB 00:01 2023-06-08T03:52:50.672 INFO:teuthology.orchestra.run.smithi016.stdout:(52/143): python3-jinja2-2.10.1-3.el8.noarch.rp 2.6 MB/s | 538 kB 00:00 2023-06-08T03:52:50.814 INFO:teuthology.orchestra.run.smithi016.stdout:(53/143): postgresql-server-10.23-1.module_el8+ 6.6 MB/s | 5.1 MB 00:00 2023-06-08T03:52:50.840 INFO:teuthology.orchestra.run.smithi016.stdout:(54/143): python3-jsonpatch-1.21-2.el8.noarch.r 159 kB/s | 27 kB 00:00 2023-06-08T03:52:50.948 INFO:teuthology.orchestra.run.smithi016.stdout:(55/143): python3-babel-2.5.1-7.el8.noarch.rpm 6.9 MB/s | 4.8 MB 00:00 2023-06-08T03:52:50.973 INFO:teuthology.orchestra.run.smithi016.stdout:(56/143): python3-jsonpointer-1.10-11.el8.noarc 126 kB/s | 20 kB 00:00 2023-06-08T03:52:50.999 INFO:teuthology.orchestra.run.smithi016.stdout:(57/143): python3-mako-1.0.6-14.el8.noarch.rpm 989 kB/s | 157 kB 00:00 2023-06-08T03:52:51.041 INFO:teuthology.orchestra.run.smithi016.stdout:(58/143): python3-markupsafe-0.23-19.el8.x86_64 421 kB/s | 39 kB 00:00 2023-06-08T03:52:51.099 INFO:teuthology.orchestra.run.smithi016.stdout:(59/143): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-06-08T03:52:51.133 INFO:teuthology.orchestra.run.smithi016.stdout:(60/143): python3-prettytable-0.7.2-14.el8.noar 477 kB/s | 44 kB 00:00 2023-06-08T03:52:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:(61/143): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-06-08T03:52:51.242 INFO:teuthology.orchestra.run.smithi016.stdout:(62/143): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-06-08T03:52:51.309 INFO:teuthology.orchestra.run.smithi016.stdout:(63/143): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-06-08T03:52:51.351 INFO:teuthology.orchestra.run.smithi016.stdout:(64/143): python3-pytz-2017.2-9.el8.noarch.rpm 497 kB/s | 54 kB 00:00 2023-06-08T03:52:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:(65/143): python3-numpy-1.14.3-10.el8.x86_64.rp 7.8 MB/s | 3.7 MB 00:00 2023-06-08T03:52:51.485 INFO:teuthology.orchestra.run.smithi016.stdout:(66/143): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2023-06-08T03:52:51.560 INFO:teuthology.orchestra.run.smithi016.stdout:(67/143): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-06-08T03:52:51.577 INFO:teuthology.orchestra.run.smithi016.stdout:(68/143): uuid-1.6.2-43.el8.x86_64.rpm 697 kB/s | 64 kB 00:00 2023-06-08T03:52:51.652 INFO:teuthology.orchestra.run.smithi016.stdout:(69/143): xmlstarlet-1.6.1-20.el8.x86_64.rpm 769 kB/s | 71 kB 00:00 2023-06-08T03:52:51.979 INFO:teuthology.orchestra.run.smithi016.stdout:(70/143): elfutils-libelf-devel-0.189-2.el8.x86 154 kB/s | 61 kB 00:00 2023-06-08T03:52:52.078 INFO:teuthology.orchestra.run.smithi016.stdout:(71/143): fuse-2.9.7-17.el8.x86_64.rpm 195 kB/s | 83 kB 00:00 2023-06-08T03:52:52.129 INFO:teuthology.orchestra.run.smithi016.stdout:(72/143): keyutils-libs-devel-1.5.10-9.el8.x86_ 320 kB/s | 48 kB 00:00 2023-06-08T03:52:52.254 INFO:teuthology.orchestra.run.smithi016.stdout:(73/143): libaio-devel-0.3.112-1.el8.x86_64.rpm 149 kB/s | 19 kB 00:00 2023-06-08T03:52:52.404 INFO:teuthology.orchestra.run.smithi016.stdout:(74/143): libcom_err-devel-1.45.6-5.el8.x86_64. 259 kB/s | 39 kB 00:00 2023-06-08T03:52:52.538 INFO:teuthology.orchestra.run.smithi016.stdout:(75/143): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.2 MB/s | 561 kB 00:00 2023-06-08T03:52:52.780 INFO:teuthology.orchestra.run.smithi016.stdout:(76/143): python3-scipy-1.0.0-21.module_el8.5.0 9.3 MB/s | 14 MB 00:01 2023-06-08T03:52:52.797 INFO:teuthology.orchestra.run.smithi016.stdout:(77/143): libquadmath-8.5.0-19.el8.x86_64.rpm 666 kB/s | 172 kB 00:00 2023-06-08T03:52:52.997 INFO:teuthology.orchestra.run.smithi016.stdout:(78/143): libgfortran-8.5.0-19.el8.x86_64.rpm 1.1 MB/s | 645 kB 00:00 2023-06-08T03:52:53.014 INFO:teuthology.orchestra.run.smithi016.stdout:(79/143): libselinux-devel-2.9-8.el8.x86_64.rpm 924 kB/s | 200 kB 00:00 2023-06-08T03:52:53.148 INFO:teuthology.orchestra.run.smithi016.stdout:(80/143): libsepol-devel-2.9-3.el8.x86_64.rpm 580 kB/s | 87 kB 00:00 2023-06-08T03:52:53.173 INFO:teuthology.orchestra.run.smithi016.stdout:(81/143): libuuid-devel-2.32.1-42.el8.x86_64.rp 626 kB/s | 99 kB 00:00 2023-06-08T03:52:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:(82/143): librabbitmq-0.9.0-3.el8.x86_64.rpm 112 kB/s | 47 kB 00:00 2023-06-08T03:52:53.273 INFO:teuthology.orchestra.run.smithi016.stdout:(83/143): libverto-devel-0.3.2-2.el8.x86_64.rpm 144 kB/s | 18 kB 00:00 2023-06-08T03:52:53.298 INFO:teuthology.orchestra.run.smithi016.stdout:(84/143): libzstd-devel-1.4.4-1.el8.x86_64.rpm 350 kB/s | 44 kB 00:00 2023-06-08T03:52:53.466 INFO:teuthology.orchestra.run.smithi016.stdout:(85/143): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.3 MB/s | 229 kB 00:00 2023-06-08T03:52:53.549 INFO:teuthology.orchestra.run.smithi016.stdout:(86/143): pcre2-devel-10.32-3.el8.x86_64.rpm 2.1 MB/s | 605 kB 00:00 2023-06-08T03:52:53.649 INFO:teuthology.orchestra.run.smithi016.stdout:(87/143): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2023-06-08T03:52:53.700 INFO:teuthology.orchestra.run.smithi016.stdout:(88/143): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.5 MB/s | 237 kB 00:00 2023-06-08T03:52:53.825 INFO:teuthology.orchestra.run.smithi016.stdout:(89/143): python3-jwt-1.6.1-2.el8.noarch.rpm 341 kB/s | 43 kB 00:00 2023-06-08T03:52:53.950 INFO:teuthology.orchestra.run.smithi016.stdout:(90/143): python3-cryptography-3.2.1-5.el8.x86_ 1.8 MB/s | 559 kB 00:00 2023-06-08T03:52:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:(91/143): python3-oauthlib-2.1.0-1.el8.noarch.r 1.0 MB/s | 155 kB 00:00 2023-06-08T03:52:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:(92/143): python3-pycparser-2.14-14.el8.noarch. 687 kB/s | 109 kB 00:00 2023-06-08T03:52:54.134 INFO:teuthology.orchestra.run.smithi016.stdout:(93/143): python3-requests-oauthlib-1.0.0-1.el8 269 kB/s | 43 kB 00:00 2023-06-08T03:52:54.185 INFO:teuthology.orchestra.run.smithi016.stdout:(94/143): openssl-devel-1.1.1k-9.el8.x86_64.rpm 3.2 MB/s | 3.2 MB 00:00 2023-06-08T03:52:54.268 INFO:teuthology.orchestra.run.smithi016.stdout:(95/143): zlib-devel-1.2.11-21.el8.x86_64.rpm 436 kB/s | 58 kB 00:00 2023-06-08T03:52:54.293 INFO:teuthology.orchestra.run.smithi016.stdout:(96/143): xfsprogs-devel-5.0.0-11.el8.x86_64.rp 469 kB/s | 74 kB 00:00 2023-06-08T03:52:54.494 INFO:teuthology.orchestra.run.smithi016.stdout:(97/143): liboath-2.6.2-3.el8.x86_64.rpm 261 kB/s | 59 kB 00:00 2023-06-08T03:52:54.519 INFO:teuthology.orchestra.run.smithi016.stdout:(98/143): gperftools-libs-2.7-9.el8.x86_64.rpm 917 kB/s | 306 kB 00:00 2023-06-08T03:52:54.545 INFO:teuthology.orchestra.run.smithi016.stdout:(99/143): libunwind-1.3.1-3.el8.x86_64.rpm 299 kB/s | 75 kB 00:00 2023-06-08T03:52:54.595 INFO:teuthology.orchestra.run.smithi016.stdout:(100/143): python3-bcrypt-3.1.6-2.el8.1.x86_64. 579 kB/s | 44 kB 00:00 2023-06-08T03:52:54.662 INFO:teuthology.orchestra.run.smithi016.stdout:(101/143): python3-beautifulsoup4-4.6.3-2.el8.1 1.6 MB/s | 185 kB 00:00 2023-06-08T03:52:54.687 INFO:teuthology.orchestra.run.smithi016.stdout:(102/143): python3-cachetools-3.1.1-4.el8.noarc 359 kB/s | 33 kB 00:00 2023-06-08T03:52:54.729 INFO:teuthology.orchestra.run.smithi016.stdout:(103/143): python3-certifi-2018.10.15-7.el8.noa 243 kB/s | 16 kB 00:00 2023-06-08T03:52:54.796 INFO:teuthology.orchestra.run.smithi016.stdout:(104/143): python3-cheroot-8.5.2-1.el8.noarch.r 1.6 MB/s | 173 kB 00:00 2023-06-08T03:52:54.846 INFO:teuthology.orchestra.run.smithi016.stdout:(105/143): python3-cherrypy-18.4.0-1.el8.noarch 3.2 MB/s | 384 kB 00:00 2023-06-08T03:52:54.872 INFO:teuthology.orchestra.run.smithi016.stdout:(106/143): python3-google-auth-1.1.1-10.el8.noa 1.1 MB/s | 81 kB 00:00 2023-06-08T03:52:54.922 INFO:teuthology.orchestra.run.smithi016.stdout:(107/143): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-06-08T03:52:54.947 INFO:teuthology.orchestra.run.smithi016.stdout:(108/143): python3-jaraco-functools-2.0-4.el8.n 234 kB/s | 18 kB 00:00 2023-06-08T03:52:54.972 INFO:teuthology.orchestra.run.smithi016.stdout:(109/143): python3-asyncssh-2.7.0-2.el8.noarch. 995 kB/s | 476 kB 00:00 2023-06-08T03:52:55.006 INFO:teuthology.orchestra.run.smithi016.stdout:(110/143): python3-logutils-0.3.5-11.el8.noarch 833 kB/s | 49 kB 00:00 2023-06-08T03:52:55.031 INFO:teuthology.orchestra.run.smithi016.stdout:(111/143): python3-more-itertools-7.2.0-3.el8.n 1.0 MB/s | 59 kB 00:00 2023-06-08T03:52:55.082 INFO:teuthology.orchestra.run.smithi016.stdout:(112/143): python3-kubernetes-11.0.0-6.el8.noar 7.3 MB/s | 1.2 MB 00:00 2023-06-08T03:52:55.099 INFO:teuthology.orchestra.run.smithi016.stdout:(113/143): python3-natsort-7.1.1-2.el8.noarch.r 653 kB/s | 60 kB 00:00 2023-06-08T03:52:55.149 INFO:teuthology.orchestra.run.smithi016.stdout:(114/143): python3-portend-2.6-1.el8.noarch.rpm 234 kB/s | 16 kB 00:00 2023-06-08T03:52:55.166 INFO:teuthology.orchestra.run.smithi016.stdout:(115/143): python3-repoze-lru-0.7-6.el8.noarch. 502 kB/s | 34 kB 00:00 2023-06-08T03:52:55.225 INFO:teuthology.orchestra.run.smithi016.stdout:(116/143): python3-routes-2.4.1-12.el8.noarch.r 2.5 MB/s | 196 kB 00:00 2023-06-08T03:52:55.250 INFO:teuthology.orchestra.run.smithi016.stdout:(117/143): python3-rsa-4.8-1.el8.noarch.rpm 736 kB/s | 61 kB 00:00 2023-06-08T03:52:55.275 INFO:teuthology.orchestra.run.smithi016.stdout:(118/143): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2023-06-08T03:52:55.301 INFO:teuthology.orchestra.run.smithi016.stdout:(119/143): python3-simplegeneric-0.8.1-17.el8.n 248 kB/s | 19 kB 00:00 2023-06-08T03:52:55.326 INFO:teuthology.orchestra.run.smithi016.stdout:(120/143): python3-singledispatch-3.4.0.3-18.el 316 kB/s | 24 kB 00:00 2023-06-08T03:52:55.351 INFO:teuthology.orchestra.run.smithi016.stdout:(121/143): python3-tempora-1.14.1-5.el8.noarch. 386 kB/s | 29 kB 00:00 2023-06-08T03:52:55.377 INFO:teuthology.orchestra.run.smithi016.stdout:(122/143): python3-trustme-0.6.0-4.el8.noarch.r 364 kB/s | 27 kB 00:00 2023-06-08T03:52:55.452 INFO:teuthology.orchestra.run.smithi016.stdout:(123/143): python3-websocket-client-0.56.0-5.el 817 kB/s | 61 kB 00:00 2023-06-08T03:52:55.477 INFO:teuthology.orchestra.run.smithi016.stdout:(124/143): python3-waitress-1.4.3-1.el8.noarch. 1.7 MB/s | 255 kB 00:00 2023-06-08T03:52:55.519 INFO:teuthology.orchestra.run.smithi016.stdout:(125/143): python3-webob-1.8.5-1.el8.1.noarch.r 1.5 MB/s | 251 kB 00:00 2023-06-08T03:52:55.545 INFO:teuthology.orchestra.run.smithi016.stdout:(126/143): python3-zc-lockfile-2.0-2.el8.noarch 343 kB/s | 23 kB 00:00 2023-06-08T03:52:55.570 INFO:teuthology.orchestra.run.smithi016.stdout:(127/143): python3-webtest-2.0.33-1.el8.noarch. 729 kB/s | 85 kB 00:00 2023-06-08T03:52:56.120 INFO:teuthology.orchestra.run.smithi016.stdout:(128/143): thrift-0.13.0-2.el8.x86_64.rpm 2.9 MB/s | 1.7 MB 00:00 2023-06-08T03:52:56.537 INFO:teuthology.orchestra.run.smithi016.stdout:(129/143): NetworkManager-initscripts-updown-1. 344 kB/s | 143 kB 00:00 2023-06-08T03:52:56.704 INFO:teuthology.orchestra.run.smithi016.stdout:(130/143): elfutils-debuginfod-client-0.189-2.e 456 kB/s | 76 kB 00:00 2023-06-08T03:52:57.029 INFO:teuthology.orchestra.run.smithi016.stdout:(131/143): librbd1-18.0.0-4313.ga02638f8.el8.x8 2.4 MB/s | 3.6 MB 00:01 2023-06-08T03:52:57.054 INFO:teuthology.orchestra.run.smithi016.stdout:(132/143): elfutils-libelf-0.189-2.el8.x86_64.r 662 kB/s | 232 kB 00:00 2023-06-08T03:52:57.513 INFO:teuthology.orchestra.run.smithi016.stdout:(133/143): iproute-6.2.0-2.el8.x86_64.rpm 1.9 MB/s | 880 kB 00:00 2023-06-08T03:52:57.597 INFO:teuthology.orchestra.run.smithi016.stdout:(134/143): elfutils-libs-0.189-2.el8.x86_64.rpm 534 kB/s | 302 kB 00:00 2023-06-08T03:52:57.655 INFO:teuthology.orchestra.run.smithi016.stdout:(135/143): libblkid-2.32.1-42.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-06-08T03:52:57.806 INFO:teuthology.orchestra.run.smithi016.stdout:(136/143): libmount-2.32.1-42.el8.x86_64.rpm 1.5 MB/s | 236 kB 00:00 2023-06-08T03:52:57.848 INFO:teuthology.orchestra.run.smithi016.stdout:(137/143): libfdisk-2.32.1-42.el8.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2023-06-08T03:52:57.940 INFO:teuthology.orchestra.run.smithi016.stdout:(138/143): libsmartcols-2.32.1-42.el8.x86_64.rp 1.3 MB/s | 179 kB 00:00 2023-06-08T03:52:58.115 INFO:teuthology.orchestra.run.smithi016.stdout:(139/143): libuuid-2.32.1-42.el8.x86_64.rpm 368 kB/s | 98 kB 00:00 2023-06-08T03:52:58.299 INFO:teuthology.orchestra.run.smithi016.stdout:(140/143): librados2-18.0.0-4313.ga02638f8.el8. 1.3 MB/s | 3.7 MB 00:02 2023-06-08T03:52:58.324 INFO:teuthology.orchestra.run.smithi016.stdout:(141/143): util-linux-user-2.32.1-42.el8.x86_64 491 kB/s | 102 kB 00:00 2023-06-08T03:52:58.382 INFO:teuthology.orchestra.run.smithi016.stdout:(142/143): util-linux-2.32.1-42.el8.x86_64.rpm 5.9 MB/s | 2.6 MB 00:00 2023-06-08T03:52:58.950 INFO:teuthology.orchestra.run.smithi016.stdout:(143/143): xfsprogs-5.0.0-11.el8.x86_64.rpm 1.7 MB/s | 1.1 MB 00:00 2023-06-08T03:52:58.953 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2023-06-08T03:52:58.953 INFO:teuthology.orchestra.run.smithi016.stdout:Total 8.0 MB/s | 204 MB 00:25 2023-06-08T03:53:00.784 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2023-06-08T03:53:01.238 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2023-06-08T03:53:01.238 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2023-06-08T03:53:02.807 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2023-06-08T03:53:02.811 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2023-06-08T03:53:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2023-06-08T03:53:08.334 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-06-08T03:53:08.495 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/158 2023-06-08T03:53:08.632 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-08T03:53:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-08T03:53:08.914 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-08T03:53:09.000 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-08T03:53:09.200 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/158 2023-06-08T03:53:09.405 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/158 2023-06-08T03:53:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 6/158 2023-06-08T03:53:09.798 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-08T03:53:10.265 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-08T03:53:10.489 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 8/158 2023-06-08T03:53:10.959 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 8/158 2023-06-08T03:53:11.131 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 9/158 2023-06-08T03:53:11.282 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 9/158 2023-06-08T03:53:11.456 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 10/158 2023-06-08T03:53:11.573 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 10/158 2023-06-08T03:53:11.785 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 11/158 2023-06-08T03:53:11.948 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-08T03:53:12.032 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-08T03:53:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/158 2023-06-08T03:53:12.493 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/158 2023-06-08T03:53:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libpq-13.5-1.el8.x86_64 15/158 2023-06-08T03:53:13.153 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 16/158 2023-06-08T03:53:13.289 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 17/158 2023-06-08T03:53:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 17/158 2023-06-08T03:53:13.555 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/158 2023-06-08T03:53:13.798 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/158 2023-06-08T03:53:13.989 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : xfsprogs-5.0.0-11.el8.x86_64 19/158 2023-06-08T03:53:14.127 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: xfsprogs-5.0.0-11.el8.x86_64 19/158 2023-06-08T03:53:14.346 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/158 2023-06-08T03:53:14.515 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/158 2023-06-08T03:53:14.630 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-08T03:53:14.787 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-08T03:53:14.947 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-08T03:53:15.651 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-08T03:53:15.805 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/158 2023-06-08T03:53:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/158 2023-06-08T03:53:16.714 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-08T03:53:17.598 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-08T03:53:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/158 2023-06-08T03:53:18.100 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/158 2023-06-08T03:53:18.271 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/158 2023-06-08T03:53:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/158 2023-06-08T03:53:18.680 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 30/158 2023-06-08T03:53:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 31/158 2023-06-08T03:53:19.038 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 32/158 2023-06-08T03:53:20.219 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/158 2023-06-08T03:53:20.567 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/158 2023-06-08T03:53:20.840 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/158 2023-06-08T03:53:21.013 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-08T03:53:23.301 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-08T03:53:23.870 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/158 2023-06-08T03:53:24.084 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/158 2023-06-08T03:53:24.296 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/158 2023-06-08T03:53:24.463 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 40/158 2023-06-08T03:53:24.636 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 41/158 2023-06-08T03:53:24.796 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/158 2023-06-08T03:53:24.983 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/158 2023-06-08T03:53:25.188 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-08T03:53:25.282 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-08T03:53:25.446 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/158 2023-06-08T03:53:25.533 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/158 2023-06-08T03:53:25.668 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/158 2023-06-08T03:53:25.829 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-08T03:53:26.467 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-08T03:53:26.730 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-08T03:53:26.759 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-08T03:53:26.931 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/158 2023-06-08T03:53:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/158 2023-06-08T03:53:27.396 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/158 2023-06-08T03:53:27.543 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/158 2023-06-08T03:53:27.685 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/158 2023-06-08T03:53:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/158 2023-06-08T03:53:28.056 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/158 2023-06-08T03:53:28.238 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/158 2023-06-08T03:53:28.408 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/158 2023-06-08T03:53:28.545 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/158 2023-06-08T03:53:28.686 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/158 2023-06-08T03:53:28.853 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/158 2023-06-08T03:53:29.023 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/158 2023-06-08T03:53:29.219 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/158 2023-06-08T03:53:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/158 2023-06-08T03:53:29.716 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/158 2023-06-08T03:53:29.908 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/158 2023-06-08T03:53:30.288 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/158 2023-06-08T03:53:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/158 2023-06-08T03:53:30.736 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/158 2023-06-08T03:53:31.602 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/158 2023-06-08T03:53:31.803 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 70/158 2023-06-08T03:53:31.895 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 70/158 2023-06-08T03:53:32.093 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 71/158 2023-06-08T03:53:32.343 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/158 2023-06-08T03:53:32.750 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 73/158 2023-06-08T03:53:33.005 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 74/158 2023-06-08T03:53:33.187 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/158 2023-06-08T03:53:33.424 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/158 2023-06-08T03:53:33.633 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/158 2023-06-08T03:53:35.019 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/158 2023-06-08T03:53:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/158 2023-06-08T03:53:35.614 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/158 2023-06-08T03:53:35.837 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/158 2023-06-08T03:53:36.131 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/158 2023-06-08T03:53:36.324 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/158 2023-06-08T03:53:36.552 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/158 2023-06-08T03:53:36.770 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/158 2023-06-08T03:53:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/158 2023-06-08T03:53:37.301 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/158 2023-06-08T03:53:37.430 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/158 2023-06-08T03:53:37.601 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/158 2023-06-08T03:53:37.910 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/158 2023-06-08T03:53:38.116 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/158 2023-06-08T03:53:38.261 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/158 2023-06-08T03:53:38.466 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/158 2023-06-08T03:53:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/158 2023-06-08T03:53:38.873 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/158 2023-06-08T03:53:39.099 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/158 2023-06-08T03:53:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/158 2023-06-08T03:53:39.368 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/158 2023-06-08T03:53:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/158 2023-06-08T03:53:39.661 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/158 2023-06-08T03:53:42.569 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 100/158 2023-06-08T03:53:42.794 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 100/158 2023-06-08T03:53:43.530 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 100/158 2023-06-08T03:53:43.819 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 101/158 2023-06-08T03:53:43.947 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 101/158 2023-06-08T03:53:44.619 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 102/158 2023-06-08T03:54:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 102/158 2023-06-08T03:54:05.662 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /sys 2023-06-08T03:54:05.662 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /proc 2023-06-08T03:54:05.662 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /dev 2023-06-08T03:54:05.662 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /run 2023-06-08T03:54:05.662 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /mnt 2023-06-08T03:54:05.662 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /var/tmp 2023-06-08T03:54:05.663 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /home 2023-06-08T03:54:05.663 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /tmp 2023-06-08T03:54:05.663 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /dev 2023-06-08T03:54:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:54:06.066 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 103/158 2023-06-08T03:54:07.915 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 103/158 2023-06-08T03:54:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 104/158 2023-06-08T03:54:08.397 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 104/158 2023-06-08T03:54:08.597 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 105/158 2023-06-08T03:54:09.154 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 105/158 2023-06-08T03:54:09.349 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 106/158 2023-06-08T03:54:09.399 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 106/158 2023-06-08T03:54:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/158 2023-06-08T03:54:09.797 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/158 2023-06-08T03:54:09.932 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-08T03:54:10.032 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-08T03:54:10.311 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : jq-1.6-7.el8.x86_64 110/158 2023-06-08T03:54:10.515 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : automake-1.16.1-7.el8.noarch 111/158 2023-06-08T03:54:11.149 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 112/158 2023-06-08T03:54:11.327 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 112/158 2023-06-08T03:54:11.457 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 113/158 2023-06-08T03:54:11.640 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 114/158 2023-06-08T03:54:11.865 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 115/158 2023-06-08T03:54:12.141 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 115/158 2023-06-08T03:54:12.340 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 116/158 2023-06-08T03:54:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 116/158 2023-06-08T03:54:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 117/158 2023-06-08T03:54:13.860 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 117/158 2023-06-08T03:54:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 118/158 2023-06-08T03:54:14.591 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 119/158 2023-06-08T03:54:14.658 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 119/158 2023-06-08T03:54:14.806 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 120/158 2023-06-08T03:54:14.833 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 120/158 2023-06-08T03:54:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 121/158 2023-06-08T03:54:15.207 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/158 2023-06-08T03:54:19.788 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/158 2023-06-08T03:54:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 123/158 2023-06-08T03:54:21.589 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 124/158 2023-06-08T03:54:21.653 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 124/158 2023-06-08T03:54:21.956 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 125/158 2023-06-08T03:54:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4313.ga0263 125/158 2023-06-08T03:54:22.231 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 126/158 2023-06-08T03:54:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 126/158 2023-06-08T03:54:22.897 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 127/158 2023-06-08T03:54:23.211 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 127/158 2023-06-08T03:54:23.515 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/158 2023-06-08T03:54:24.849 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 129/158 2023-06-08T03:54:25.128 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/158 2023-06-08T03:54:25.312 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/158 2023-06-08T03:54:25.520 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/158 2023-06-08T03:54:25.685 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xfsprogs-devel-5.0.0-11.el8.x86_64 133/158 2023-06-08T03:54:25.847 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 134/158 2023-06-08T03:54:27.110 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-08T03:54:27.322 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-08T03:54:27.357 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-08T03:54:27.556 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 136/158 2023-06-08T03:54:27.782 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 137/158 2023-06-08T03:54:28.135 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 138/158 2023-06-08T03:54:28.382 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 139/158 2023-06-08T03:54:28.538 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-6.el 140/158 2023-06-08T03:54:28.564 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-6.el 140/158 2023-06-08T03:54:28.769 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 141/158 2023-06-08T03:54:29.012 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/158 2023-06-08T03:54:29.129 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/158 2023-06-08T03:54:29.371 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/158 2023-06-08T03:54:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/158 2023-06-08T03:54:29.564 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 144/158 2023-06-08T03:54:29.743 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 145/158 2023-06-08T03:54:29.743 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-08T03:54:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-08T03:54:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-08T03:54:30.224 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-08T03:54:30.241 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-08T03:54:30.336 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-08T03:54:30.336 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-08T03:54:30.563 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-08T03:54:30.732 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 150/158 2023-06-08T03:54:30.908 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 151/158 2023-06-08T03:54:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 152/158 2023-06-08T03:54:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-08T03:54:31.311 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-08T03:54:31.311 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 154/158 2023-06-08T03:54:31.524 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 154/158 2023-06-08T03:54:31.524 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-08T03:54:31.732 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-08T03:54:31.733 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-08T03:54:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-08T03:54:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-08T03:54:32.133 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-08T03:54:32.298 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-08T03:54:32.530 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-08T03:54:32.530 INFO:teuthology.orchestra.run.smithi016.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-06-08T03:54:32.531 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:54:33.266 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 1/158 2023-06-08T03:54:33.267 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2/158 2023-06-08T03:54:33.267 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 3/158 2023-06-08T03:54:33.267 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 4/158 2023-06-08T03:54:33.267 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 5/158 2023-06-08T03:54:33.267 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 6/158 2023-06-08T03:54:33.267 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 7/158 2023-06-08T03:54:33.267 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 8/158 2023-06-08T03:54:33.268 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 9/158 2023-06-08T03:54:33.268 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 10/158 2023-06-08T03:54:33.268 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 11/158 2023-06-08T03:54:33.268 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 12/158 2023-06-08T03:54:33.268 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 13/158 2023-06-08T03:54:33.268 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 14/158 2023-06-08T03:54:33.268 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 15/158 2023-06-08T03:54:33.268 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 16/158 2023-06-08T03:54:33.269 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 17/158 2023-06-08T03:54:33.269 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/158 2023-06-08T03:54:33.269 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 19/158 2023-06-08T03:54:33.269 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 20/158 2023-06-08T03:54:33.269 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 21/158 2023-06-08T03:54:33.269 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 22/158 2023-06-08T03:54:33.269 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 23/158 2023-06-08T03:54:33.270 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 24/158 2023-06-08T03:54:33.270 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 25/158 2023-06-08T03:54:33.270 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 26/158 2023-06-08T03:54:33.270 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 27/158 2023-06-08T03:54:33.270 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 28/158 2023-06-08T03:54:33.270 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 29/158 2023-06-08T03:54:33.270 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 30/158 2023-06-08T03:54:33.278 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 31/158 2023-06-08T03:54:33.278 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 32/158 2023-06-08T03:54:33.278 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 33/158 2023-06-08T03:54:33.278 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 34/158 2023-06-08T03:54:33.279 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 35/158 2023-06-08T03:54:33.279 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 36/158 2023-06-08T03:54:33.279 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 37/158 2023-06-08T03:54:33.279 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 38/158 2023-06-08T03:54:33.279 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/158 2023-06-08T03:54:33.279 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/158 2023-06-08T03:54:33.279 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/158 2023-06-08T03:54:33.280 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : jq-1.6-7.el8.x86_64 42/158 2023-06-08T03:54:33.280 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/158 2023-06-08T03:54:33.280 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/158 2023-06-08T03:54:33.280 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/158 2023-06-08T03:54:33.280 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/158 2023-06-08T03:54:33.280 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/158 2023-06-08T03:54:33.280 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/158 2023-06-08T03:54:33.280 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/158 2023-06-08T03:54:33.281 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/158 2023-06-08T03:54:33.281 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/158 2023-06-08T03:54:33.281 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/158 2023-06-08T03:54:33.281 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/158 2023-06-08T03:54:33.281 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/158 2023-06-08T03:54:33.281 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/158 2023-06-08T03:54:33.281 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/158 2023-06-08T03:54:33.282 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/158 2023-06-08T03:54:33.282 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/158 2023-06-08T03:54:33.282 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/158 2023-06-08T03:54:33.282 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/158 2023-06-08T03:54:33.282 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/158 2023-06-08T03:54:33.282 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/158 2023-06-08T03:54:33.282 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/158 2023-06-08T03:54:33.282 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/158 2023-06-08T03:54:33.283 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/158 2023-06-08T03:54:33.283 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/158 2023-06-08T03:54:33.283 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/158 2023-06-08T03:54:33.283 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/158 2023-06-08T03:54:33.283 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/158 2023-06-08T03:54:33.283 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/158 2023-06-08T03:54:33.283 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/158 2023-06-08T03:54:33.283 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/158 2023-06-08T03:54:33.284 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/158 2023-06-08T03:54:33.284 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/158 2023-06-08T03:54:33.284 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/158 2023-06-08T03:54:33.284 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/158 2023-06-08T03:54:33.284 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/158 2023-06-08T03:54:33.284 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/158 2023-06-08T03:54:33.284 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/158 2023-06-08T03:54:33.285 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/158 2023-06-08T03:54:33.285 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/158 2023-06-08T03:54:33.285 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/158 2023-06-08T03:54:33.285 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/158 2023-06-08T03:54:33.285 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/158 2023-06-08T03:54:33.285 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/158 2023-06-08T03:54:33.285 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/158 2023-06-08T03:54:33.285 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/158 2023-06-08T03:54:33.286 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/158 2023-06-08T03:54:33.286 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/158 2023-06-08T03:54:33.286 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 90/158 2023-06-08T03:54:33.286 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/158 2023-06-08T03:54:33.286 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/158 2023-06-08T03:54:33.286 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/158 2023-06-08T03:54:33.286 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/158 2023-06-08T03:54:33.286 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xfsprogs-devel-5.0.0-11.el8.x86_64 95/158 2023-06-08T03:54:33.287 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/158 2023-06-08T03:54:33.287 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/158 2023-06-08T03:54:33.287 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/158 2023-06-08T03:54:33.287 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/158 2023-06-08T03:54:33.287 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/158 2023-06-08T03:54:33.287 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/158 2023-06-08T03:54:33.287 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/158 2023-06-08T03:54:33.287 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/158 2023-06-08T03:54:33.288 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/158 2023-06-08T03:54:33.288 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/158 2023-06-08T03:54:33.288 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/158 2023-06-08T03:54:33.288 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/158 2023-06-08T03:54:33.288 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/158 2023-06-08T03:54:33.288 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/158 2023-06-08T03:54:33.288 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/158 2023-06-08T03:54:33.289 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/158 2023-06-08T03:54:33.289 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/158 2023-06-08T03:54:33.289 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/158 2023-06-08T03:54:33.289 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/158 2023-06-08T03:54:33.289 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/158 2023-06-08T03:54:33.289 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/158 2023-06-08T03:54:33.289 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/158 2023-06-08T03:54:33.289 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/158 2023-06-08T03:54:33.290 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/158 2023-06-08T03:54:33.290 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/158 2023-06-08T03:54:33.290 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/158 2023-06-08T03:54:33.290 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/158 2023-06-08T03:54:33.290 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/158 2023-06-08T03:54:33.290 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/158 2023-06-08T03:54:33.290 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/158 2023-06-08T03:54:33.290 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/158 2023-06-08T03:54:33.291 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/158 2023-06-08T03:54:33.291 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/158 2023-06-08T03:54:33.291 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 129/158 2023-06-08T03:54:33.291 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/158 2023-06-08T03:54:33.291 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 131/158 2023-06-08T03:54:33.291 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/158 2023-06-08T03:54:33.291 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-6.el 133/158 2023-06-08T03:54:33.291 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/158 2023-06-08T03:54:33.292 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/158 2023-06-08T03:54:33.292 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/158 2023-06-08T03:54:33.292 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/158 2023-06-08T03:54:33.292 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/158 2023-06-08T03:54:33.292 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/158 2023-06-08T03:54:33.292 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/158 2023-06-08T03:54:33.292 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/158 2023-06-08T03:54:33.292 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/158 2023-06-08T03:54:33.293 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/158 2023-06-08T03:54:33.293 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/158 2023-06-08T03:54:33.293 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/158 2023-06-08T03:54:33.293 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/158 2023-06-08T03:54:33.293 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/158 2023-06-08T03:54:33.293 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/158 2023-06-08T03:54:33.293 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/158 2023-06-08T03:54:33.294 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/158 2023-06-08T03:54:33.294 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/158 2023-06-08T03:54:33.294 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/158 2023-06-08T03:54:33.294 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/158 2023-06-08T03:54:33.294 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/158 2023-06-08T03:54:33.294 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/158 2023-06-08T03:54:33.294 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/158 2023-06-08T03:54:33.294 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xfsprogs-5.0.0-11.el8.x86_64 157/158 2023-06-08T03:54:35.344 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 158/158 2023-06-08T03:54:35.344 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:54:35.344 INFO:teuthology.orchestra.run.smithi016.stdout:Upgraded: 2023-06-08T03:54:35.344 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-initscripts-updown-1:1.40.16-6.el8.noarch 2023-06-08T03:54:35.345 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-06-08T03:54:35.345 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-06-08T03:54:35.345 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-06-08T03:54:35.345 INFO:teuthology.orchestra.run.smithi016.stdout: iproute-6.2.0-2.el8.x86_64 2023-06-08T03:54:35.345 INFO:teuthology.orchestra.run.smithi016.stdout: libblkid-2.32.1-42.el8.x86_64 2023-06-08T03:54:35.345 INFO:teuthology.orchestra.run.smithi016.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-06-08T03:54:35.345 INFO:teuthology.orchestra.run.smithi016.stdout: libmount-2.32.1-42.el8.x86_64 2023-06-08T03:54:35.345 INFO:teuthology.orchestra.run.smithi016.stdout: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.346 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.346 INFO:teuthology.orchestra.run.smithi016.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-06-08T03:54:35.346 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-2.32.1-42.el8.x86_64 2023-06-08T03:54:35.346 INFO:teuthology.orchestra.run.smithi016.stdout: util-linux-2.32.1-42.el8.x86_64 2023-06-08T03:54:35.346 INFO:teuthology.orchestra.run.smithi016.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-06-08T03:54:35.346 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-5.0.0-11.el8.x86_64 2023-06-08T03:54:35.346 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2023-06-08T03:54:35.347 INFO:teuthology.orchestra.run.smithi016.stdout: automake-1.16.1-7.el8.noarch 2023-06-08T03:54:35.347 INFO:teuthology.orchestra.run.smithi016.stdout: bison-3.0.4-10.el8.x86_64 2023-06-08T03:54:35.347 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.347 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.347 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.347 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.347 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:54:35.347 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.348 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.348 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.348 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:54:35.348 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:54:35.348 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:54:35.348 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:54:35.348 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:54:35.349 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.349 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.349 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:54:35.349 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.349 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.349 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.349 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:54:35.350 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:54:35.350 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.350 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T03:54:35.350 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-06-08T03:54:35.350 INFO:teuthology.orchestra.run.smithi016.stdout: flex-2.6.1-9.el8.x86_64 2023-06-08T03:54:35.350 INFO:teuthology.orchestra.run.smithi016.stdout: fuse-2.9.7-17.el8.x86_64 2023-06-08T03:54:35.350 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-08T03:54:35.350 INFO:teuthology.orchestra.run.smithi016.stdout: jq-1.6-7.el8.x86_64 2023-06-08T03:54:35.351 INFO:teuthology.orchestra.run.smithi016.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-08T03:54:35.351 INFO:teuthology.orchestra.run.smithi016.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-06-08T03:54:35.351 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-08T03:54:35.351 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.351 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.351 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.351 INFO:teuthology.orchestra.run.smithi016.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-06-08T03:54:35.352 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-06-08T03:54:35.352 INFO:teuthology.orchestra.run.smithi016.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-08T03:54:35.352 INFO:teuthology.orchestra.run.smithi016.stdout: libpq-13.5-1.el8.x86_64 2023-06-08T03:54:35.352 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-06-08T03:54:35.352 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-08T03:54:35.352 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.352 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.352 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-08T03:54:35.353 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.353 INFO:teuthology.orchestra.run.smithi016.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-06-08T03:54:35.353 INFO:teuthology.orchestra.run.smithi016.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-08T03:54:35.353 INFO:teuthology.orchestra.run.smithi016.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-08T03:54:35.353 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-08T03:54:35.353 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-06-08T03:54:35.353 INFO:teuthology.orchestra.run.smithi016.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-06-08T03:54:35.353 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-06-08T03:54:35.354 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-08T03:54:35.354 INFO:teuthology.orchestra.run.smithi016.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-08T03:54:35.354 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-0.3.15-4.el8.x86_64 2023-06-08T03:54:35.354 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-06-08T03:54:35.354 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-06-08T03:54:35.354 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-06-08T03:54:35.354 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-06-08T03:54:35.355 INFO:teuthology.orchestra.run.smithi016.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-06-08T03:54:35.355 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-08T03:54:35.355 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-08T03:54:35.355 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-08T03:54:35.355 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-08T03:54:35.355 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-08T03:54:35.355 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-08T03:54:35.355 INFO:teuthology.orchestra.run.smithi016.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-08T03:54:35.356 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-08T03:54:35.356 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.356 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.356 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.356 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-08T03:54:35.356 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-06-08T03:54:35.356 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-08T03:54:35.356 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-08T03:54:35.357 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-06-08T03:54:35.357 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-08T03:54:35.357 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-08T03:54:35.357 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-08T03:54:35.357 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-08T03:54:35.357 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-08T03:54:35.357 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-08T03:54:35.357 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-08T03:54:35.358 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-08T03:54:35.358 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-08T03:54:35.358 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako-1.0.6-14.el8.noarch 2023-06-08T03:54:35.358 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-08T03:54:35.358 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-08T03:54:35.358 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-08T03:54:35.358 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-08T03:54:35.359 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-08T03:54:35.359 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-08T03:54:35.359 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-08T03:54:35.359 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend-2.6-1.el8.noarch 2023-06-08T03:54:35.359 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-08T03:54:35.359 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-08T03:54:35.359 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-08T03:54:35.359 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-08T03:54:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-08T03:54:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-08T03:54:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-08T03:54:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-08T03:54:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-08T03:54:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-08T03:54:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-06-08T03:54:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-08T03:54:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-08T03:54:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-08T03:54:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-08T03:54:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-08T03:54:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-08T03:54:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-08T03:54:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-08T03:54:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-08T03:54:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-08T03:54:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T03:54:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-08T03:54:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-08T03:54:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-08T03:54:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel-5.0.0-11.el8.x86_64 2023-06-08T03:54:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-08T03:54:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-06-08T03:54:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T03:54:35.364 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2023-06-08T03:54:35.632 DEBUG:teuthology.parallel:result is None 2023-06-08T03:58:54.071 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 41 kB/s | 16 MB 06:32 2023-06-08T03:58:58.544 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 161 kB/s | 24 kB 00:00 2023-06-08T03:59:02.460 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-08T03:59:02.461 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-08T03:59:02.473 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-06-08T03:59:02.473 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-06-08T03:59:02.474 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-06-08T03:59:02.475 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-06-08T03:59:02.476 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-08T03:59:02.478 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-08T03:59:02.481 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-08T03:59:02.482 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-08T03:59:02.662 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2023-06-08T03:59:02.676 INFO:teuthology.orchestra.run.smithi169.stdout:==================================================================================================== 2023-06-08T03:59:02.676 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2023-06-08T03:59:02.676 INFO:teuthology.orchestra.run.smithi169.stdout:==================================================================================================== 2023-06-08T03:59:02.676 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2023-06-08T03:59:02.676 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-06-08T03:59:02.676 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.4 k 2023-06-08T03:59:02.677 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 5.4 M 2023-06-08T03:59:02.677 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 848 k 2023-06-08T03:59:02.677 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 166 k 2023-06-08T03:59:02.677 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 1.5 M 2023-06-08T03:59:02.677 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 128 k 2023-06-08T03:59:02.677 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 1.7 M 2023-06-08T03:59:02.677 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 7.4 M 2023-06-08T03:59:02.678 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 47 k 2023-06-08T03:59:02.678 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 13 M 2023-06-08T03:59:02.678 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 41 M 2023-06-08T03:59:02.678 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 258 k 2023-06-08T03:59:02.678 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 160 k 2023-06-08T03:59:02.678 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 258 k 2023-06-08T03:59:02.678 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 18 k 2023-06-08T03:59:02.679 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-06-08T03:59:02.679 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-06-08T03:59:02.679 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-06-08T03:59:02.679 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 31 k 2023-06-08T03:59:02.679 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 771 k 2023-06-08T03:59:02.679 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 139 k 2023-06-08T03:59:02.679 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-06-08T03:59:02.680 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-06-08T03:59:02.680 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-06-08T03:59:02.680 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-06-08T03:59:02.680 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-06-08T03:59:02.680 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-06-08T03:59:02.680 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 197 k 2023-06-08T03:59:02.680 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 370 k 2023-06-08T03:59:02.681 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 365 k 2023-06-08T03:59:02.681 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 107 k 2023-06-08T03:59:02.681 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 94 k 2023-06-08T03:59:02.681 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.4 M 2023-06-08T03:59:02.681 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 179 k 2023-06-08T03:59:02.681 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 5.0.0-11.el8 baseos 74 k 2023-06-08T03:59:02.681 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2023-06-08T03:59:02.682 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-6.el8 baseos 143 k 2023-06-08T03:59:02.682 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-06-08T03:59:02.682 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-06-08T03:59:02.682 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-06-08T03:59:02.682 INFO:teuthology.orchestra.run.smithi169.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-06-08T03:59:02.682 INFO:teuthology.orchestra.run.smithi169.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-06-08T03:59:02.682 INFO:teuthology.orchestra.run.smithi169.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-06-08T03:59:02.683 INFO:teuthology.orchestra.run.smithi169.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-06-08T03:59:02.683 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.7 M 2023-06-08T03:59:02.683 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.6 M 2023-06-08T03:59:02.683 INFO:teuthology.orchestra.run.smithi169.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-06-08T03:59:02.683 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-06-08T03:59:02.683 INFO:teuthology.orchestra.run.smithi169.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-06-08T03:59:02.683 INFO:teuthology.orchestra.run.smithi169.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-06-08T03:59:02.684 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs x86_64 5.0.0-11.el8 baseos 1.1 M 2023-06-08T03:59:02.684 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2023-06-08T03:59:02.684 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-06-08T03:59:02.684 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 22 M 2023-06-08T03:59:02.684 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 23 k 2023-06-08T03:59:02.684 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 2.3 M 2023-06-08T03:59:02.684 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 240 k 2023-06-08T03:59:02.685 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 4.6 M 2023-06-08T03:59:02.685 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 18 M 2023-06-08T03:59:02.685 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 15 k 2023-06-08T03:59:02.685 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 24 k 2023-06-08T03:59:02.685 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-06-08T03:59:02.685 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-08T03:59:02.685 INFO:teuthology.orchestra.run.smithi169.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-06-08T03:59:02.686 INFO:teuthology.orchestra.run.smithi169.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-06-08T03:59:02.686 INFO:teuthology.orchestra.run.smithi169.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-06-08T03:59:02.686 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 137 k 2023-06-08T03:59:02.686 INFO:teuthology.orchestra.run.smithi169.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-06-08T03:59:02.686 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-06-08T03:59:02.686 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-08T03:59:02.686 INFO:teuthology.orchestra.run.smithi169.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-06-08T03:59:02.687 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-06-08T03:59:02.687 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-06-08T03:59:02.687 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 473 k 2023-06-08T03:59:02.687 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-06-08T03:59:02.687 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.5 M 2023-06-08T03:59:02.687 INFO:teuthology.orchestra.run.smithi169.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-06-08T03:59:02.687 INFO:teuthology.orchestra.run.smithi169.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-06-08T03:59:02.688 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-08T03:59:02.688 INFO:teuthology.orchestra.run.smithi169.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-06-08T03:59:02.688 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-06-08T03:59:02.688 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-06-08T03:59:02.688 INFO:teuthology.orchestra.run.smithi169.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-06-08T03:59:02.688 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-06-08T03:59:02.688 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-06-08T03:59:02.689 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-06-08T03:59:02.689 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-06-08T03:59:02.689 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-06-08T03:59:02.689 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-08T03:59:02.689 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-06-08T03:59:02.689 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-08T03:59:02.689 INFO:teuthology.orchestra.run.smithi169.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-08T03:59:02.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-08T03:59:02.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 45 k 2023-06-08T03:59:02.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 119 k 2023-06-08T03:59:02.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-08T03:59:02.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.11.5-5.el8 baseos 237 k 2023-06-08T03:59:02.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-08T03:59:02.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-08T03:59:02.690 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 3.2.1-5.el8 baseos 559 k 2023-06-08T03:59:02.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-08T03:59:02.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-08T03:59:02.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-08T03:59:02.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-06-08T03:59:02.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-06-08T03:59:02.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-06-08T03:59:02.691 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-06-08T03:59:02.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-08T03:59:02.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-08T03:59:02.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-06-08T03:59:02.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-06-08T03:59:02.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-08T03:59:02.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-08T03:59:02.692 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-06-08T03:59:02.693 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-06-08T03:59:02.693 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-06-08T03:59:02.693 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-08T03:59:02.693 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-08T03:59:02.693 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-06-08T03:59:02.693 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-06-08T03:59:02.693 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-06-08T03:59:02.694 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-06-08T03:59:02.694 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-06-08T03:59:02.694 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-06-08T03:59:02.694 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-08T03:59:02.694 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-06-08T03:59:02.694 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-08T03:59:02.694 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-08T03:59:02.695 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-06-08T03:59:02.695 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-08T03:59:02.695 INFO:teuthology.orchestra.run.smithi169.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-08T03:59:02.695 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-08T03:59:02.695 INFO:teuthology.orchestra.run.smithi169.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-08T03:59:02.695 INFO:teuthology.orchestra.run.smithi169.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-08T03:59:02.695 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-08T03:59:02.696 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-08T03:59:02.696 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-08T03:59:02.696 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-06-08T03:59:02.696 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-08T03:59:02.696 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-06-08T03:59:02.696 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-08T03:59:02.696 INFO:teuthology.orchestra.run.smithi169.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-06-08T03:59:02.697 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-06-08T03:59:02.697 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-06-08T03:59:02.697 INFO:teuthology.orchestra.run.smithi169.stdout:Enabling module streams: 2023-06-08T03:59:02.697 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql 10 2023-06-08T03:59:02.697 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T03:59:02.697 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2023-06-08T03:59:02.697 INFO:teuthology.orchestra.run.smithi169.stdout:==================================================================================================== 2023-06-08T03:59:02.697 INFO:teuthology.orchestra.run.smithi169.stdout:Install 128 Packages 2023-06-08T03:59:02.698 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 15 Packages 2023-06-08T03:59:02.698 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T03:59:02.698 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 204 M 2023-06-08T03:59:02.698 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2023-06-08T03:59:04.487 INFO:teuthology.orchestra.run.smithi169.stdout:(1/143): ceph-18.0.0-4313.ga02638f8.el8.x86_64. 31 kB/s | 6.4 kB 00:00 2023-06-08T03:59:04.679 INFO:teuthology.orchestra.run.smithi169.stdout:(2/143): ceph-fuse-18.0.0-4313.ga02638f8.el8.x8 4.3 MB/s | 848 kB 00:00 2023-06-08T03:59:04.729 INFO:teuthology.orchestra.run.smithi169.stdout:(3/143): ceph-immutable-object-cache-18.0.0-431 3.3 MB/s | 166 kB 00:00 2023-06-08T03:59:04.954 INFO:teuthology.orchestra.run.smithi169.stdout:(4/143): ceph-base-18.0.0-4313.ga02638f8.el8.x8 8.0 MB/s | 5.4 MB 00:00 2023-06-08T03:59:05.013 INFO:teuthology.orchestra.run.smithi169.stdout:(5/143): ceph-mds-18.0.0-4313.ga02638f8.el8.x86 8.1 MB/s | 2.3 MB 00:00 2023-06-08T03:59:05.121 INFO:teuthology.orchestra.run.smithi169.stdout:(6/143): ceph-mgr-18.0.0-4313.ga02638f8.el8.x86 9.3 MB/s | 1.5 MB 00:00 2023-06-08T03:59:05.480 INFO:teuthology.orchestra.run.smithi169.stdout:(7/143): ceph-mon-18.0.0-4313.ga02638f8.el8.x86 9.9 MB/s | 4.6 MB 00:00 2023-06-08T03:59:06.939 INFO:teuthology.orchestra.run.smithi169.stdout:(8/143): ceph-osd-18.0.0-4313.ga02638f8.el8.x86 9.8 MB/s | 18 MB 00:01 2023-06-08T03:59:07.097 INFO:teuthology.orchestra.run.smithi169.stdout:(9/143): ceph-radosgw-18.0.0-4313.ga02638f8.el8 8.1 MB/s | 13 MB 00:01 2023-06-08T03:59:07.122 INFO:teuthology.orchestra.run.smithi169.stdout:(10/143): ceph-selinux-18.0.0-4313.ga02638f8.el 133 kB/s | 24 kB 00:00 2023-06-08T03:59:07.223 INFO:teuthology.orchestra.run.smithi169.stdout:(11/143): cephfs-mirror-18.0.0-4313.ga02638f8.e 2.5 MB/s | 258 kB 00:00 2023-06-08T03:59:07.281 INFO:teuthology.orchestra.run.smithi169.stdout:(12/143): libcephfs-devel-18.0.0-4313.ga02638f8 533 kB/s | 31 kB 00:00 2023-06-08T03:59:07.415 INFO:teuthology.orchestra.run.smithi169.stdout:(13/143): libcephfs2-18.0.0-4313.ga02638f8.el8. 5.7 MB/s | 771 kB 00:00 2023-06-08T03:59:07.490 INFO:teuthology.orchestra.run.smithi169.stdout:(14/143): libcephsqlite-18.0.0-4313.ga02638f8.e 1.8 MB/s | 137 kB 00:00 2023-06-08T03:59:07.566 INFO:teuthology.orchestra.run.smithi169.stdout:(15/143): librados-devel-18.0.0-4313.ga02638f8. 1.8 MB/s | 139 kB 00:00 2023-06-08T03:59:07.658 INFO:teuthology.orchestra.run.smithi169.stdout:(16/143): libradosstriper1-18.0.0-4313.ga02638f 5.1 MB/s | 473 kB 00:00 2023-06-08T03:59:08.433 INFO:teuthology.orchestra.run.smithi169.stdout:(17/143): librgw2-18.0.0-4313.ga02638f8.el8.x86 8.5 MB/s | 6.5 MB 00:00 2023-06-08T03:59:08.500 INFO:teuthology.orchestra.run.smithi169.stdout:(18/143): python3-ceph-argparse-18.0.0-4313.ga0 671 kB/s | 45 kB 00:00 2023-06-08T03:59:08.575 INFO:teuthology.orchestra.run.smithi169.stdout:(19/143): python3-ceph-common-18.0.0-4313.ga026 1.6 MB/s | 119 kB 00:00 2023-06-08T03:59:08.650 INFO:teuthology.orchestra.run.smithi169.stdout:(20/143): python3-cephfs-18.0.0-4313.ga02638f8. 2.6 MB/s | 197 kB 00:00 2023-06-08T03:59:08.734 INFO:teuthology.orchestra.run.smithi169.stdout:(21/143): python3-rados-18.0.0-4313.ga02638f8.e 4.3 MB/s | 370 kB 00:00 2023-06-08T03:59:08.818 INFO:teuthology.orchestra.run.smithi169.stdout:(22/143): python3-rbd-18.0.0-4313.ga02638f8.el8 4.3 MB/s | 365 kB 00:00 2023-06-08T03:59:08.893 INFO:teuthology.orchestra.run.smithi169.stdout:(23/143): python3-rgw-18.0.0-4313.ga02638f8.el8 1.4 MB/s | 107 kB 00:00 2023-06-08T03:59:08.968 INFO:teuthology.orchestra.run.smithi169.stdout:(24/143): rbd-fuse-18.0.0-4313.ga02638f8.el8.x8 1.2 MB/s | 94 kB 00:00 2023-06-08T03:59:09.219 INFO:teuthology.orchestra.run.smithi169.stdout:(25/143): ceph-common-18.0.0-4313.ga02638f8.el8 4.4 MB/s | 22 MB 00:04 2023-06-08T03:59:09.303 INFO:teuthology.orchestra.run.smithi169.stdout:(26/143): rbd-nbd-18.0.0-4313.ga02638f8.el8.x86 2.1 MB/s | 179 kB 00:00 2023-06-08T03:59:09.369 INFO:teuthology.orchestra.run.smithi169.stdout:(27/143): rbd-mirror-18.0.0-4313.ga02638f8.el8. 8.6 MB/s | 3.4 MB 00:00 2023-06-08T03:59:09.394 INFO:teuthology.orchestra.run.smithi169.stdout:(28/143): ceph-grafana-dashboards-18.0.0-4313.g 252 kB/s | 23 kB 00:00 2023-06-08T03:59:09.420 INFO:teuthology.orchestra.run.smithi169.stdout:(29/143): ceph-mgr-cephadm-18.0.0-4313.ga02638f 2.5 MB/s | 128 kB 00:00 2023-06-08T03:59:09.820 INFO:teuthology.orchestra.run.smithi169.stdout:(30/143): ceph-test-18.0.0-4313.ga02638f8.el8.x 15 MB/s | 41 MB 00:02 2023-06-08T03:59:09.879 INFO:teuthology.orchestra.run.smithi169.stdout:(31/143): ceph-mgr-dashboard-18.0.0-4313.ga0263 3.5 MB/s | 1.7 MB 00:00 2023-06-08T03:59:09.904 INFO:teuthology.orchestra.run.smithi169.stdout:(32/143): ceph-mgr-modules-core-18.0.0-4313.ga0 2.8 MB/s | 240 kB 00:00 2023-06-08T03:59:09.946 INFO:teuthology.orchestra.run.smithi169.stdout:(33/143): ceph-prometheus-alerts-18.0.0-4313.ga 351 kB/s | 15 kB 00:00 2023-06-08T03:59:09.972 INFO:teuthology.orchestra.run.smithi169.stdout:(34/143): ceph-mgr-rook-18.0.0-4313.ga02638f8.e 515 kB/s | 47 kB 00:00 2023-06-08T03:59:10.005 INFO:teuthology.orchestra.run.smithi169.stdout:(35/143): ceph-volume-18.0.0-4313.ga02638f8.el8 4.3 MB/s | 258 kB 00:00 2023-06-08T03:59:10.047 INFO:teuthology.orchestra.run.smithi169.stdout:(36/143): cephadm-18.0.0-4313.ga02638f8.el8.noa 2.1 MB/s | 160 kB 00:00 2023-06-08T03:59:10.072 INFO:teuthology.orchestra.run.smithi169.stdout:(37/143): cephfs-top-18.0.0-4313.ga02638f8.el8. 267 kB/s | 18 kB 00:00 2023-06-08T03:59:10.156 INFO:teuthology.orchestra.run.smithi169.stdout:(38/143): ceph-mgr-diskprediction-local-18.0.0- 10 MB/s | 7.4 MB 00:00 2023-06-08T03:59:10.607 INFO:teuthology.orchestra.run.smithi169.stdout:(39/143): bison-3.0.4-10.el8.x86_64.rpm 1.3 MB/s | 688 kB 00:00 2023-06-08T03:59:10.623 INFO:teuthology.orchestra.run.smithi169.stdout:(40/143): flex-2.6.1-9.el8.x86_64.rpm 685 kB/s | 320 kB 00:00 2023-06-08T03:59:10.649 INFO:teuthology.orchestra.run.smithi169.stdout:(41/143): automake-1.16.1-7.el8.noarch.rpm 1.2 MB/s | 713 kB 00:00 2023-06-08T03:59:10.707 INFO:teuthology.orchestra.run.smithi169.stdout:(42/143): jq-1.6-7.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2023-06-08T03:59:10.724 INFO:teuthology.orchestra.run.smithi169.stdout:(43/143): libpq-13.5-1.el8.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2023-06-08T03:59:10.758 INFO:teuthology.orchestra.run.smithi169.stdout:(44/143): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-06-08T03:59:10.825 INFO:teuthology.orchestra.run.smithi169.stdout:(45/143): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2023-06-08T03:59:10.850 INFO:teuthology.orchestra.run.smithi169.stdout:(46/143): oniguruma-6.8.2-2.el8.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-06-08T03:59:10.876 INFO:teuthology.orchestra.run.smithi169.stdout:(47/143): libtool-2.4.6-25.el8.x86_64.rpm 4.1 MB/s | 709 kB 00:00 2023-06-08T03:59:11.134 INFO:teuthology.orchestra.run.smithi169.stdout:(48/143): postgresql-10.23-1.module_el8+300+2c5 6.1 MB/s | 1.6 MB 00:00 2023-06-08T03:59:11.318 INFO:teuthology.orchestra.run.smithi169.stdout:(49/143): postgresql-contrib-10.23-1.module_el8 4.8 MB/s | 903 kB 00:00 2023-06-08T03:59:11.493 INFO:teuthology.orchestra.run.smithi169.stdout:(50/143): openblas-threads-0.3.15-4.el8.x86_64. 7.6 MB/s | 4.9 MB 00:00 2023-06-08T03:59:11.560 INFO:teuthology.orchestra.run.smithi169.stdout:(51/143): openblas-0.3.15-4.el8.x86_64.rpm 6.4 MB/s | 4.7 MB 00:00 2023-06-08T03:59:11.669 INFO:teuthology.orchestra.run.smithi169.stdout:(52/143): python3-jinja2-2.10.1-3.el8.noarch.rp 4.9 MB/s | 538 kB 00:00 2023-06-08T03:59:11.769 INFO:teuthology.orchestra.run.smithi169.stdout:(53/143): python3-jsonpatch-1.21-2.el8.noarch.r 266 kB/s | 27 kB 00:00 2023-06-08T03:59:11.869 INFO:teuthology.orchestra.run.smithi169.stdout:(54/143): python3-jsonpointer-1.10-11.el8.noarc 200 kB/s | 20 kB 00:00 2023-06-08T03:59:11.936 INFO:teuthology.orchestra.run.smithi169.stdout:(55/143): postgresql-server-10.23-1.module_el8+ 8.3 MB/s | 5.1 MB 00:00 2023-06-08T03:59:11.970 INFO:teuthology.orchestra.run.smithi169.stdout:(56/143): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-06-08T03:59:12.045 INFO:teuthology.orchestra.run.smithi169.stdout:(57/143): python3-babel-2.5.1-7.el8.noarch.rpm 8.7 MB/s | 4.8 MB 00:00 2023-06-08T03:59:12.070 INFO:teuthology.orchestra.run.smithi169.stdout:(58/143): python3-markupsafe-0.23-19.el8.x86_64 290 kB/s | 39 kB 00:00 2023-06-08T03:59:12.146 INFO:teuthology.orchestra.run.smithi169.stdout:(59/143): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-06-08T03:59:12.171 INFO:teuthology.orchestra.run.smithi169.stdout:(60/143): python3-prettytable-0.7.2-14.el8.noar 438 kB/s | 44 kB 00:00 2023-06-08T03:59:12.246 INFO:teuthology.orchestra.run.smithi169.stdout:(61/143): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-06-08T03:59:12.263 INFO:teuthology.orchestra.run.smithi169.stdout:(62/143): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.3 MB/s | 126 kB 00:00 2023-06-08T03:59:12.356 INFO:teuthology.orchestra.run.smithi169.stdout:(63/143): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-06-08T03:59:12.372 INFO:teuthology.orchestra.run.smithi169.stdout:(64/143): python3-pytz-2017.2-9.el8.noarch.rpm 498 kB/s | 54 kB 00:00 2023-06-08T03:59:12.439 INFO:teuthology.orchestra.run.smithi169.stdout:(65/143): python3-numpy-1.14.3-10.el8.x86_64.rp 8.0 MB/s | 3.7 MB 00:00 2023-06-08T03:59:12.473 INFO:teuthology.orchestra.run.smithi169.stdout:(66/143): python3-werkzeug-0.12.2-4.el8.noarch. 4.5 MB/s | 457 kB 00:00 2023-06-08T03:59:12.540 INFO:teuthology.orchestra.run.smithi169.stdout:(67/143): socat-1.7.4.1-1.el8.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2023-06-08T03:59:12.565 INFO:teuthology.orchestra.run.smithi169.stdout:(68/143): uuid-1.6.2-43.el8.x86_64.rpm 695 kB/s | 64 kB 00:00 2023-06-08T03:59:12.641 INFO:teuthology.orchestra.run.smithi169.stdout:(69/143): xmlstarlet-1.6.1-20.el8.x86_64.rpm 706 kB/s | 71 kB 00:00 2023-06-08T03:59:12.933 INFO:teuthology.orchestra.run.smithi169.stdout:(70/143): elfutils-libelf-devel-0.189-2.el8.x86 168 kB/s | 61 kB 00:00 2023-06-08T03:59:13.058 INFO:teuthology.orchestra.run.smithi169.stdout:(71/143): fuse-2.9.7-17.el8.x86_64.rpm 199 kB/s | 83 kB 00:00 2023-06-08T03:59:13.091 INFO:teuthology.orchestra.run.smithi169.stdout:(72/143): keyutils-libs-devel-1.5.10-9.el8.x86_ 303 kB/s | 48 kB 00:00 2023-06-08T03:59:13.317 INFO:teuthology.orchestra.run.smithi169.stdout:(73/143): python3-scipy-1.0.0-21.module_el8.5.0 14 MB/s | 14 MB 00:00 2023-06-08T03:59:13.342 INFO:teuthology.orchestra.run.smithi169.stdout:(74/143): libaio-devel-0.3.112-1.el8.x86_64.rpm 74 kB/s | 19 kB 00:00 2023-06-08T03:59:13.651 INFO:teuthology.orchestra.run.smithi169.stdout:(75/143): libcom_err-devel-1.45.6-5.el8.x86_64. 116 kB/s | 39 kB 00:00 2023-06-08T03:59:13.718 INFO:teuthology.orchestra.run.smithi169.stdout:(76/143): krb5-devel-1.18.2-22.el8.x86_64.rpm 850 kB/s | 561 kB 00:00 2023-06-08T03:59:13.868 INFO:teuthology.orchestra.run.smithi169.stdout:(77/143): librabbitmq-0.9.0-3.el8.x86_64.rpm 313 kB/s | 47 kB 00:00 2023-06-08T03:59:13.977 INFO:teuthology.orchestra.run.smithi169.stdout:(78/143): libgfortran-8.5.0-19.el8.x86_64.rpm 1.0 MB/s | 645 kB 00:00 2023-06-08T03:59:14.002 INFO:teuthology.orchestra.run.smithi169.stdout:(79/143): libquadmath-8.5.0-19.el8.x86_64.rpm 491 kB/s | 172 kB 00:00 2023-06-08T03:59:14.127 INFO:teuthology.orchestra.run.smithi169.stdout:(80/143): libsepol-devel-2.9-3.el8.x86_64.rpm 580 kB/s | 87 kB 00:00 2023-06-08T03:59:14.152 INFO:teuthology.orchestra.run.smithi169.stdout:(81/143): libselinux-devel-2.9-8.el8.x86_64.rpm 705 kB/s | 200 kB 00:00 2023-06-08T03:59:14.244 INFO:teuthology.orchestra.run.smithi169.stdout:(82/143): libuuid-devel-2.32.1-42.el8.x86_64.rp 411 kB/s | 99 kB 00:00 2023-06-08T03:59:14.270 INFO:teuthology.orchestra.run.smithi169.stdout:(83/143): libverto-devel-0.3.2-2.el8.x86_64.rpm 127 kB/s | 18 kB 00:00 2023-06-08T03:59:14.303 INFO:teuthology.orchestra.run.smithi169.stdout:(84/143): libzstd-devel-1.4.4-1.el8.x86_64.rpm 291 kB/s | 44 kB 00:00 2023-06-08T03:59:14.545 INFO:teuthology.orchestra.run.smithi169.stdout:(85/143): pcre2-utf16-10.32-3.el8.x86_64.rpm 948 kB/s | 229 kB 00:00 2023-06-08T03:59:14.579 INFO:teuthology.orchestra.run.smithi169.stdout:(86/143): pcre2-devel-10.32-3.el8.x86_64.rpm 1.9 MB/s | 605 kB 00:00 2023-06-08T03:59:14.754 INFO:teuthology.orchestra.run.smithi169.stdout:(87/143): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.3 MB/s | 237 kB 00:00 2023-06-08T03:59:14.779 INFO:teuthology.orchestra.run.smithi169.stdout:(88/143): pcre2-utf32-10.32-3.el8.x86_64.rpm 944 kB/s | 220 kB 00:00 2023-06-08T03:59:14.913 INFO:teuthology.orchestra.run.smithi169.stdout:(89/143): python3-jwt-1.6.1-2.el8.noarch.rpm 320 kB/s | 43 kB 00:00 2023-06-08T03:59:15.005 INFO:teuthology.orchestra.run.smithi169.stdout:(90/143): python3-cryptography-3.2.1-5.el8.x86_ 2.2 MB/s | 559 kB 00:00 2023-06-08T03:59:15.105 INFO:teuthology.orchestra.run.smithi169.stdout:(91/143): python3-oauthlib-2.1.0-1.el8.noarch.r 809 kB/s | 155 kB 00:00 2023-06-08T03:59:15.164 INFO:teuthology.orchestra.run.smithi169.stdout:(92/143): python3-pycparser-2.14-14.el8.noarch. 688 kB/s | 109 kB 00:00 2023-06-08T03:59:15.239 INFO:teuthology.orchestra.run.smithi169.stdout:(93/143): python3-requests-oauthlib-1.0.0-1.el8 319 kB/s | 43 kB 00:00 2023-06-08T03:59:15.298 INFO:teuthology.orchestra.run.smithi169.stdout:(94/143): xfsprogs-devel-5.0.0-11.el8.x86_64.rp 556 kB/s | 74 kB 00:00 2023-06-08T03:59:15.382 INFO:teuthology.orchestra.run.smithi169.stdout:(95/143): zlib-devel-1.2.11-21.el8.x86_64.rpm 409 kB/s | 58 kB 00:00 2023-06-08T03:59:15.482 INFO:teuthology.orchestra.run.smithi169.stdout:(96/143): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-06-08T03:59:15.507 INFO:teuthology.orchestra.run.smithi169.stdout:(97/143): liboath-2.6.2-3.el8.x86_64.rpm 470 kB/s | 59 kB 00:00 2023-06-08T03:59:15.566 INFO:teuthology.orchestra.run.smithi169.stdout:(98/143): openssl-devel-1.1.1k-9.el8.x86_64.rpm 2.4 MB/s | 3.2 MB 00:01 2023-06-08T03:59:15.591 INFO:teuthology.orchestra.run.smithi169.stdout:(99/143): libunwind-1.3.1-3.el8.x86_64.rpm 689 kB/s | 75 kB 00:00 2023-06-08T03:59:15.650 INFO:teuthology.orchestra.run.smithi169.stdout:(100/143): python3-beautifulsoup4-4.6.3-2.el8.1 3.1 MB/s | 185 kB 00:00 2023-06-08T03:59:15.675 INFO:teuthology.orchestra.run.smithi169.stdout:(101/143): python3-asyncssh-2.7.0-2.el8.noarch. 2.8 MB/s | 476 kB 00:00 2023-06-08T03:59:15.700 INFO:teuthology.orchestra.run.smithi169.stdout:(102/143): python3-bcrypt-3.1.6-2.el8.1.x86_64. 326 kB/s | 44 kB 00:00 2023-06-08T03:59:15.726 INFO:teuthology.orchestra.run.smithi169.stdout:(103/143): python3-cachetools-3.1.1-4.el8.noarc 437 kB/s | 33 kB 00:00 2023-06-08T03:59:15.751 INFO:teuthology.orchestra.run.smithi169.stdout:(104/143): python3-certifi-2018.10.15-7.el8.noa 216 kB/s | 16 kB 00:00 2023-06-08T03:59:15.801 INFO:teuthology.orchestra.run.smithi169.stdout:(105/143): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2023-06-08T03:59:15.827 INFO:teuthology.orchestra.run.smithi169.stdout:(106/143): python3-cheroot-8.5.2-1.el8.noarch.r 1.3 MB/s | 173 kB 00:00 2023-06-08T03:59:15.852 INFO:teuthology.orchestra.run.smithi169.stdout:(107/143): python3-jaraco-6.2-6.el8.noarch.rpm 223 kB/s | 11 kB 00:00 2023-06-08T03:59:15.877 INFO:teuthology.orchestra.run.smithi169.stdout:(108/143): python3-jaraco-functools-2.0-4.el8.n 352 kB/s | 18 kB 00:00 2023-06-08T03:59:15.902 INFO:teuthology.orchestra.run.smithi169.stdout:(109/143): python3-cherrypy-18.4.0-1.el8.noarch 2.5 MB/s | 384 kB 00:00 2023-06-08T03:59:15.919 INFO:teuthology.orchestra.run.smithi169.stdout:(110/143): python3-logutils-0.3.5-11.el8.noarch 1.1 MB/s | 49 kB 00:00 2023-06-08T03:59:15.944 INFO:teuthology.orchestra.run.smithi169.stdout:(111/143): python3-more-itertools-7.2.0-3.el8.n 1.4 MB/s | 59 kB 00:00 2023-06-08T03:59:15.970 INFO:teuthology.orchestra.run.smithi169.stdout:(112/143): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2023-06-08T03:59:16.012 INFO:teuthology.orchestra.run.smithi169.stdout:(113/143): python3-kubernetes-11.0.0-6.el8.noar 7.3 MB/s | 1.2 MB 00:00 2023-06-08T03:59:16.029 INFO:teuthology.orchestra.run.smithi169.stdout:(114/143): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2023-06-08T03:59:16.054 INFO:teuthology.orchestra.run.smithi169.stdout:(115/143): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-06-08T03:59:16.071 INFO:teuthology.orchestra.run.smithi169.stdout:(116/143): python3-repoze-lru-0.7-6.el8.noarch. 575 kB/s | 34 kB 00:00 2023-06-08T03:59:16.105 INFO:teuthology.orchestra.run.smithi169.stdout:(117/143): python3-routes-2.4.1-12.el8.noarch.r 2.5 MB/s | 196 kB 00:00 2023-06-08T03:59:16.130 INFO:teuthology.orchestra.run.smithi169.stdout:(118/143): python3-simplegeneric-0.8.1-17.el8.n 320 kB/s | 19 kB 00:00 2023-06-08T03:59:16.155 INFO:teuthology.orchestra.run.smithi169.stdout:(119/143): python3-rsa-4.8-1.el8.noarch.rpm 612 kB/s | 61 kB 00:00 2023-06-08T03:59:16.183 INFO:teuthology.orchestra.run.smithi169.stdout:(120/143): python3-singledispatch-3.4.0.3-18.el 309 kB/s | 24 kB 00:00 2023-06-08T03:59:16.208 INFO:teuthology.orchestra.run.smithi169.stdout:(121/143): python3-tempora-1.14.1-5.el8.noarch. 377 kB/s | 29 kB 00:00 2023-06-08T03:59:16.266 INFO:teuthology.orchestra.run.smithi169.stdout:(122/143): python3-trustme-0.6.0-4.el8.noarch.r 330 kB/s | 27 kB 00:00 2023-06-08T03:59:16.292 INFO:teuthology.orchestra.run.smithi169.stdout:(123/143): python3-webob-1.8.5-1.el8.1.noarch.r 2.9 MB/s | 251 kB 00:00 2023-06-08T03:59:16.317 INFO:teuthology.orchestra.run.smithi169.stdout:(124/143): python3-websocket-client-0.56.0-5.el 1.2 MB/s | 61 kB 00:00 2023-06-08T03:59:16.342 INFO:teuthology.orchestra.run.smithi169.stdout:(125/143): python3-waitress-1.4.3-1.el8.noarch. 1.6 MB/s | 255 kB 00:00 2023-06-08T03:59:16.367 INFO:teuthology.orchestra.run.smithi169.stdout:(126/143): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2023-06-08T03:59:16.393 INFO:teuthology.orchestra.run.smithi169.stdout:(127/143): python3-zc-lockfile-2.0-2.el8.noarch 305 kB/s | 23 kB 00:00 2023-06-08T03:59:16.493 INFO:teuthology.orchestra.run.smithi169.stdout:(128/143): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2023-06-08T03:59:16.818 INFO:teuthology.orchestra.run.smithi169.stdout:(129/143): NetworkManager-initscripts-updown-1. 440 kB/s | 143 kB 00:00 2023-06-08T03:59:17.035 INFO:teuthology.orchestra.run.smithi169.stdout:(130/143): elfutils-debuginfod-client-0.189-2.e 351 kB/s | 76 kB 00:00 2023-06-08T03:59:17.386 INFO:teuthology.orchestra.run.smithi169.stdout:(131/143): librados2-18.0.0-4313.ga02638f8.el8. 3.6 MB/s | 3.7 MB 00:01 2023-06-08T03:59:17.436 INFO:teuthology.orchestra.run.smithi169.stdout:(132/143): elfutils-libelf-0.189-2.el8.x86_64.r 579 kB/s | 232 kB 00:00 2023-06-08T03:59:17.728 INFO:teuthology.orchestra.run.smithi169.stdout:(133/143): librbd1-18.0.0-4313.ga02638f8.el8.x8 2.7 MB/s | 3.6 MB 00:01 2023-06-08T03:59:17.970 INFO:teuthology.orchestra.run.smithi169.stdout:(134/143): elfutils-libs-0.189-2.el8.x86_64.rpm 519 kB/s | 302 kB 00:00 2023-06-08T03:59:18.053 INFO:teuthology.orchestra.run.smithi169.stdout:(135/143): iproute-6.2.0-2.el8.x86_64.rpm 1.4 MB/s | 880 kB 00:00 2023-06-08T03:59:18.129 INFO:teuthology.orchestra.run.smithi169.stdout:(136/143): libblkid-2.32.1-42.el8.x86_64.rpm 550 kB/s | 220 kB 00:00 2023-06-08T03:59:18.170 INFO:teuthology.orchestra.run.smithi169.stdout:(137/143): libfdisk-2.32.1-42.el8.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2023-06-08T03:59:18.195 INFO:teuthology.orchestra.run.smithi169.stdout:(138/143): libmount-2.32.1-42.el8.x86_64.rpm 1.6 MB/s | 236 kB 00:00 2023-06-08T03:59:18.246 INFO:teuthology.orchestra.run.smithi169.stdout:(139/143): libsmartcols-2.32.1-42.el8.x86_64.rp 1.5 MB/s | 179 kB 00:00 2023-06-08T03:59:18.288 INFO:teuthology.orchestra.run.smithi169.stdout:(140/143): libuuid-2.32.1-42.el8.x86_64.rpm 841 kB/s | 98 kB 00:00 2023-06-08T03:59:18.355 INFO:teuthology.orchestra.run.smithi169.stdout:(141/143): util-linux-user-2.32.1-42.el8.x86_64 942 kB/s | 102 kB 00:00 2023-06-08T03:59:18.522 INFO:teuthology.orchestra.run.smithi169.stdout:(142/143): xfsprogs-5.0.0-11.el8.x86_64.rpm 4.6 MB/s | 1.1 MB 00:00 2023-06-08T03:59:18.572 INFO:teuthology.orchestra.run.smithi169.stdout:(143/143): util-linux-2.32.1-42.el8.x86_64.rpm 6.9 MB/s | 2.6 MB 00:00 2023-06-08T03:59:18.575 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2023-06-08T03:59:18.575 INFO:teuthology.orchestra.run.smithi169.stdout:Total 13 MB/s | 204 MB 00:15 2023-06-08T03:59:20.358 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2023-06-08T03:59:20.864 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2023-06-08T03:59:20.864 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2023-06-08T03:59:22.510 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2023-06-08T03:59:22.514 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2023-06-08T03:59:27.775 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2023-06-08T03:59:28.002 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-06-08T03:59:28.201 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/158 2023-06-08T03:59:28.337 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-08T03:59:28.440 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-08T03:59:28.637 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-08T03:59:28.731 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-08T03:59:28.952 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/158 2023-06-08T03:59:29.159 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/158 2023-06-08T03:59:29.385 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 6/158 2023-06-08T03:59:29.745 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-08T03:59:30.193 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-08T03:59:30.437 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 8/158 2023-06-08T03:59:30.874 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 8/158 2023-06-08T03:59:31.070 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 9/158 2023-06-08T03:59:31.225 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 9/158 2023-06-08T03:59:31.420 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 10/158 2023-06-08T03:59:31.535 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 10/158 2023-06-08T03:59:31.780 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 11/158 2023-06-08T03:59:31.961 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-08T03:59:32.037 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-08T03:59:32.278 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/158 2023-06-08T03:59:32.504 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/158 2023-06-08T03:59:32.938 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpq-13.5-1.el8.x86_64 15/158 2023-06-08T03:59:33.166 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 16/158 2023-06-08T03:59:33.319 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 17/158 2023-06-08T03:59:33.443 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 17/158 2023-06-08T03:59:33.594 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/158 2023-06-08T03:59:33.833 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/158 2023-06-08T03:59:34.053 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : xfsprogs-5.0.0-11.el8.x86_64 19/158 2023-06-08T03:59:34.185 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: xfsprogs-5.0.0-11.el8.x86_64 19/158 2023-06-08T03:59:34.434 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/158 2023-06-08T03:59:34.619 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/158 2023-06-08T03:59:34.794 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-08T03:59:34.961 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-08T03:59:35.111 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-08T03:59:35.792 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-08T03:59:36.002 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/158 2023-06-08T03:59:36.705 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/158 2023-06-08T03:59:36.885 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-08T03:59:37.700 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-08T03:59:38.036 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/158 2023-06-08T03:59:38.236 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/158 2023-06-08T03:59:38.422 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/158 2023-06-08T03:59:38.630 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/158 2023-06-08T03:59:38.809 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 30/158 2023-06-08T03:59:38.956 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 31/158 2023-06-08T03:59:39.210 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 32/158 2023-06-08T03:59:40.299 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/158 2023-06-08T03:59:40.649 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/158 2023-06-08T03:59:40.937 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/158 2023-06-08T03:59:41.151 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-08T03:59:43.228 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-08T03:59:43.531 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/158 2023-06-08T03:59:43.752 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/158 2023-06-08T03:59:43.979 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/158 2023-06-08T03:59:44.192 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 40/158 2023-06-08T03:59:44.370 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 41/158 2023-06-08T03:59:44.540 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/158 2023-06-08T03:59:44.724 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/158 2023-06-08T03:59:44.959 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-08T03:59:45.053 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-08T03:59:45.242 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/158 2023-06-08T03:59:45.328 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/158 2023-06-08T03:59:45.480 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/158 2023-06-08T03:59:45.659 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-08T03:59:46.252 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-08T03:59:46.535 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-08T03:59:46.563 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-08T03:59:46.758 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/158 2023-06-08T03:59:47.033 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/158 2023-06-08T03:59:47.250 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/158 2023-06-08T03:59:47.397 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/158 2023-06-08T03:59:47.555 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/158 2023-06-08T03:59:47.755 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/158 2023-06-08T03:59:47.973 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/158 2023-06-08T03:59:48.172 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/158 2023-06-08T03:59:48.387 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/158 2023-06-08T03:59:48.540 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/158 2023-06-08T03:59:48.715 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/158 2023-06-08T03:59:48.891 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/158 2023-06-08T03:59:49.076 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/158 2023-06-08T03:59:49.280 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/158 2023-06-08T03:59:49.512 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/158 2023-06-08T03:59:49.731 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/158 2023-06-08T03:59:49.949 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/158 2023-06-08T03:59:50.362 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/158 2023-06-08T03:59:50.627 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/158 2023-06-08T03:59:50.811 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/158 2023-06-08T03:59:51.627 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/158 2023-06-08T03:59:51.850 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 70/158 2023-06-08T03:59:51.940 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 70/158 2023-06-08T03:59:52.186 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 71/158 2023-06-08T03:59:52.419 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/158 2023-06-08T03:59:52.810 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 73/158 2023-06-08T03:59:53.057 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 74/158 2023-06-08T03:59:53.240 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/158 2023-06-08T03:59:53.480 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/158 2023-06-08T03:59:53.709 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/158 2023-06-08T03:59:54.996 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/158 2023-06-08T03:59:55.401 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/158 2023-06-08T03:59:55.626 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/158 2023-06-08T03:59:55.869 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/158 2023-06-08T03:59:56.157 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/158 2023-06-08T03:59:56.369 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/158 2023-06-08T03:59:56.635 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/158 2023-06-08T03:59:56.853 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/158 2023-06-08T03:59:57.215 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/158 2023-06-08T03:59:57.405 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/158 2023-06-08T03:59:57.568 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/158 2023-06-08T03:59:57.743 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/158 2023-06-08T03:59:58.080 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/158 2023-06-08T03:59:58.312 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/158 2023-06-08T03:59:58.481 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/158 2023-06-08T03:59:58.683 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/158 2023-06-08T03:59:58.901 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/158 2023-06-08T03:59:59.102 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/158 2023-06-08T03:59:59.288 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/158 2023-06-08T03:59:59.457 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/158 2023-06-08T03:59:59.566 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/158 2023-06-08T03:59:59.733 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/158 2023-06-08T03:59:59.874 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/158 2023-06-08T04:00:03.250 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 100/158 2023-06-08T04:00:03.490 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 100/158 2023-06-08T04:00:04.187 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 100/158 2023-06-08T04:00:04.521 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 101/158 2023-06-08T04:00:04.666 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 101/158 2023-06-08T04:00:04.840 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 102/158 2023-06-08T04:00:25.562 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 102/158 2023-06-08T04:00:25.562 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2023-06-08T04:00:25.562 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2023-06-08T04:00:25.562 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /dev 2023-06-08T04:00:25.563 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /run 2023-06-08T04:00:25.563 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2023-06-08T04:00:25.563 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2023-06-08T04:00:25.563 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2023-06-08T04:00:25.563 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2023-06-08T04:00:25.563 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /dev 2023-06-08T04:00:25.563 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:00:25.961 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 103/158 2023-06-08T04:00:27.699 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 103/158 2023-06-08T04:00:27.925 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 104/158 2023-06-08T04:00:28.194 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 104/158 2023-06-08T04:00:28.414 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 105/158 2023-06-08T04:00:28.937 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 105/158 2023-06-08T04:00:29.136 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 106/158 2023-06-08T04:00:29.185 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 106/158 2023-06-08T04:00:29.378 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/158 2023-06-08T04:00:29.607 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/158 2023-06-08T04:00:29.769 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-08T04:00:29.865 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-08T04:00:30.180 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : jq-1.6-7.el8.x86_64 110/158 2023-06-08T04:00:30.419 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.1-7.el8.noarch 111/158 2023-06-08T04:00:31.027 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 112/158 2023-06-08T04:00:31.186 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 112/158 2023-06-08T04:00:31.302 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 113/158 2023-06-08T04:00:31.498 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 114/158 2023-06-08T04:00:31.727 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 115/158 2023-06-08T04:00:31.986 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 115/158 2023-06-08T04:00:32.190 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 116/158 2023-06-08T04:00:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 116/158 2023-06-08T04:00:33.526 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 117/158 2023-06-08T04:00:33.653 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 117/158 2023-06-08T04:00:34.057 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 118/158 2023-06-08T04:00:34.258 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 119/158 2023-06-08T04:00:34.322 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 119/158 2023-06-08T04:00:34.509 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 120/158 2023-06-08T04:00:34.537 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 120/158 2023-06-08T04:00:34.735 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 121/158 2023-06-08T04:00:34.889 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/158 2023-06-08T04:00:39.197 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/158 2023-06-08T04:00:40.692 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 123/158 2023-06-08T04:00:40.923 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 124/158 2023-06-08T04:00:40.985 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 124/158 2023-06-08T04:00:41.176 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 125/158 2023-06-08T04:00:41.246 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4313.ga0263 125/158 2023-06-08T04:00:41.492 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 126/158 2023-06-08T04:00:41.901 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 126/158 2023-06-08T04:00:42.151 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 127/158 2023-06-08T04:00:42.435 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 127/158 2023-06-08T04:00:42.764 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/158 2023-06-08T04:00:43.995 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 129/158 2023-06-08T04:00:44.280 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/158 2023-06-08T04:00:44.474 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/158 2023-06-08T04:00:44.730 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/158 2023-06-08T04:00:44.897 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-5.0.0-11.el8.x86_64 133/158 2023-06-08T04:00:45.109 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 134/158 2023-06-08T04:00:46.301 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-08T04:00:46.567 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-08T04:00:46.602 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-08T04:00:46.801 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 136/158 2023-06-08T04:00:47.026 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 137/158 2023-06-08T04:00:47.394 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 138/158 2023-06-08T04:00:47.660 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 139/158 2023-06-08T04:00:47.824 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-6.el 140/158 2023-06-08T04:00:47.852 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-6.el 140/158 2023-06-08T04:00:48.043 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 141/158 2023-06-08T04:00:48.282 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/158 2023-06-08T04:00:48.393 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/158 2023-06-08T04:00:48.624 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/158 2023-06-08T04:00:48.650 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/158 2023-06-08T04:00:48.834 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 144/158 2023-06-08T04:00:49.025 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 145/158 2023-06-08T04:00:49.026 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-08T04:00:49.304 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-08T04:00:49.304 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-08T04:00:49.568 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-08T04:00:49.583 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-08T04:00:49.713 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-08T04:00:49.713 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-08T04:00:49.981 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-08T04:00:50.150 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 150/158 2023-06-08T04:00:50.325 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 151/158 2023-06-08T04:00:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 152/158 2023-06-08T04:00:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-08T04:00:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-08T04:00:50.803 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 154/158 2023-06-08T04:00:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 154/158 2023-06-08T04:00:51.018 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-08T04:00:51.243 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-08T04:00:51.243 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-08T04:00:51.460 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-08T04:00:51.460 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-08T04:00:51.685 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-08T04:00:51.874 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-08T04:00:52.072 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-08T04:00:52.073 INFO:teuthology.orchestra.run.smithi169.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-06-08T04:00:52.073 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:00:52.798 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 1/158 2023-06-08T04:00:52.799 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2/158 2023-06-08T04:00:52.799 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 3/158 2023-06-08T04:00:52.799 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 4/158 2023-06-08T04:00:52.799 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 5/158 2023-06-08T04:00:52.799 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 6/158 2023-06-08T04:00:52.799 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 7/158 2023-06-08T04:00:52.799 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 8/158 2023-06-08T04:00:52.801 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 9/158 2023-06-08T04:00:52.801 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 10/158 2023-06-08T04:00:52.801 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 11/158 2023-06-08T04:00:52.801 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 12/158 2023-06-08T04:00:52.801 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 13/158 2023-06-08T04:00:52.802 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 14/158 2023-06-08T04:00:52.802 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 15/158 2023-06-08T04:00:52.802 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 16/158 2023-06-08T04:00:52.802 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 17/158 2023-06-08T04:00:52.802 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/158 2023-06-08T04:00:52.802 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 19/158 2023-06-08T04:00:52.802 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 20/158 2023-06-08T04:00:52.802 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 21/158 2023-06-08T04:00:52.803 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 22/158 2023-06-08T04:00:52.803 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 23/158 2023-06-08T04:00:52.803 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 24/158 2023-06-08T04:00:52.803 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 25/158 2023-06-08T04:00:52.811 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 26/158 2023-06-08T04:00:52.811 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 27/158 2023-06-08T04:00:52.811 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 28/158 2023-06-08T04:00:52.812 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 29/158 2023-06-08T04:00:52.812 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 30/158 2023-06-08T04:00:52.812 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 31/158 2023-06-08T04:00:52.812 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 32/158 2023-06-08T04:00:52.812 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 33/158 2023-06-08T04:00:52.812 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 34/158 2023-06-08T04:00:52.812 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 35/158 2023-06-08T04:00:52.813 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 36/158 2023-06-08T04:00:52.813 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 37/158 2023-06-08T04:00:52.813 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 38/158 2023-06-08T04:00:52.813 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/158 2023-06-08T04:00:52.813 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/158 2023-06-08T04:00:52.813 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/158 2023-06-08T04:00:52.813 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : jq-1.6-7.el8.x86_64 42/158 2023-06-08T04:00:52.813 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/158 2023-06-08T04:00:52.814 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/158 2023-06-08T04:00:52.814 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/158 2023-06-08T04:00:52.814 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/158 2023-06-08T04:00:52.814 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/158 2023-06-08T04:00:52.814 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/158 2023-06-08T04:00:52.814 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/158 2023-06-08T04:00:52.814 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/158 2023-06-08T04:00:52.815 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/158 2023-06-08T04:00:52.815 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/158 2023-06-08T04:00:52.815 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/158 2023-06-08T04:00:52.815 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/158 2023-06-08T04:00:52.815 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/158 2023-06-08T04:00:52.815 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/158 2023-06-08T04:00:52.815 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/158 2023-06-08T04:00:52.815 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/158 2023-06-08T04:00:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/158 2023-06-08T04:00:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/158 2023-06-08T04:00:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/158 2023-06-08T04:00:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/158 2023-06-08T04:00:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/158 2023-06-08T04:00:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/158 2023-06-08T04:00:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/158 2023-06-08T04:00:52.816 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/158 2023-06-08T04:00:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/158 2023-06-08T04:00:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/158 2023-06-08T04:00:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/158 2023-06-08T04:00:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/158 2023-06-08T04:00:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/158 2023-06-08T04:00:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/158 2023-06-08T04:00:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/158 2023-06-08T04:00:52.817 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/158 2023-06-08T04:00:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/158 2023-06-08T04:00:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/158 2023-06-08T04:00:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/158 2023-06-08T04:00:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/158 2023-06-08T04:00:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/158 2023-06-08T04:00:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/158 2023-06-08T04:00:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/158 2023-06-08T04:00:52.818 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/158 2023-06-08T04:00:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/158 2023-06-08T04:00:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/158 2023-06-08T04:00:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/158 2023-06-08T04:00:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/158 2023-06-08T04:00:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/158 2023-06-08T04:00:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/158 2023-06-08T04:00:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/158 2023-06-08T04:00:52.819 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 90/158 2023-06-08T04:00:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/158 2023-06-08T04:00:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/158 2023-06-08T04:00:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/158 2023-06-08T04:00:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/158 2023-06-08T04:00:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-5.0.0-11.el8.x86_64 95/158 2023-06-08T04:00:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/158 2023-06-08T04:00:52.820 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/158 2023-06-08T04:00:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/158 2023-06-08T04:00:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/158 2023-06-08T04:00:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/158 2023-06-08T04:00:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/158 2023-06-08T04:00:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/158 2023-06-08T04:00:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/158 2023-06-08T04:00:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/158 2023-06-08T04:00:52.821 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/158 2023-06-08T04:00:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/158 2023-06-08T04:00:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/158 2023-06-08T04:00:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/158 2023-06-08T04:00:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/158 2023-06-08T04:00:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/158 2023-06-08T04:00:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/158 2023-06-08T04:00:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/158 2023-06-08T04:00:52.822 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/158 2023-06-08T04:00:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/158 2023-06-08T04:00:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/158 2023-06-08T04:00:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/158 2023-06-08T04:00:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/158 2023-06-08T04:00:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/158 2023-06-08T04:00:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/158 2023-06-08T04:00:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/158 2023-06-08T04:00:52.823 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/158 2023-06-08T04:00:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/158 2023-06-08T04:00:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/158 2023-06-08T04:00:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/158 2023-06-08T04:00:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/158 2023-06-08T04:00:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/158 2023-06-08T04:00:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/158 2023-06-08T04:00:52.824 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/158 2023-06-08T04:00:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 129/158 2023-06-08T04:00:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/158 2023-06-08T04:00:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 131/158 2023-06-08T04:00:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/158 2023-06-08T04:00:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-6.el 133/158 2023-06-08T04:00:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/158 2023-06-08T04:00:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/158 2023-06-08T04:00:52.825 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/158 2023-06-08T04:00:52.826 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/158 2023-06-08T04:00:52.826 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/158 2023-06-08T04:00:52.826 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/158 2023-06-08T04:00:52.826 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/158 2023-06-08T04:00:52.826 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/158 2023-06-08T04:00:52.826 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/158 2023-06-08T04:00:52.826 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/158 2023-06-08T04:00:52.826 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/158 2023-06-08T04:00:52.827 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/158 2023-06-08T04:00:52.827 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/158 2023-06-08T04:00:52.827 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/158 2023-06-08T04:00:52.827 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/158 2023-06-08T04:00:52.827 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/158 2023-06-08T04:00:52.827 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/158 2023-06-08T04:00:52.827 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/158 2023-06-08T04:00:52.827 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/158 2023-06-08T04:00:52.828 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/158 2023-06-08T04:00:52.828 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/158 2023-06-08T04:00:52.828 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/158 2023-06-08T04:00:52.828 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/158 2023-06-08T04:00:52.828 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-5.0.0-11.el8.x86_64 157/158 2023-06-08T04:00:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 158/158 2023-06-08T04:00:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:00:54.892 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2023-06-08T04:00:54.892 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-initscripts-updown-1:1.40.16-6.el8.noarch 2023-06-08T04:00:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-06-08T04:00:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-06-08T04:00:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-06-08T04:00:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: iproute-6.2.0-2.el8.x86_64 2023-06-08T04:00:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: libblkid-2.32.1-42.el8.x86_64 2023-06-08T04:00:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-06-08T04:00:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: libmount-2.32.1-42.el8.x86_64 2023-06-08T04:00:54.893 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.894 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.894 INFO:teuthology.orchestra.run.smithi169.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-06-08T04:00:54.894 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-2.32.1-42.el8.x86_64 2023-06-08T04:00:54.894 INFO:teuthology.orchestra.run.smithi169.stdout: util-linux-2.32.1-42.el8.x86_64 2023-06-08T04:00:54.894 INFO:teuthology.orchestra.run.smithi169.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-06-08T04:00:54.894 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-5.0.0-11.el8.x86_64 2023-06-08T04:00:54.895 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2023-06-08T04:00:54.895 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.1-7.el8.noarch 2023-06-08T04:00:54.895 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.0.4-10.el8.x86_64 2023-06-08T04:00:54.895 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.896 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.896 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.896 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.896 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T04:00:54.896 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.896 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.896 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.897 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T04:00:54.897 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T04:00:54.897 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T04:00:54.897 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T04:00:54.897 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T04:00:54.897 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.897 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.897 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T04:00:54.898 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.898 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.898 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.898 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T04:00:54.898 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T04:00:54.898 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.898 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-08T04:00:54.898 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-06-08T04:00:54.899 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.1-9.el8.x86_64 2023-06-08T04:00:54.899 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.7-17.el8.x86_64 2023-06-08T04:00:54.899 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-08T04:00:54.899 INFO:teuthology.orchestra.run.smithi169.stdout: jq-1.6-7.el8.x86_64 2023-06-08T04:00:54.899 INFO:teuthology.orchestra.run.smithi169.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-08T04:00:54.899 INFO:teuthology.orchestra.run.smithi169.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-06-08T04:00:54.899 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-08T04:00:54.900 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.900 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.900 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.900 INFO:teuthology.orchestra.run.smithi169.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-06-08T04:00:54.900 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-06-08T04:00:54.900 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-08T04:00:54.901 INFO:teuthology.orchestra.run.smithi169.stdout: libpq-13.5-1.el8.x86_64 2023-06-08T04:00:54.901 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-06-08T04:00:54.901 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-08T04:00:54.901 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.901 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.901 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-08T04:00:54.901 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.901 INFO:teuthology.orchestra.run.smithi169.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-06-08T04:00:54.902 INFO:teuthology.orchestra.run.smithi169.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-08T04:00:54.902 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-08T04:00:54.902 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-08T04:00:54.902 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-06-08T04:00:54.902 INFO:teuthology.orchestra.run.smithi169.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-06-08T04:00:54.902 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-06-08T04:00:54.902 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-08T04:00:54.902 INFO:teuthology.orchestra.run.smithi169.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-08T04:00:54.903 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.15-4.el8.x86_64 2023-06-08T04:00:54.903 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-06-08T04:00:54.903 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-06-08T04:00:54.903 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-06-08T04:00:54.903 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-06-08T04:00:54.903 INFO:teuthology.orchestra.run.smithi169.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-06-08T04:00:54.903 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-08T04:00:54.903 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-08T04:00:54.904 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-08T04:00:54.904 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-08T04:00:54.904 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-08T04:00:54.904 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-08T04:00:54.904 INFO:teuthology.orchestra.run.smithi169.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-08T04:00:54.904 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-08T04:00:54.904 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.905 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.905 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.905 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-08T04:00:54.905 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-06-08T04:00:54.905 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-08T04:00:54.905 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-08T04:00:54.906 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-06-08T04:00:54.906 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-08T04:00:54.906 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-08T04:00:54.906 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-08T04:00:54.907 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-08T04:00:54.907 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-08T04:00:54.907 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-08T04:00:54.907 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-08T04:00:54.907 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-08T04:00:54.907 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-08T04:00:54.908 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.0.6-14.el8.noarch 2023-06-08T04:00:54.908 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-08T04:00:54.908 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-08T04:00:54.908 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-08T04:00:54.908 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-08T04:00:54.908 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-08T04:00:54.908 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-08T04:00:54.909 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-08T04:00:54.909 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-2.6-1.el8.noarch 2023-06-08T04:00:54.909 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-08T04:00:54.909 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-08T04:00:54.909 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-08T04:00:54.909 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-08T04:00:54.909 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-08T04:00:54.909 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-08T04:00:54.910 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.910 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.910 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-08T04:00:54.910 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-08T04:00:54.910 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.910 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-08T04:00:54.910 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-08T04:00:54.910 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-06-08T04:00:54.911 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-08T04:00:54.911 INFO:teuthology.orchestra.run.smithi169.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-08T04:00:54.911 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-08T04:00:54.911 INFO:teuthology.orchestra.run.smithi169.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-08T04:00:54.911 INFO:teuthology.orchestra.run.smithi169.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-08T04:00:54.911 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-08T04:00:54.911 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-08T04:00:54.912 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-08T04:00:54.912 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-08T04:00:54.912 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-08T04:00:54.912 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.912 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.912 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-08T04:00:54.912 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-08T04:00:54.912 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-08T04:00:54.913 INFO:teuthology.orchestra.run.smithi169.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-08T04:00:54.913 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-5.0.0-11.el8.x86_64 2023-06-08T04:00:54.913 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-08T04:00:54.913 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-06-08T04:00:54.913 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:00:54.914 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2023-06-08T04:00:55.205 DEBUG:teuthology.parallel:result is None 2023-06-08T04:00:55.206 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-08T04:00:55.344 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-08T04:00:55.406 INFO:teuthology.orchestra.run.smithi016.stdout:18.0.0-4313.ga02638f8.el8 2023-06-08T04:00:55.407 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313.ga02638f8.el8 2023-06-08T04:00:55.407 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313.ga02638f8 is installed. 2023-06-08T04:00:55.407 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-08T04:00:55.637 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-08T04:00:55.693 INFO:teuthology.orchestra.run.smithi169.stdout:18.0.0-4313.ga02638f8.el8 2023-06-08T04:00:55.694 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313.ga02638f8.el8 2023-06-08T04:00:55.694 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313.ga02638f8 is installed. 2023-06-08T04:00:55.694 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-08T04:00:55.695 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:00:55.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-08T04:00:55.775 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:00:55.775 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-08T04:00:55.850 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-08T04:00:55.850 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:00:55.850 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2023-06-08T04:00:55.923 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-08T04:00:56.032 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:00:56.033 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2023-06-08T04:00:56.110 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-08T04:00:56.180 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-08T04:00:56.180 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:00:56.181 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-08T04:00:56.249 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-08T04:00:56.358 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:00:56.359 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-08T04:00:56.428 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-08T04:00:56.538 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-08T04:00:56.539 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:00:56.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2023-06-08T04:00:56.608 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-08T04:00:56.717 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:00:56.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2023-06-08T04:00:56.786 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-08T04:00:56.896 INFO:teuthology.run_tasks:Running task ceph... 2023-06-08T04:00:56.960 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-08T04:00:56.961 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2023-06-08T04:00:56.966 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2023-06-08T04:00:57.035 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-08T04:00:57.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-08T04:00:57.040 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-08T04:00:57.110 INFO:tasks.ceph:Creating extra log directories... 2023-06-08T04:00:57.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-08T04:00:57.114 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-08T04:00:57.191 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-08T04:00:57.191 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-08T04:00:57.191 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-08T04:00:57.192 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:00:57.192 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-08T04:00:57.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-08T04:00:57.446 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-08T04:00:57.514 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:00:57.515 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-08T04:00:57.561 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-08T04:00:57.779 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-08T04:00:57.856 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-08T04:00:57.856 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-08T04:00:57.857 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7298110', 'branch': 'wip-lxb-fscrypt-20230607-0901', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7298110', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'xiubli-2023-06-08_03:32:08-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-lxb-fscrypt-20230607-0901'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lxb-fscrypt-20230607-0901', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'owner': 'scheduled_xiubli@teuthology', 'priority': 110, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-lxb-fscrypt-20230607-0901', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi016.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRaG+PAPw62/BW/RBOXAvbM4PUsL4i7Rc0Shhz92b1K4E6SMNUxIiorR97V5zrtTA1qeMTYJrCttsRM/n0RX6f1IMG/FVMnk5oEi1qCH/S9LQvf1KshuJFUlJlWOpSJ1zXwGPyVUM7+eiUMFo/DqYMOEVaRuDUJt8F7ip8FyoR6/vsQkHbCuyweQAXyi89e31lNLNfq3/BBbXRwsndwEapeZpbeNsZk4RsStn4vBhaIRf3hPPc5mBWJ0vjph7n7gb+fMi1oLMdB/PsByRdN2PJ/+UYpwu5T92smrI4p+8XxDuvJ0zBHIeF4NwmWuUxgac2Va31Wh4ncgHvIKzAne76YUqcCinP8sq1tusvC8XIIaCZlc0yIx7owdqwjEXAYuNIqWReSNoMtdMgAAG3eA1zIVAqQLUc23HzumkyIgMjP4Lo23idrcbRycqd95ZDtaQtWS8ApZGKIlDhR9zCQjSWyZkoCs/p2yP9aqURymb7Bf+VzBvLMCkiubTCo9uGL28=', 'smithi169.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsunnVApFntDWJB8XW8mAq+MO/vNpp+IAsVun01ZGarX9+HEAGuO3SyIY0QN6Y+aSs02HYv+xeYnsUxGEynJZLUB7Qz0x0nB/XKOPe6f0IMnPM6N+4L70LUDoBL8NMsNjpr7LiRNJtFbkzoM7HAV8AMQswprkP33OmcBGmfru3PAwHBDmd/oKCs5ileVZmjzpCFJ+sujlNwtP6SsCFKgUhlkoQH6b9Vh2lJzv4ElSdZsSWS0IXGef2U8QgHNXAOM5zTsIjHzr/P4RhdhBLQJMuu+7vnBzkxLT3bvMS5JS3HwPTQ8xM9u1TXFVkRPyZyi2MhGxi6D4ZnDp/Oxs+iycYERaDSFB95ZdsZmsHs3Eza14qSTzfnYPJ/Cax2mB1kHLZGnN3BFWj4hEcl99MuPwayW8bbJRw/P7SZob6ROPdul+w0YekNdl6951RUqMCBcihH/bZQVQpbxhkQsg7v3ny7YojfJ2plb3ENbXAq/cJOE/3YZtqNd51Rcrp+r9o5ZU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61', 'timestamp': '2023-06-08_03:32:08', 'tube': 'smithi', 'user': 'xiubli', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-08T04:00:57.857 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-08T04:00:57.862 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-08T04:00:57.908 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2023-06-08T04:00:57.947 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2023-06-08T04:00:58.018 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:00:58.018 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2023-06-08T04:00:58.063 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-08T04:00:58.063 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2023-06-08T04:00:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-08T04:00:58.148 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T04:00:58.148 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 447 Links: 1 2023-06-08T04:00:58.148 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T04:00:58.149 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T04:00:58.149 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-06-08 03:54:32.745229138 +0000 2023-06-08T04:00:58.149 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-06-08 03:51:16.182470421 +0000 2023-06-08T04:00:58.149 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-06-08 03:51:16.182470421 +0000 2023-06-08T04:00:58.149 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2023-06-08 03:51:16.161470784 +0000 2023-06-08T04:00:58.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-08T04:00:58.215 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-06-08T04:00:58.216 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-06-08T04:00:58.216 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000174308 s, 2.9 MB/s 2023-06-08T04:00:58.217 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-08T04:00:58.265 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2023-06-08T04:00:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-08T04:00:58.311 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T04:00:58.311 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 453 Links: 1 2023-06-08T04:00:58.312 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T04:00:58.312 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T04:00:58.312 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-06-08 03:54:32.745229138 +0000 2023-06-08T04:00:58.312 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-06-08 03:51:17.019455949 +0000 2023-06-08T04:00:58.312 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-06-08 03:51:17.019455949 +0000 2023-06-08T04:00:58.312 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2023-06-08 03:51:16.996456347 +0000 2023-06-08T04:00:58.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-08T04:00:58.379 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-06-08T04:00:58.379 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-06-08T04:00:58.379 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000163251 s, 3.1 MB/s 2023-06-08T04:00:58.381 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-08T04:00:58.428 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2023-06-08T04:00:58.473 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-08T04:00:58.474 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T04:00:58.474 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 459 Links: 1 2023-06-08T04:00:58.474 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T04:00:58.474 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T04:00:58.474 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-06-08 03:54:32.745229138 +0000 2023-06-08T04:00:58.474 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-06-08 03:51:17.841441737 +0000 2023-06-08T04:00:58.474 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-06-08 03:51:17.841441737 +0000 2023-06-08T04:00:58.475 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2023-06-08 03:51:17.822442065 +0000 2023-06-08T04:00:58.475 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-08T04:00:58.579 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-06-08T04:00:58.579 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-06-08T04:00:58.579 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000169625 s, 3.0 MB/s 2023-06-08T04:00:58.582 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-08T04:00:58.629 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2023-06-08T04:00:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-08T04:00:58.674 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T04:00:58.674 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 465 Links: 1 2023-06-08T04:00:58.675 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T04:00:58.675 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T04:00:58.675 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-06-08 03:54:32.746229121 +0000 2023-06-08T04:00:58.675 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-06-08 03:51:18.676427299 +0000 2023-06-08T04:00:58.675 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-06-08 03:51:18.676427299 +0000 2023-06-08T04:00:58.675 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2023-06-08 03:51:18.655427663 +0000 2023-06-08T04:00:58.675 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-08T04:00:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-06-08T04:00:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-06-08T04:00:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000173277 s, 3.0 MB/s 2023-06-08T04:00:58.783 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-08T04:00:58.830 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-08T04:00:58.830 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:00:58.831 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2023-06-08T04:00:58.877 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-08T04:00:58.878 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2023-06-08T04:00:58.965 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-08T04:00:58.965 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T04:00:58.966 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-06-08T04:00:58.966 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T04:00:58.966 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T04:00:58.966 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-06-08 04:00:52.274912471 +0000 2023-06-08T04:00:58.966 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-06-08 03:51:10.666247224 +0000 2023-06-08T04:00:58.966 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-06-08 03:51:10.666247224 +0000 2023-06-08T04:00:58.966 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2023-06-08 03:51:10.638247823 +0000 2023-06-08T04:00:58.967 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-08T04:00:59.038 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-06-08T04:00:59.038 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-06-08T04:00:59.038 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000313173 s, 1.6 MB/s 2023-06-08T04:00:59.042 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-08T04:00:59.093 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2023-06-08T04:00:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-08T04:00:59.140 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T04:00:59.140 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-06-08T04:00:59.140 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T04:00:59.140 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T04:00:59.141 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-06-08 04:00:52.274912471 +0000 2023-06-08T04:00:59.141 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-06-08 03:51:11.490229604 +0000 2023-06-08T04:00:59.141 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-06-08 03:51:11.490229604 +0000 2023-06-08T04:00:59.141 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2023-06-08 03:51:11.467230095 +0000 2023-06-08T04:00:59.141 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-08T04:00:59.210 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-06-08T04:00:59.211 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-06-08T04:00:59.211 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000268938 s, 1.9 MB/s 2023-06-08T04:00:59.213 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-08T04:00:59.261 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2023-06-08T04:00:59.309 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-08T04:00:59.309 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T04:00:59.309 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-06-08T04:00:59.309 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T04:00:59.309 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T04:00:59.309 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-06-08 04:00:52.274912471 +0000 2023-06-08T04:00:59.310 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-06-08 03:51:12.311212047 +0000 2023-06-08T04:00:59.310 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-06-08 03:51:12.311212047 +0000 2023-06-08T04:00:59.310 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2023-06-08 03:51:12.288212539 +0000 2023-06-08T04:00:59.310 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-08T04:00:59.377 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-06-08T04:00:59.378 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-06-08T04:00:59.378 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000267777 s, 1.9 MB/s 2023-06-08T04:00:59.380 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-08T04:00:59.427 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2023-06-08T04:00:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-08T04:00:59.474 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-08T04:00:59.474 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-06-08T04:00:59.474 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-08T04:00:59.474 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2023-06-08T04:00:59.474 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2023-06-08 04:00:52.274912471 +0000 2023-06-08T04:00:59.475 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2023-06-08 03:51:13.139194341 +0000 2023-06-08T04:00:59.475 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2023-06-08 03:51:13.139194341 +0000 2023-06-08T04:00:59.475 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2023-06-08 03:51:13.111194939 +0000 2023-06-08T04:00:59.475 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-08T04:00:59.543 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2023-06-08T04:00:59.544 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2023-06-08T04:00:59.544 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000284005 s, 1.8 MB/s 2023-06-08T04:00:59.546 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-08T04:00:59.594 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-08T04:00:59.594 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-08T04:00:59.595 INFO:tasks.ceph:Generating config... 2023-06-08T04:00:59.596 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-08T04:00:59.596 INFO:tasks.ceph:[client] debug client = 20 2023-06-08T04:00:59.596 INFO:tasks.ceph:[client] debug ms = 1 2023-06-08T04:00:59.596 INFO:tasks.ceph:[client] pid file = 2023-06-08T04:00:59.597 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-08T04:00:59.597 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-08T04:00:59.597 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-06-08T04:00:59.597 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-08T04:00:59.597 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-08T04:00:59.598 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-08T04:00:59.598 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-08T04:00:59.598 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-08T04:00:59.598 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-08T04:00:59.598 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-08T04:00:59.599 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-08T04:00:59.599 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-08T04:00:59.599 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-08T04:00:59.599 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-08T04:00:59.599 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-08T04:00:59.600 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-08T04:00:59.600 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-08T04:00:59.600 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-08T04:00:59.600 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-08T04:00:59.600 INFO:tasks.ceph:[osd] bdev async discard = True 2023-06-08T04:00:59.600 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-06-08T04:00:59.601 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-06-08T04:00:59.601 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-08T04:00:59.601 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-08T04:00:59.601 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-06-08T04:00:59.601 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-06-08T04:00:59.602 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-08T04:00:59.602 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-08T04:00:59.602 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-06-08T04:00:59.602 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-08T04:00:59.602 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-08T04:00:59.603 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-08T04:00:59.603 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-08T04:00:59.603 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-08T04:00:59.603 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-08T04:00:59.603 INFO:tasks.ceph:Setting up mon.a... 2023-06-08T04:00:59.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-08T04:00:59.718 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2023-06-08T04:00:59.724 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-08T04:00:59.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-08T04:00:59.894 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.b', '172.21.15.169'), ('mon.c', '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]')] 2023-06-08T04:00:59.894 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-08T04:00:59.895 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:00:59.896 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-08T04:00:59.940 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --add b 172.21.15.169 --addv c '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:00.068 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:00.069 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid e063be5d-be19-46d2-af9e-e986de4a0b1c 2023-06-08T04:01:00.069 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = pacific 2023-06-08T04:01:00.069 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2023-06-08T04:01:00.069 INFO:teuthology.orchestra.run.smithi016.stdout:fsid e063be5d-be19-46d2-af9e-e986de4a0b1c 2023-06-08T04:01:00.069 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2023-06-08T04:01:00.066076+0000 2023-06-08T04:01:00.069 INFO:teuthology.orchestra.run.smithi016.stdout:created 2023-06-08T04:01:00.066076+0000 2023-06-08T04:01:00.070 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 16 (pacific) 2023-06-08T04:01:00.070 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2023-06-08T04:01:00.070 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2023-06-08T04:01:00.070 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2023-06-08T04:01:00.070 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] mon.c 2023-06-08T04:01:00.070 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-08T04:01:00.071 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-08T04:01:00.116 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e063be5d-be19-46d2-af9e-e986de4a0b1c... 2023-06-08T04:01:00.117 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-08T04:01:00.161 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-08T04:01:00.274 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2023-06-08T04:01:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2023-06-08T04:01:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-08T04:01:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2023-06-08T04:01:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2023-06-08T04:01:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2023-06-08T04:01:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2023-06-08T04:01:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2023-06-08T04:01:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2023-06-08T04:01:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2023-06-08T04:01:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-08T04:01:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2023-06-08T04:01:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2023-06-08T04:01:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-08T04:01:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2023-06-08T04:01:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2023-06-08T04:01:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2023-06-08T04:01:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2023-06-08T04:01:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2023-06-08T04:01:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2023-06-08T04:01:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2023-06-08T04:01:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2023-06-08T04:01:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-08T04:01:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-08T04:01:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2023-06-08T04:01:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-08T04:01:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2023-06-08T04:01:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2023-06-08T04:01:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2023-06-08T04:01:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2023-06-08T04:01:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2023-06-08T04:01:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2023-06-08T04:01:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on skipped message = False 2023-06-08T04:01:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = e063be5d-be19-46d2-af9e-e986de4a0b1c 2023-06-08T04:01:00.281 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.281 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2023-06-08T04:01:00.281 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2023-06-08T04:01:00.281 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.281 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2023-06-08T04:01:00.281 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2023-06-08T04:01:00.281 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2023-06-08T04:01:00.281 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.282 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2023-06-08T04:01:00.282 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2023-06-08T04:01:00.282 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.282 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2023-06-08T04:01:00.282 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2023-06-08T04:01:00.282 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2023-06-08T04:01:00.282 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.282 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2023-06-08T04:01:00.283 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2023-06-08T04:01:00.283 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.283 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2023-06-08T04:01:00.283 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.283 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2023-06-08T04:01:00.283 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.283 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2023-06-08T04:01:00.283 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.284 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2023-06-08T04:01:00.284 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2023-06-08T04:01:00.284 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.284 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2023-06-08T04:01:00.284 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2023-06-08T04:01:00.284 INFO:teuthology.orchestra.run.smithi016.stdout: bdev async discard = True 2023-06-08T04:01:00.284 INFO:teuthology.orchestra.run.smithi016.stdout: bdev enable discard = True 2023-06-08T04:01:00.285 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore allocator = bitmap 2023-06-08T04:01:00.285 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2023-06-08T04:01:00.285 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2023-06-08T04:01:00.285 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 1/20 2023-06-08T04:01:00.285 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 1/20 2023-06-08T04:01:00.285 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-06-08T04:01:00.285 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2023-06-08T04:01:00.285 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 4/10 2023-06-08T04:01:00.286 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2023-06-08T04:01:00.286 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2023-06-08T04:01:00.286 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2023-06-08T04:01:00.286 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2023-06-08T04:01:00.286 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2023-06-08T04:01:00.286 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2023-06-08T04:01:00.286 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.286 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2023-06-08T04:01:00.287 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-06-08T04:01:00.287 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2023-06-08T04:01:00.287 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2023-06-08T04:01:00.287 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2023-06-08T04:01:00.287 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2023-06-08T04:01:00.287 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2023-06-08T04:01:00.287 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2023-06-08T04:01:00.287 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.288 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2023-06-08T04:01:00.288 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-06-08T04:01:00.288 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2023-06-08T04:01:00.288 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2023-06-08T04:01:00.288 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2023-06-08T04:01:00.288 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2023-06-08T04:01:00.288 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2023-06-08T04:01:00.288 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2023-06-08T04:01:00.289 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2023-06-08T04:01:00.289 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2023-06-08T04:01:00.289 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2023-06-08T04:01:00.289 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.289 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-08T04:01:00.289 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2023-06-08T04:01:00.289 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2023-06-08T04:01:00.289 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.290 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2023-06-08T04:01:00.290 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-08T04:01:00.290 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-08T04:01:00.290 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.290 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2023-06-08T04:01:00.290 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2023-06-08T04:01:00.290 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.290 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2023-06-08T04:01:00.291 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2023-06-08T04:01:00.291 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:00.291 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2023-06-08T04:01:00.291 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2023-06-08T04:01:00.291 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2023-06-08T04:01:00.291 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2023-06-08T04:01:00.291 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-08T04:01:00.292 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-08T04:01:00.292 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2023-06-08T04:01:00.292 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2023-06-08T04:01:00.292 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-06-08T04:01:00.292 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = "" 2023-06-08T04:01:00.292 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2023-06-08T04:01:00.292 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2023-06-08T04:01:00.292 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2023-06-08T04:01:00.293 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2023-06-08T04:01:00.293 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2023-06-08T04:01:00.293 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2023-06-08T04:01:00.293 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2023-06-08T04:01:00.293 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2023-06-08T04:01:00.293 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2023-06-08T04:01:00.293 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2023-06-08T04:01:00.293 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2023-06-08T04:01:00.294 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds balancer = 20 2023-06-08T04:01:00.294 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-06-08T04:01:00.294 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2023-06-08T04:01:00.294 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2023-06-08T04:01:00.295 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2023-06-08T04:01:00.295 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2023-06-08T04:01:00.295 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2023-06-08T04:01:00.296 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2023-06-08T04:01:00.296 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2023-06-08T04:01:00.296 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2023-06-08T04:01:00.296 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2023-06-08T04:01:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-08T04:01:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2023-06-08T04:01:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2023-06-08T04:01:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2023-06-08T04:01:00.297 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2023-06-08T04:01:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2023-06-08T04:01:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2023-06-08T04:01:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2023-06-08T04:01:00.298 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-08T04:01:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2023-06-08T04:01:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2023-06-08T04:01:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-08T04:01:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2023-06-08T04:01:00.299 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2023-06-08T04:01:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2023-06-08T04:01:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2023-06-08T04:01:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2023-06-08T04:01:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2023-06-08T04:01:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2023-06-08T04:01:00.300 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2023-06-08T04:01:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-08T04:01:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-08T04:01:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2023-06-08T04:01:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-08T04:01:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2023-06-08T04:01:00.301 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2023-06-08T04:01:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2023-06-08T04:01:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2023-06-08T04:01:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2023-06-08T04:01:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.16,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2023-06-08T04:01:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on skipped message = False 2023-06-08T04:01:00.302 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = e063be5d-be19-46d2-af9e-e986de4a0b1c 2023-06-08T04:01:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.303 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2023-06-08T04:01:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2023-06-08T04:01:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2023-06-08T04:01:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2023-06-08T04:01:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2023-06-08T04:01:00.303 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2023-06-08T04:01:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2023-06-08T04:01:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2023-06-08T04:01:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2023-06-08T04:01:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2023-06-08T04:01:00.304 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2023-06-08T04:01:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2023-06-08T04:01:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2023-06-08T04:01:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2023-06-08T04:01:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.305 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2023-06-08T04:01:00.306 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.306 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2023-06-08T04:01:00.306 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2023-06-08T04:01:00.306 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.306 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2023-06-08T04:01:00.306 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2023-06-08T04:01:00.306 INFO:teuthology.orchestra.run.smithi169.stdout: bdev async discard = True 2023-06-08T04:01:00.306 INFO:teuthology.orchestra.run.smithi169.stdout: bdev enable discard = True 2023-06-08T04:01:00.307 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore allocator = bitmap 2023-06-08T04:01:00.307 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2023-06-08T04:01:00.307 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2023-06-08T04:01:00.307 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 1/20 2023-06-08T04:01:00.307 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 1/20 2023-06-08T04:01:00.307 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-06-08T04:01:00.307 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2023-06-08T04:01:00.308 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 4/10 2023-06-08T04:01:00.308 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2023-06-08T04:01:00.308 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2023-06-08T04:01:00.308 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2023-06-08T04:01:00.308 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2023-06-08T04:01:00.308 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2023-06-08T04:01:00.308 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2023-06-08T04:01:00.309 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.309 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2023-06-08T04:01:00.309 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-06-08T04:01:00.309 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2023-06-08T04:01:00.309 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2023-06-08T04:01:00.309 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2023-06-08T04:01:00.309 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2023-06-08T04:01:00.309 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2023-06-08T04:01:00.310 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2023-06-08T04:01:00.310 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.310 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2023-06-08T04:01:00.310 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-06-08T04:01:00.310 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2023-06-08T04:01:00.310 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2023-06-08T04:01:00.310 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2023-06-08T04:01:00.311 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2023-06-08T04:01:00.311 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2023-06-08T04:01:00.311 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2023-06-08T04:01:00.311 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2023-06-08T04:01:00.311 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2023-06-08T04:01:00.311 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2023-06-08T04:01:00.311 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.311 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-08T04:01:00.312 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2023-06-08T04:01:00.312 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2023-06-08T04:01:00.312 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.312 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2023-06-08T04:01:00.312 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-08T04:01:00.312 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-08T04:01:00.312 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.312 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2023-06-08T04:01:00.313 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2023-06-08T04:01:00.313 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.313 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2023-06-08T04:01:00.313 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2023-06-08T04:01:00.313 INFO:teuthology.orchestra.run.smithi169.stdout: 2023-06-08T04:01:00.313 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2023-06-08T04:01:00.313 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2023-06-08T04:01:00.314 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2023-06-08T04:01:00.314 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2023-06-08T04:01:00.314 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-08T04:01:00.314 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-08T04:01:00.314 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2023-06-08T04:01:00.314 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2023-06-08T04:01:00.314 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-06-08T04:01:00.314 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = "" 2023-06-08T04:01:00.315 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2023-06-08T04:01:00.315 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2023-06-08T04:01:00.315 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2023-06-08T04:01:00.315 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2023-06-08T04:01:00.315 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2023-06-08T04:01:00.315 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2023-06-08T04:01:00.315 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2023-06-08T04:01:00.315 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2023-06-08T04:01:00.316 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2023-06-08T04:01:00.316 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2023-06-08T04:01:00.316 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2023-06-08T04:01:00.316 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2023-06-08T04:01:00.316 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2023-06-08T04:01:00.316 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2023-06-08T04:01:00.316 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2023-06-08T04:01:00.316 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2023-06-08T04:01:00.317 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2023-06-08T04:01:00.317 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2023-06-08T04:01:00.317 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2023-06-08T04:01:00.317 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2023-06-08T04:01:00.318 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-08T04:01:00.319 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-08T04:01:00.431 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-08T04:01:00.432 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:00.432 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-08T04:01:00.477 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:00.477 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-08T04:01:00.560 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2023-06-08T04:01:00.561 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:00.561 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-08T04:01:00.561 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-08T04:01:00.694 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:00.694 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:00.779 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2023-06-08T04:01:00.779 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:00.780 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-08T04:01:00.780 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-08T04:01:00.879 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:00.879 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:00.965 INFO:tasks.ceph:Setting up mon nodes... 2023-06-08T04:01:00.965 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-08T04:01:00.966 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-08T04:01:01.089 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-08T04:01:01.095 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-08T04:01:01.232 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-08T04:01:01.238 INFO:tasks.ceph:Setting up mds nodes... 2023-06-08T04:01:01.239 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-08T04:01:01.363 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-08T04:01:01.368 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-08T04:01:01.437 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-08T04:01:01.560 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-08T04:01:01.565 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-08T04:01:01.634 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-08T04:01:01.758 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-08T04:01:01.763 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-08T04:01:01.834 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-08T04:01:01.967 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-08T04:01:01.972 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-08T04:01:02.040 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-08T04:01:02.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-08T04:01:02.138 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-08T04:01:02.168 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-08T04:01:02.265 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-08T04:01:02.295 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-08T04:01:02.391 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-08T04:01:02.421 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-08T04:01:02.517 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-08T04:01:02.547 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-08T04:01:02.547 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-08T04:01:02.547 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-08T04:01:02.616 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-08T04:01:02.617 INFO:tasks.ceph:role: osd.0 2023-06-08T04:01:02.617 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2023-06-08T04:01:02.617 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-08T04:01:02.685 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T04:01:02.685 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T04:01:02.686 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T04:01:02.686 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T04:01:02.686 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T04:01:02.686 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-06-08T04:01:02.686 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T04:01:02.686 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T04:01:02.686 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T04:01:02.686 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T04:01:02.710 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-06-08T04:01:02.713 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-06-08T04:01:02.713 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-08T04:01:02.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-08T04:01:02.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-08T04:01:02.964 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-08T04:01:02.965 INFO:tasks.ceph:role: osd.1 2023-06-08T04:01:02.965 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2023-06-08T04:01:02.965 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-08T04:01:03.034 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T04:01:03.034 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T04:01:03.034 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T04:01:03.034 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T04:01:03.034 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T04:01:03.034 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-06-08T04:01:03.035 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T04:01:03.035 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T04:01:03.035 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T04:01:03.035 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T04:01:03.060 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-06-08T04:01:03.063 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-06-08T04:01:03.064 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-08T04:01:03.170 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-08T04:01:03.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-08T04:01:03.314 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-08T04:01:03.314 INFO:tasks.ceph:role: osd.2 2023-06-08T04:01:03.315 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2023-06-08T04:01:03.315 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-08T04:01:03.383 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T04:01:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T04:01:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T04:01:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T04:01:03.384 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T04:01:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-06-08T04:01:03.384 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T04:01:03.384 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T04:01:03.385 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T04:01:03.385 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T04:01:03.410 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-06-08T04:01:03.413 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-06-08T04:01:03.413 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-08T04:01:03.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-08T04:01:03.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-08T04:01:03.660 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-08T04:01:03.660 INFO:tasks.ceph:role: osd.3 2023-06-08T04:01:03.660 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2023-06-08T04:01:03.661 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-08T04:01:03.729 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T04:01:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T04:01:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T04:01:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T04:01:03.729 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T04:01:03.729 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-06-08T04:01:03.729 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T04:01:03.730 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T04:01:03.730 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T04:01:03.730 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T04:01:03.754 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-06-08T04:01:03.757 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-06-08T04:01:03.758 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-08T04:01:03.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-08T04:01:03.938 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:04.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:04.071+0000 7f797a99d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-08T04:01:04.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:04.072+0000 7f797a99d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-08T04:01:04.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:04.072+0000 7f797a99d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-08T04:01:04.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:04.072+0000 7f797a99d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-08T04:01:04.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:04.072+0000 7f797a99d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-08T04:01:04.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:04.074+0000 7f797a99d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-08T04:01:06.959 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-08T04:01:07.031 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:07.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:07.137+0000 7f44a9fa5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-08T04:01:07.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:07.137+0000 7f44a9fa5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-08T04:01:07.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:07.137+0000 7f44a9fa5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-08T04:01:07.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:07.138+0000 7f44a9fa5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-08T04:01:07.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:07.138+0000 7f44a9fa5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-08T04:01:07.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:07.139+0000 7f44a9fa5640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-08T04:01:10.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-08T04:01:10.091 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:10.196+0000 7f10c00e4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-08T04:01:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:10.196+0000 7f10c00e4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-08T04:01:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:10.196+0000 7f10c00e4640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-08T04:01:10.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:10.196+0000 7f10c00e4640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-08T04:01:10.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:10.196+0000 7f10c00e4640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-08T04:01:10.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:10.198+0000 7f10c00e4640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-08T04:01:13.086 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-08T04:01:13.159 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:13.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:13.263+0000 7f9146380640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-08T04:01:13.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:13.263+0000 7f9146380640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-08T04:01:13.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:13.263+0000 7f9146380640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-08T04:01:13.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:13.263+0000 7f9146380640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-08T04:01:13.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:13.263+0000 7f9146380640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-08T04:01:13.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:13.265+0000 7f9146380640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-08T04:01:16.148 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-08T04:01:16.220 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-08T04:01:16.296 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-08T04:01:16.296 INFO:tasks.ceph:role: osd.4 2023-06-08T04:01:16.296 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2023-06-08T04:01:16.297 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-08T04:01:16.374 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T04:01:16.374 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T04:01:16.375 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T04:01:16.375 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T04:01:16.375 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T04:01:16.375 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2023-06-08T04:01:16.375 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T04:01:16.375 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T04:01:16.375 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T04:01:16.376 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T04:01:16.798 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2023-06-08T04:01:16.801 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2023-06-08T04:01:16.802 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-08T04:01:17.002 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-08T04:01:17.083 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-08T04:01:17.153 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-08T04:01:17.153 INFO:tasks.ceph:role: osd.5 2023-06-08T04:01:17.154 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2023-06-08T04:01:17.154 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-08T04:01:17.229 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T04:01:17.229 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T04:01:17.230 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T04:01:17.230 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T04:01:17.230 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T04:01:17.230 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2023-06-08T04:01:17.230 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T04:01:17.230 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T04:01:17.230 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T04:01:17.230 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T04:01:17.639 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2023-06-08T04:01:17.642 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2023-06-08T04:01:17.643 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-08T04:01:17.779 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-08T04:01:17.854 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-08T04:01:17.923 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-08T04:01:17.923 INFO:tasks.ceph:role: osd.6 2023-06-08T04:01:17.923 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2023-06-08T04:01:17.924 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-08T04:01:18.000 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T04:01:18.000 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T04:01:18.001 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T04:01:18.001 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T04:01:18.001 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T04:01:18.001 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2023-06-08T04:01:18.001 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T04:01:18.001 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T04:01:18.001 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T04:01:18.002 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T04:01:18.451 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2023-06-08T04:01:18.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2023-06-08T04:01:18.455 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-08T04:01:18.650 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-08T04:01:18.728 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-08T04:01:18.797 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-08T04:01:18.797 INFO:tasks.ceph:role: osd.7 2023-06-08T04:01:18.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com 2023-06-08T04:01:18.797 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-08T04:01:18.873 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-08T04:01:18.874 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-08T04:01:18.874 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-08T04:01:18.874 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-08T04:01:18.874 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-08T04:01:18.874 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2023-06-08T04:01:18.874 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-08T04:01:18.875 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-08T04:01:18.875 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-08T04:01:18.875 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-08T04:01:19.321 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2023-06-08T04:01:19.325 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2023-06-08T04:01:19.325 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-08T04:01:19.452 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-08T04:01:19.527 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:19.661 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:19.658+0000 7f398b93f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-08T04:01:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:19.658+0000 7f398b93f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-08T04:01:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:19.658+0000 7f398b93f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-08T04:01:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:19.658+0000 7f398b93f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-08T04:01:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:19.658+0000 7f398b93f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-08T04:01:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:19.660+0000 7f398b93f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-08T04:01:22.550 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-08T04:01:22.620 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:22.724 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:22.721+0000 7fe33cd36640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-08T04:01:22.724 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:22.721+0000 7fe33cd36640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-08T04:01:22.725 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:22.721+0000 7fe33cd36640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-08T04:01:22.725 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:22.721+0000 7fe33cd36640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-08T04:01:22.725 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:22.721+0000 7fe33cd36640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-08T04:01:22.726 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:22.723+0000 7fe33cd36640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-08T04:01:25.608 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-08T04:01:25.677 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:25.780+0000 7fe85c002640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-08T04:01:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:25.781+0000 7fe85c002640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-08T04:01:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:25.781+0000 7fe85c002640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-08T04:01:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:25.781+0000 7fe85c002640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-08T04:01:25.784 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:25.781+0000 7fe85c002640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-08T04:01:25.785 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:25.782+0000 7fe85c002640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-08T04:01:27.858 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:01:27.863 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:01:28.666 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-08T04:01:28.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:28.842 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:28.839+0000 7f1d745d5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-08T04:01:28.843 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:28.840+0000 7f1d745d5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-08T04:01:28.843 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:28.840+0000 7f1d745d5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-08T04:01:28.843 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:28.840+0000 7f1d745d5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-08T04:01:28.844 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:28.840+0000 7f1d745d5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-08T04:01:28.844 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:28.841+0000 7f1d745d5640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-08T04:01:31.723 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-08T04:01:31.793 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-08T04:01:31.793 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:31.794 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-08T04:01:31.869 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:31.870 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-08T04:01:31.940 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:31.941 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-08T04:01:32.049 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:32.049 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-08T04:01:32.158 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:32.158 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-08T04:01:32.265 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:32.266 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-08T04:01:32.373 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:32.373 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-08T04:01:32.481 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:32.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-08T04:01:32.554 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:32.555 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-08T04:01:32.624 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:32.624 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-08T04:01:32.732 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:32.732 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-08T04:01:32.840 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:32.840 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-08T04:01:32.947 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:32.948 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-08T04:01:33.056 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:33.056 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-08T04:01:33.164 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:33.164 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-08T04:01:33.211 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:33.211 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-08T04:01:33.298 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:33.298 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-08T04:01:33.342 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:33.343 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-08T04:01:33.427 INFO:tasks.ceph:Adding keys to all mons... 2023-06-08T04:01:33.427 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-08T04:01:33.431 DEBUG:teuthology.orchestra.run.smithi169:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-08T04:01:33.495 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2023-06-08T04:01:33.495 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB9UoFkucAwBRAA2dmEcdR4fMYm2R1mSLYNOA== 2023-06-08T04:01:33.495 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2023-06-08T04:01:33.495 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB9UoFk35x4FRAADM+9NAHlIWB6yC8xc2MufA== 2023-06-08T04:01:33.496 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2023-06-08T04:01:33.496 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB9UoFkMT5FIRAAmK/HZz71T1PyRVHxIJE0uA== 2023-06-08T04:01:33.496 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2023-06-08T04:01:33.496 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCAUoFk85JUBBAAjT5ZwyE5pVcWq1NsJ4CTBg== 2023-06-08T04:01:33.496 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2023-06-08T04:01:33.496 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCDUoFkLb1CCBAAMsI8UtsSaoHk6Epg7pxVyg== 2023-06-08T04:01:33.496 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2023-06-08T04:01:33.497 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCGUoFk7BHDCxAACkZ3mKgDf8/NXjtQ+C1bOw== 2023-06-08T04:01:33.497 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2023-06-08T04:01:33.497 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCJUoFknGW+DxAAAmly8wC6ktsCfU4On25oXA== 2023-06-08T04:01:33.497 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2023-06-08T04:01:33.497 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB9UoFkhdWxDRAACS83UVzst6A1mML+eax1ZQ== 2023-06-08T04:01:33.497 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2023-06-08T04:01:33.497 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB9UoFka5EMLRAAis+gRoT5X158f9dzcJ2n+Q== 2023-06-08T04:01:33.498 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2023-06-08T04:01:33.498 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB9UoFkcOd9ORAABquSPz25IwncZWTuoHFEXw== 2023-06-08T04:01:33.498 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2023-06-08T04:01:33.498 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCPUoFkDjhCJxAAag2QnOpmumBfwNqWkICQbA== 2023-06-08T04:01:33.498 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2023-06-08T04:01:33.498 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCSUoFkhs4BKxAAY5yxYPQFhhFpv6PD1TgKsQ== 2023-06-08T04:01:33.498 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2023-06-08T04:01:33.498 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCVUoFko6KKLhAA5e2w6DXK2lv9Ro5mZI/K/A== 2023-06-08T04:01:33.499 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2023-06-08T04:01:33.499 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCYUoFkvWoUMhAA2t5ZZbwfreUvDUAD6bmSvQ== 2023-06-08T04:01:33.499 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2023-06-08T04:01:33.499 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB+UoFkoqYXCBAAaLt8J54zlTht4qHSpScWBA== 2023-06-08T04:01:33.499 INFO:teuthology.orchestra.run.smithi016.stdout:[client.2] 2023-06-08T04:01:33.499 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB+UoFkNOanDxAA6H6DKiFvdXfY0ffLCqdG0w== 2023-06-08T04:01:33.499 INFO:teuthology.orchestra.run.smithi016.stdout:[client.1] 2023-06-08T04:01:33.499 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB+UoFkou81FxAA0R9U4YtDkeyOC5svIlMpiA== 2023-06-08T04:01:33.500 INFO:teuthology.orchestra.run.smithi016.stdout:[client.3] 2023-06-08T04:01:33.500 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB+UoFky7SvHhAAL7xdohdCN5+GZnfedDkRrg== 2023-06-08T04:01:33.532 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.y] 2023-06-08T04:01:33.532 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB9UoFkucAwBRAA2dmEcdR4fMYm2R1mSLYNOA== 2023-06-08T04:01:33.532 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2023-06-08T04:01:33.533 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB9UoFk35x4FRAADM+9NAHlIWB6yC8xc2MufA== 2023-06-08T04:01:33.533 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2023-06-08T04:01:33.533 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB9UoFkMT5FIRAAmK/HZz71T1PyRVHxIJE0uA== 2023-06-08T04:01:33.533 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.0] 2023-06-08T04:01:33.533 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCAUoFk85JUBBAAjT5ZwyE5pVcWq1NsJ4CTBg== 2023-06-08T04:01:33.533 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.1] 2023-06-08T04:01:33.533 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCDUoFkLb1CCBAAMsI8UtsSaoHk6Epg7pxVyg== 2023-06-08T04:01:33.534 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.2] 2023-06-08T04:01:33.534 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCGUoFk7BHDCxAACkZ3mKgDf8/NXjtQ+C1bOw== 2023-06-08T04:01:33.534 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.3] 2023-06-08T04:01:33.534 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCJUoFknGW+DxAAAmly8wC6ktsCfU4On25oXA== 2023-06-08T04:01:33.534 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.x] 2023-06-08T04:01:33.534 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB9UoFkhdWxDRAACS83UVzst6A1mML+eax1ZQ== 2023-06-08T04:01:33.534 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2023-06-08T04:01:33.534 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB9UoFka5EMLRAAis+gRoT5X158f9dzcJ2n+Q== 2023-06-08T04:01:33.535 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2023-06-08T04:01:33.535 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB9UoFkcOd9ORAABquSPz25IwncZWTuoHFEXw== 2023-06-08T04:01:33.535 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.4] 2023-06-08T04:01:33.535 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCPUoFkDjhCJxAAag2QnOpmumBfwNqWkICQbA== 2023-06-08T04:01:33.535 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.5] 2023-06-08T04:01:33.535 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCSUoFkhs4BKxAAY5yxYPQFhhFpv6PD1TgKsQ== 2023-06-08T04:01:33.535 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.6] 2023-06-08T04:01:33.536 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCVUoFko6KKLhAA5e2w6DXK2lv9Ro5mZI/K/A== 2023-06-08T04:01:33.536 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.7] 2023-06-08T04:01:33.536 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQCYUoFkvWoUMhAA2t5ZZbwfreUvDUAD6bmSvQ== 2023-06-08T04:01:33.536 INFO:teuthology.orchestra.run.smithi169.stdout:[client.0] 2023-06-08T04:01:33.536 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB+UoFkoqYXCBAAaLt8J54zlTht4qHSpScWBA== 2023-06-08T04:01:33.536 INFO:teuthology.orchestra.run.smithi169.stdout:[client.2] 2023-06-08T04:01:33.536 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB+UoFkNOanDxAA6H6DKiFvdXfY0ffLCqdG0w== 2023-06-08T04:01:33.536 INFO:teuthology.orchestra.run.smithi169.stdout:[client.1] 2023-06-08T04:01:33.537 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB+UoFkou81FxAA0R9U4YtDkeyOC5svIlMpiA== 2023-06-08T04:01:33.537 INFO:teuthology.orchestra.run.smithi169.stdout:[client.3] 2023-06-08T04:01:33.537 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQB+UoFky7SvHhAAL7xdohdCN5+GZnfedDkRrg== 2023-06-08T04:01:33.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-08T04:01:33.544 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-08T04:01:33.685 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T04:01:33.689 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T04:01:33.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T04:01:33.804 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T04:01:33.915 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:33.920 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.028 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.141 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.145 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.255 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.259 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.366 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-08T04:01:34.370 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-08T04:01:34.478 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T04:01:34.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T04:01:34.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T04:01:34.597 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-08T04:01:34.708 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.712 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.824 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.932 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:34.937 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:35.044 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:35.048 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-08T04:01:35.155 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T04:01:35.160 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T04:01:35.271 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T04:01:35.275 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T04:01:35.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T04:01:35.390 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T04:01:35.500 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T04:01:35.504 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-08T04:01:35.617 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-08T04:01:35.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-08T04:01:35.685 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-08T04:01:35.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-08T04:01:35.879 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-08T04:01:35.948 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-08T04:01:36.069 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-08T04:01:36.138 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-08T04:01:36.207 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-08T04:01:36.329 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-08T04:01:36.397 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:36.402 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-08T04:01:36.447 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-08T04:01:36.447 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-08T04:01:36.448 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-08T04:01:36.452 INFO:tasks.ceph.mon.a:Started 2023-06-08T04:01:36.452 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-08T04:01:36.452 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-08T04:01:36.491 INFO:tasks.ceph.mon.b:Started 2023-06-08T04:01:36.491 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-08T04:01:36.492 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-08T04:01:36.495 INFO:tasks.ceph.mon.c:Started 2023-06-08T04:01:36.496 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-08T04:01:36.496 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-08T04:01:36.496 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-08T04:01:36.500 INFO:tasks.ceph.mgr.y:Started 2023-06-08T04:01:36.500 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-08T04:01:36.501 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-08T04:01:36.505 INFO:tasks.ceph.mgr.x:Started 2023-06-08T04:01:36.505 INFO:tasks.ceph:Setting crush tunables to default 2023-06-08T04:01:36.505 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2023-06-08T04:01:36.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.704+0000 7f90415ff700 1 Processor -- start 2023-06-08T04:01:36.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.705+0000 7f90415ff700 1 -- start start 2023-06-08T04:01:36.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.706+0000 7f90415ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f903c0b83f0 0x7f903c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:36.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.706+0000 7f90415ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 0x7f903c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:36.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.706+0000 7f90415ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f903c0b4b50 0x7f903c06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:36.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.706+0000 7f90415ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c0b4fd0 con 0x7f903c0b4b50 2023-06-08T04:01:36.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.706+0000 7f90415ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c0d0800 con 0x7f903c0b83f0 2023-06-08T04:01:36.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.706+0000 7f90415ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0cd1e0 con 0x7f903c0ced40 2023-06-08T04:01:36.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903b7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f903c0b4b50 0x7f903c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:36.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903affd700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f903c0b83f0 0x7f903c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:36.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903b7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f903c0b4b50 0x7f903c06b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45686/0 (socket says 172.21.15.16:45686) 2023-06-08T04:01:36.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903affd700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f903c0b83f0 0x7f903c160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:42800/0 (socket says 172.21.15.16:42800) 2023-06-08T04:01:36.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903b7fe700 1 -- 172.21.15.16:0/2322454897 learned_addr learned my addr 172.21.15.16:0/2322454897 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:36.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903affd700 1 -- 172.21.15.16:0/2322454897 >> v2:172.21.15.169:3300/0 conn(0x7f903c0b83f0 msgr2=0x7f903c160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-08T04:01:36.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903affd700 1 -- 172.21.15.16:0/2322454897 >> v2:172.21.15.169:3300/0 conn(0x7f903c0b83f0 msgr2=0x7f903c160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-08T04:01:36.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903affd700 1 --2- 172.21.15.16:0/2322454897 >> v2:172.21.15.169:3300/0 conn(0x7f903c0b83f0 0x7f903c160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-08T04:01:36.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903b7fe700 1 -- 172.21.15.16:0/2322454897 >> v2:172.21.15.16:3300/0 conn(0x7f903c0b4b50 msgr2=0x7f903c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-08T04:01:36.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903b7fe700 1 -- 172.21.15.16:0/2322454897 >> v2:172.21.15.16:3300/0 conn(0x7f903c0b4b50 msgr2=0x7f903c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-08T04:01:36.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903b7fe700 1 --2- 172.21.15.16:0/2322454897 >> v2:172.21.15.16:3300/0 conn(0x7f903c0b4b50 0x7f903c06b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-08T04:01:36.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903affd700 1 --2- 172.21.15.16:0/2322454897 >> v2:172.21.15.169:3300/0 conn(0x7f903c0b83f0 0x7f903c160a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-08T04:01:36.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903b7fe700 1 --2- 172.21.15.16:0/2322454897 >> v2:172.21.15.16:3300/0 conn(0x7f903c0b4b50 0x7f903c06b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-08T04:01:36.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903a7fc700 1 --2- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 0x7f903c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:36.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903a7fc700 1 -- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 msgr2=0x7f903c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-08T04:01:36.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903a7fc700 1 -- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 msgr2=0x7f903c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-08T04:01:36.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903a7fc700 1 --2- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 0x7f903c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-08T04:01:36.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.707+0000 7f903a7fc700 1 --2- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 0x7f903c0b4610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-08T04:01:36.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.908+0000 7f903affd700 1 --2- 172.21.15.16:0/2322454897 >> v2:172.21.15.169:3300/0 conn(0x7f903c0b83f0 0x7f903c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:36.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.908+0000 7f903a7fc700 1 --2- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 0x7f903c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:36.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.908+0000 7f903b7fe700 1 --2- 172.21.15.16:0/2322454897 >> v2:172.21.15.16:3300/0 conn(0x7f903c0b4b50 0x7f903c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.908+0000 7f903affd700 1 -- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 msgr2=0x7f903c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.908+0000 7f903affd700 1 --2- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 0x7f903c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.908+0000 7f903affd700 1 -- 172.21.15.16:0/2322454897 >> v2:172.21.15.16:3300/0 conn(0x7f903c0b4b50 msgr2=0x7f903c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.908+0000 7f903affd700 1 --2- 172.21.15.16:0/2322454897 >> v2:172.21.15.16:3300/0 conn(0x7f903c0b4b50 0x7f903c06b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.908+0000 7f903affd700 1 -- 172.21.15.16:0/2322454897 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0cd4c0 con 0x7f903c0b83f0 2023-06-08T04:01:36.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.909+0000 7f903affd700 1 --2- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f903c0b83f0 0x7f903c160a60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f903c06ca80 tx=0x7f902c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d26b02db958e40a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:36.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.909+0000 7f9039ffb700 1 -- 172.21.15.16:0/2322454897 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c00c070 con 0x7f903c0b83f0 2023-06-08T04:01:36.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.909+0000 7f9039ffb700 1 -- 172.21.15.16:0/2322454897 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c013610 con 0x7f903c0b83f0 2023-06-08T04:01:36.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.909+0000 7f9039ffb700 1 -- 172.21.15.16:0/2322454897 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c0139a0 con 0x7f903c0b83f0 2023-06-08T04:01:36.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.910+0000 7f90415ff700 1 -- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f903c0b83f0 msgr2=0x7f903c160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:36.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.910+0000 7f90415ff700 1 --2- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f903c0b83f0 0x7f903c160a60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f903c06ca80 tx=0x7f902c009b80 comp rx=0 tx=0).stop 2023-06-08T04:01:36.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.910+0000 7f90415ff700 1 -- 172.21.15.16:0/2322454897 shutdown_connections 2023-06-08T04:01:36.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.910+0000 7f90415ff700 1 --2- 172.21.15.16:0/2322454897 >> v2:172.21.15.16:3300/0 conn(0x7f903c0b4b50 0x7f903c06b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:36.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.910+0000 7f90415ff700 1 --2- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f903c0b83f0 0x7f903c160a60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:36.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.910+0000 7f90415ff700 1 --2- 172.21.15.16:0/2322454897 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 0x7f903c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:36.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.910+0000 7f90415ff700 1 -- 172.21.15.16:0/2322454897 >> 172.21.15.16:0/2322454897 conn(0x7f903c0cf610 msgr2=0x7f903c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:36.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.910+0000 7f90415ff700 1 -- 172.21.15.16:0/2322454897 shutdown_connections 2023-06-08T04:01:36.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.910+0000 7f90415ff700 1 -- 172.21.15.16:0/2322454897 wait complete. 2023-06-08T04:01:36.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.912+0000 7f90415ff700 1 Processor -- start 2023-06-08T04:01:36.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.912+0000 7f90415ff700 1 -- start start 2023-06-08T04:01:36.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.913+0000 7f90415ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f903c0b4b50 0x7f903c0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:36.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.913+0000 7f90415ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c0b83f0 0x7f903c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:36.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.913+0000 7f90415ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 0x7f903c0ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:36.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.913+0000 7f90415ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0cd060 con 0x7f903c0b83f0 2023-06-08T04:01:36.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.913+0000 7f90415ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c1f1e30 con 0x7f903c0b4b50 2023-06-08T04:01:36.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.913+0000 7f90415ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0b2790 con 0x7f903c0ced40 2023-06-08T04:01:36.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.913+0000 7f903a7fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c0b83f0 0x7f903c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:36.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.913+0000 7f903affd700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f903c0b4b50 0x7f903c0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:36.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.913+0000 7f903a7fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c0b83f0 0x7f903c0c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45714/0 (socket says 172.21.15.16:45714) 2023-06-08T04:01:36.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.913+0000 7f903a7fc700 1 -- 172.21.15.16:0/900781695 learned_addr learned my addr 172.21.15.16:0/900781695 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:36.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f903b7fe700 1 --2- 172.21.15.16:0/900781695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 0x7f903c0ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:36.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f903a7fc700 1 -- 172.21.15.16:0/900781695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 msgr2=0x7f903c0ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:36.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f903a7fc700 1 --2- 172.21.15.16:0/900781695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 0x7f903c0ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:36.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f903a7fc700 1 -- 172.21.15.16:0/900781695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f903c0b4b50 msgr2=0x7f903c0b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:36.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f903a7fc700 1 --2- 172.21.15.16:0/900781695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f903c0b4b50 0x7f903c0b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:36.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f903a7fc700 1 -- 172.21.15.16:0/900781695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c009500 con 0x7f903c0b83f0 2023-06-08T04:01:36.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f903a7fc700 1 --2- 172.21.15.16:0/900781695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c0b83f0 0x7f903c0c9d80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9030009730 tx=0x7f9030009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:36.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f90237fe700 1 -- 172.21.15.16:0/900781695 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030014610 con 0x7f903c0b83f0 2023-06-08T04:01:36.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f90237fe700 1 -- 172.21.15.16:0/900781695 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9030014770 con 0x7f903c0b83f0 2023-06-08T04:01:36.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f90415ff700 1 -- 172.21.15.16:0/900781695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c0ccaa0 con 0x7f903c0b83f0 2023-06-08T04:01:36.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f90237fe700 1 -- 172.21.15.16:0/900781695 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030014ae0 con 0x7f903c0b83f0 2023-06-08T04:01:36.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.914+0000 7f90415ff700 1 -- 172.21.15.16:0/900781695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c0b2a30 con 0x7f903c0b83f0 2023-06-08T04:01:36.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.915+0000 7f90237fe700 1 -- 172.21.15.16:0/900781695 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9030014c40 con 0x7f903c0b83f0 2023-06-08T04:01:36.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.915+0000 7f90237fe700 1 -- 172.21.15.16:0/900781695 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f903001dde0 con 0x7f903c0b83f0 2023-06-08T04:01:36.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.916+0000 7f90415ff700 1 -- 172.21.15.16:0/900781695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c0740e0 con 0x7f903c0b83f0 2023-06-08T04:01:36.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.919+0000 7f90237fe700 1 -- 172.21.15.16:0/900781695 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f903003cb00 con 0x7f903c0b83f0 2023-06-08T04:01:37.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:36.997+0000 7f90415ff700 1 -- 172.21.15.16:0/900781695 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f903c160ab0 con 0x7f903c0b83f0 2023-06-08T04:01:37.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:37.001+0000 7f90237fe700 1 -- 172.21.15.16:0/900781695 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f903002b070 con 0x7f903c0b83f0 2023-06-08T04:01:37.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:37.002+0000 7f90415ff700 1 -- 172.21.15.16:0/900781695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c0b83f0 msgr2=0x7f903c0c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:37.002+0000 7f90415ff700 1 --2- 172.21.15.16:0/900781695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c0b83f0 0x7f903c0c9d80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9030009730 tx=0x7f9030009a40 comp rx=0 tx=0).stop 2023-06-08T04:01:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:37.002+0000 7f90415ff700 1 -- 172.21.15.16:0/900781695 shutdown_connections 2023-06-08T04:01:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:37.002+0000 7f90415ff700 1 --2- 172.21.15.16:0/900781695 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f903c0ced40 0x7f903c0ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:37.002+0000 7f90415ff700 1 --2- 172.21.15.16:0/900781695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f903c0b4b50 0x7f903c0b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:37.002+0000 7f90415ff700 1 --2- 172.21.15.16:0/900781695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f903c0b83f0 0x7f903c0c9d80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:37.002+0000 7f90415ff700 1 -- 172.21.15.16:0/900781695 >> 172.21.15.16:0/900781695 conn(0x7f903c0cf610 msgr2=0x7f903c0b7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:37.002+0000 7f90415ff700 1 -- 172.21.15.16:0/900781695 shutdown_connections 2023-06-08T04:01:37.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:37.002+0000 7f90415ff700 1 -- 172.21.15.16:0/900781695 wait complete. 2023-06-08T04:01:37.007 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2023-06-08T04:01:37.014 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:37.010+0000 7f009f30f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-08T04:01:37.023 INFO:tasks.ceph:check_enable_crimson: False 2023-06-08T04:01:37.023 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-08T04:01:37.023 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:37.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-08T04:01:37.091 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:37.092 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-08T04:01:37.199 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:37.200 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-08T04:01:37.224 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:37.220+0000 7f009f30f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-08T04:01:37.309 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:01:37.310 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-08T04:01:37.418 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:37.414+0000 7fce0e2e3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-08T04:01:37.422 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:37.422 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-08T04:01:37.491 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:37.492 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-08T04:01:37.600 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:37.600 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-08T04:01:37.627 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:37.623+0000 7f009f30f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-08T04:01:37.641 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:37.637+0000 7fce0e2e3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-08T04:01:37.696 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:01:37.697 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-08T04:01:37.806 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 0378ae44-ec40-4e27-a6c3-58647f58db99 0 2023-06-08T04:01:38.039 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.035+0000 7fd4145ff700 1 Processor -- start 2023-06-08T04:01:38.040 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.035+0000 7fd4145ff700 1 -- start start 2023-06-08T04:01:38.041 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.037+0000 7fd4145ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd40c0b4d20 0x7fd40c167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.041 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.037+0000 7fd4145ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40c0d0800 con 0x7fd40c160a60 2023-06-08T04:01:38.041 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.037+0000 7fd4145ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40c0cd1e0 con 0x7fd40c0b83f0 2023-06-08T04:01:38.041 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.037+0000 7fd4145ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c160ed0 con 0x7fd40c0b4d20 2023-06-08T04:01:38.041 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.037+0000 7fd412b9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd40c0b4d20 0x7fd40c167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.042 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.037+0000 7fd412b9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd40c0b4d20 0x7fd40c167260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51384/0 (socket says 172.21.15.169:51384) 2023-06-08T04:01:38.042 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.037+0000 7fd412b9c700 1 -- 172.21.15.169:0/909371783 learned_addr learned my addr 172.21.15.169:0/909371783 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:38.043 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.037+0000 7fd412b9c700 1 -- 172.21.15.169:0/909371783 >> v1:172.21.15.169:6789/0 conn(0x7fd40c0b83f0 legacy=0x7fd40c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.043 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.037+0000 7fd412b9c700 1 -- 172.21.15.169:0/909371783 >> v1:172.21.15.16:6789/0 conn(0x7fd40c160a60 legacy=0x7fd40c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:38.043 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.037+0000 7fd412b9c700 1 -- 172.21.15.169:0/909371783 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c0cd4c0 con 0x7fd40c0b4d20 2023-06-08T04:01:38.043 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.038+0000 7fd412b9c700 1 --2- 172.21.15.169:0/909371783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd40c0b4d20 0x7fd40c167260 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd4040098f0 tx=0x7fd404009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6ab518f98455e41 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:38.043 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.038+0000 7fd411399700 1 -- 172.21.15.169:0/909371783 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404004230 con 0x7fd40c0b4d20 2023-06-08T04:01:38.044 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.038+0000 7fd411399700 1 -- 172.21.15.169:0/909371783 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd404004390 con 0x7fd40c0b4d20 2023-06-08T04:01:38.044 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.038+0000 7fd411399700 1 -- 172.21.15.169:0/909371783 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4040036a0 con 0x7fd40c0b4d20 2023-06-08T04:01:38.044 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.038+0000 7fd4145ff700 1 -- 172.21.15.169:0/909371783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd40c0b4d20 msgr2=0x7fd40c167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.044 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.038+0000 7fd4145ff700 1 --2- 172.21.15.169:0/909371783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd40c0b4d20 0x7fd40c167260 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd4040098f0 tx=0x7fd404009c00 comp rx=0 tx=0).stop 2023-06-08T04:01:38.044 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.038+0000 7fd4145ff700 1 -- 172.21.15.169:0/909371783 shutdown_connections 2023-06-08T04:01:38.044 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.038+0000 7fd4145ff700 1 --2- 172.21.15.169:0/909371783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd40c0b4d20 0x7fd40c167260 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.044 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.039+0000 7fd4145ff700 1 -- 172.21.15.169:0/909371783 >> 172.21.15.169:0/909371783 conn(0x7fd40c0cf610 msgr2=0x7fd40c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:38.045 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.039+0000 7fd4145ff700 1 -- 172.21.15.169:0/909371783 shutdown_connections 2023-06-08T04:01:38.045 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.039+0000 7fd4145ff700 1 -- 172.21.15.169:0/909371783 wait complete. 2023-06-08T04:01:38.045 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.040+0000 7fd4145ff700 1 Processor -- start 2023-06-08T04:01:38.045 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.041+0000 7fd4145ff700 1 -- start start 2023-06-08T04:01:38.046 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.041+0000 7fd4145ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd40c0b4d20 0x7fd40c158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.047 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.041+0000 7fd4145ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd40c0b83f0 0x7fd40c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.047 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd4145ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40c160a60 0x7fd40c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.047 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd4145ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c0cb330 con 0x7fd40c160a60 2023-06-08T04:01:38.047 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd4145ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c0ca720 con 0x7fd40c0b83f0 2023-06-08T04:01:38.047 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd4145ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c0caa00 con 0x7fd40c0b4d20 2023-06-08T04:01:38.047 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd41239b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd40c0b4d20 0x7fd40c158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.047 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd411b9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd40c0b83f0 0x7fd40c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.048 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd411b9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd40c0b83f0 0x7fd40c0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51392/0 (socket says 172.21.15.169:51392) 2023-06-08T04:01:38.048 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd41239b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd40c0b4d20 0x7fd40c158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:40936/0 (socket says 172.21.15.169:40936) 2023-06-08T04:01:38.048 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd411b9a700 1 -- 172.21.15.169:0/3864503316 learned_addr learned my addr 172.21.15.169:0/3864503316 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:38.048 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd412b9c700 1 --2- 172.21.15.169:0/3864503316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40c160a60 0x7fd40c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.048 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd411b9a700 1 -- 172.21.15.169:0/3864503316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd40c0b4d20 msgr2=0x7fd40c158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.048 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd411b9a700 1 --2- 172.21.15.169:0/3864503316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd40c0b4d20 0x7fd40c158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.048 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd411b9a700 1 -- 172.21.15.169:0/3864503316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40c160a60 msgr2=0x7fd40c0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.049 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd411b9a700 1 --2- 172.21.15.169:0/3864503316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40c160a60 0x7fd40c0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.049 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd411b9a700 1 -- 172.21.15.169:0/3864503316 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404009550 con 0x7fd40c0b83f0 2023-06-08T04:01:38.049 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.042+0000 7fd411b9a700 1 --2- 172.21.15.169:0/3864503316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd40c0b83f0 0x7fd40c0cb7c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00b470 tx=0x7fd3fc00b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:38.050 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.043+0000 7fd402ffd700 1 -- 172.21.15.169:0/3864503316 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc011830 con 0x7fd40c0b83f0 2023-06-08T04:01:38.050 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.043+0000 7fd402ffd700 1 -- 172.21.15.169:0/3864503316 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc0119b0 con 0x7fd40c0b83f0 2023-06-08T04:01:38.050 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.043+0000 7fd402ffd700 1 -- 172.21.15.169:0/3864503316 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc011d60 con 0x7fd40c0b83f0 2023-06-08T04:01:38.050 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.043+0000 7fd4145ff700 1 -- 172.21.15.169:0/3864503316 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c0cace0 con 0x7fd40c0b83f0 2023-06-08T04:01:38.050 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.043+0000 7fd4145ff700 1 -- 172.21.15.169:0/3864503316 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c15ea90 con 0x7fd40c0b83f0 2023-06-08T04:01:38.050 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.043+0000 7fd402ffd700 1 -- 172.21.15.169:0/3864503316 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd3fc01a700 con 0x7fd40c0b83f0 2023-06-08T04:01:38.050 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.043+0000 7fd402ffd700 1 -- 172.21.15.169:0/3864503316 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd3fc019610 con 0x7fd40c0b83f0 2023-06-08T04:01:38.051 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.044+0000 7fd4145ff700 1 -- 172.21.15.169:0/3864503316 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c0cb4a0 con 0x7fd40c0b83f0 2023-06-08T04:01:38.051 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.047+0000 7fd402ffd700 1 -- 172.21.15.169:0/3864503316 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd3fc039b00 con 0x7fd40c0b83f0 2023-06-08T04:01:38.054 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:38.050+0000 7fce0e2e3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-08T04:01:38.136 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.132+0000 7fd4145ff700 1 -- 172.21.15.169:0/3864503316 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0378ae44-ec40-4e27-a6c3-58647f58db99", "id": 0} v 0) v1 -- 0x7fd40c0740e0 con 0x7fd40c0b83f0 2023-06-08T04:01:38.140 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.136+0000 7fd402ffd700 1 -- 172.21.15.169:0/3864503316 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0378ae44-ec40-4e27-a6c3-58647f58db99", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd3fc028030 con 0x7fd40c0b83f0 2023-06-08T04:01:38.140 INFO:teuthology.orchestra.run.smithi169.stdout:0 2023-06-08T04:01:38.142 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.137+0000 7fd4145ff700 1 -- 172.21.15.169:0/3864503316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd40c0b83f0 msgr2=0x7fd40c0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.142 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.137+0000 7fd4145ff700 1 --2- 172.21.15.169:0/3864503316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd40c0b83f0 0x7fd40c0cb7c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00b470 tx=0x7fd3fc00b780 comp rx=0 tx=0).stop 2023-06-08T04:01:38.142 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.137+0000 7fd4145ff700 1 -- 172.21.15.169:0/3864503316 shutdown_connections 2023-06-08T04:01:38.142 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.137+0000 7fd4145ff700 1 --2- 172.21.15.169:0/3864503316 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40c160a60 0x7fd40c0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.142 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.137+0000 7fd4145ff700 1 --2- 172.21.15.169:0/3864503316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd40c0b4d20 0x7fd40c158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.143 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.137+0000 7fd4145ff700 1 --2- 172.21.15.169:0/3864503316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd40c0b83f0 0x7fd40c0cb7c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.143 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.137+0000 7fd4145ff700 1 -- 172.21.15.169:0/3864503316 >> 172.21.15.169:0/3864503316 conn(0x7fd40c0cf610 msgr2=0x7fd40c06bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:38.143 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.138+0000 7fd4145ff700 1 -- 172.21.15.169:0/3864503316 shutdown_connections 2023-06-08T04:01:38.143 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.138+0000 7fd4145ff700 1 -- 172.21.15.169:0/3864503316 wait complete. 2023-06-08T04:01:38.159 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new db3f3b63-738f-4ed8-bb23-440e10922610 1 2023-06-08T04:01:38.308 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:38.304+0000 7f009f30f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-08T04:01:38.351 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.347+0000 7f039a5ff700 1 Processor -- start 2023-06-08T04:01:38.351 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.347+0000 7f039a5ff700 1 -- start start 2023-06-08T04:01:38.352 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.348+0000 7f039a5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b83f0 0x7f0394160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.353 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.348+0000 7f039a5ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f03940b4d20 0x7f03940d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.353 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.348+0000 7f039a5ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03940d0800 con 0x7f03940ced40 2023-06-08T04:01:38.353 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.348+0000 7f039a5ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03940cd1e0 con 0x7f03940b4d20 2023-06-08T04:01:38.353 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.348+0000 7f039a5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03940cd4c0 con 0x7f03940b83f0 2023-06-08T04:01:38.353 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.348+0000 7f0393fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b83f0 0x7f0394160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.353 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.348+0000 7f0398b9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f03940b4d20 0x7f03940d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.353 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.348+0000 7f0398b9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f03940b4d20 0x7f03940d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51400/0 (socket says 172.21.15.169:51400) 2023-06-08T04:01:38.354 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.348+0000 7f0398b9c700 1 -- 172.21.15.169:0/1007337875 learned_addr learned my addr 172.21.15.169:0/1007337875 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:38.355 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.349+0000 7f0393fff700 1 -- 172.21.15.169:0/1007337875 >> v2:172.21.15.169:3300/0 conn(0x7f03940b4d20 msgr2=0x7f03940d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:38.355 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.349+0000 7f0393fff700 1 --2- 172.21.15.169:0/1007337875 >> v2:172.21.15.169:3300/0 conn(0x7f03940b4d20 0x7f03940d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.355 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.349+0000 7f0393fff700 1 -- 172.21.15.169:0/1007337875 >> v1:172.21.15.16:6789/0 conn(0x7f03940ced40 legacy=0x7f03940b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.355 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.349+0000 7f0393fff700 1 -- 172.21.15.169:0/1007337875 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940d0aa0 con 0x7f03940b83f0 2023-06-08T04:01:38.355 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.349+0000 7f0392ffd700 1 -- 172.21.15.169:0/1007337875 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985944032 0 0) 0x7f03940d0800 con 0x7f03940ced40 2023-06-08T04:01:38.356 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.349+0000 7f0398b9c700 1 --2- 172.21.15.169:0/1007337875 >> v2:172.21.15.169:3300/0 conn(0x7f03940b4d20 0x7f03940d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:38.356 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.349+0000 7f0393fff700 1 --2- 172.21.15.169:0/1007337875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b83f0 0x7f0394160a60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0384009840 tx=0x7f0384009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69adf6b29189e5b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:38.356 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.349+0000 7f0392ffd700 1 -- 172.21.15.169:0/1007337875 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384011830 con 0x7f03940b83f0 2023-06-08T04:01:38.356 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.349+0000 7f0392ffd700 1 -- 172.21.15.169:0/1007337875 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0384011990 con 0x7f03940b83f0 2023-06-08T04:01:38.356 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.349+0000 7f0392ffd700 1 -- 172.21.15.169:0/1007337875 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384011d20 con 0x7f03940b83f0 2023-06-08T04:01:38.356 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.350+0000 7f039a5ff700 1 -- 172.21.15.169:0/1007337875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b83f0 msgr2=0x7f0394160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.356 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.350+0000 7f039a5ff700 1 --2- 172.21.15.169:0/1007337875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b83f0 0x7f0394160a60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0384009840 tx=0x7f0384009b50 comp rx=0 tx=0).stop 2023-06-08T04:01:38.357 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.350+0000 7f039a5ff700 1 -- 172.21.15.169:0/1007337875 shutdown_connections 2023-06-08T04:01:38.357 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.350+0000 7f039a5ff700 1 --2- 172.21.15.169:0/1007337875 >> v2:172.21.15.169:3300/0 conn(0x7f03940b4d20 0x7f03940d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.357 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.350+0000 7f039a5ff700 1 --2- 172.21.15.169:0/1007337875 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b83f0 0x7f0394160a60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.357 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.350+0000 7f039a5ff700 1 -- 172.21.15.169:0/1007337875 >> 172.21.15.169:0/1007337875 conn(0x7f03940cf610 msgr2=0x7f03940cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:38.357 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.350+0000 7f039a5ff700 1 -- 172.21.15.169:0/1007337875 shutdown_connections 2023-06-08T04:01:38.357 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.350+0000 7f039a5ff700 1 -- 172.21.15.169:0/1007337875 wait complete. 2023-06-08T04:01:38.359 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.352+0000 7f039a5ff700 1 Processor -- start 2023-06-08T04:01:38.359 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.352+0000 7f039a5ff700 1 -- start start 2023-06-08T04:01:38.359 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f039a5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b4d20 0x7f039415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.360 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f039a5ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03940b83f0 0x7f039415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.360 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f039a5ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03940ced40 0x7f03940c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.360 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f039a5ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03940c9350 con 0x7f03940b83f0 2023-06-08T04:01:38.360 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f039a5ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03940c77b0 con 0x7f03940ced40 2023-06-08T04:01:38.360 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f039a5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03940c6ba0 con 0x7f03940b4d20 2023-06-08T04:01:38.360 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f0393fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b4d20 0x7f039415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.360 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f0398b9c700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03940ced40 0x7f03940c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.361 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f03937fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03940b83f0 0x7f039415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.361 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f0398b9c700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03940ced40 0x7f03940c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51406/0 (socket says 172.21.15.169:51406) 2023-06-08T04:01:38.361 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f0398b9c700 1 -- 172.21.15.169:0/2190778204 learned_addr learned my addr 172.21.15.169:0/2190778204 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:38.361 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.353+0000 7f0393fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b4d20 0x7f039415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:40952/0 (socket says 172.21.15.169:40952) 2023-06-08T04:01:38.361 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.354+0000 7f0398b9c700 1 -- 172.21.15.169:0/2190778204 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b4d20 msgr2=0x7f039415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.361 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.354+0000 7f0398b9c700 1 --2- 172.21.15.169:0/2190778204 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b4d20 0x7f039415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.361 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.354+0000 7f0398b9c700 1 -- 172.21.15.169:0/2190778204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03940b83f0 msgr2=0x7f039415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.361 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.354+0000 7f0398b9c700 1 --2- 172.21.15.169:0/2190778204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03940b83f0 0x7f039415a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.362 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.354+0000 7f0398b9c700 1 -- 172.21.15.169:0/2190778204 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c009b30 con 0x7f03940ced40 2023-06-08T04:01:38.362 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.354+0000 7f0393fff700 1 --2- 172.21.15.169:0/2190778204 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b4d20 0x7f039415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:38.362 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.354+0000 7f0398b9c700 1 --2- 172.21.15.169:0/2190778204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03940ced40 0x7f03940c7c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f038c00efc0 tx=0x7f038c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:38.362 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.354+0000 7f0390ff9700 1 -- 172.21.15.169:0/2190778204 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c018070 con 0x7f03940ced40 2023-06-08T04:01:38.362 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.354+0000 7f0390ff9700 1 -- 172.21.15.169:0/2190778204 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c00f040 con 0x7f03940ced40 2023-06-08T04:01:38.362 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.354+0000 7f039a5ff700 1 -- 172.21.15.169:0/2190778204 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03840094a0 con 0x7f03940ced40 2023-06-08T04:01:38.362 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.354+0000 7f0390ff9700 1 -- 172.21.15.169:0/2190778204 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c003c20 con 0x7f03940ced40 2023-06-08T04:01:38.362 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.355+0000 7f039a5ff700 1 -- 172.21.15.169:0/2190778204 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03940c7160 con 0x7f03940ced40 2023-06-08T04:01:38.363 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.355+0000 7f0390ff9700 1 -- 172.21.15.169:0/2190778204 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f038c00cb80 con 0x7f03940ced40 2023-06-08T04:01:38.363 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.355+0000 7f0390ff9700 1 -- 172.21.15.169:0/2190778204 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f038c004130 con 0x7f03940ced40 2023-06-08T04:01:38.363 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.356+0000 7f039a5ff700 1 -- 172.21.15.169:0/2190778204 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03940740e0 con 0x7f03940ced40 2023-06-08T04:01:38.363 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.358+0000 7f0390ff9700 1 -- 172.21.15.169:0/2190778204 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f038c00ce30 con 0x7f03940ced40 2023-06-08T04:01:38.449 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.445+0000 7f039a5ff700 1 -- 172.21.15.169:0/2190778204 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "db3f3b63-738f-4ed8-bb23-440e10922610", "id": 1} v 0) v1 -- 0x7f039415c3e0 con 0x7f03940ced40 2023-06-08T04:01:38.453 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.449+0000 7f0390ff9700 1 -- 172.21.15.169:0/2190778204 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "db3f3b63-738f-4ed8-bb23-440e10922610", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f038c02c0b0 con 0x7f03940ced40 2023-06-08T04:01:38.454 INFO:teuthology.orchestra.run.smithi169.stdout:1 2023-06-08T04:01:38.455 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.451+0000 7f039a5ff700 1 -- 172.21.15.169:0/2190778204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03940ced40 msgr2=0x7f03940c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.455 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.451+0000 7f039a5ff700 1 --2- 172.21.15.169:0/2190778204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03940ced40 0x7f03940c7c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f038c00efc0 tx=0x7f038c00c3a0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.455 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.451+0000 7f039a5ff700 1 -- 172.21.15.169:0/2190778204 shutdown_connections 2023-06-08T04:01:38.455 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.451+0000 7f039a5ff700 1 --2- 172.21.15.169:0/2190778204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03940ced40 0x7f03940c7c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.456 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.451+0000 7f039a5ff700 1 --2- 172.21.15.169:0/2190778204 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03940b4d20 0x7f039415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.456 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.451+0000 7f039a5ff700 1 --2- 172.21.15.169:0/2190778204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03940b83f0 0x7f039415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.456 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.451+0000 7f039a5ff700 1 -- 172.21.15.169:0/2190778204 >> 172.21.15.169:0/2190778204 conn(0x7f03940cf610 msgr2=0x7f03940b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:38.456 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.451+0000 7f039a5ff700 1 -- 172.21.15.169:0/2190778204 shutdown_connections 2023-06-08T04:01:38.456 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.451+0000 7f039a5ff700 1 -- 172.21.15.169:0/2190778204 wait complete. 2023-06-08T04:01:38.472 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 8ae38eac-16e1-43a4-96f8-2aef6d82963b 2 2023-06-08T04:01:38.560 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:38.555+0000 7f009f30f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-08T04:01:38.667 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.663+0000 7ffb4c5ff700 1 Processor -- start 2023-06-08T04:01:38.667 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.663+0000 7ffb4c5ff700 1 -- start start 2023-06-08T04:01:38.668 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.664+0000 7ffb4c5ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffb44156a80 0x7ffb4415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.669 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.664+0000 7ffb4c5ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffb440d3170 0x7ffb440d35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.669 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.664+0000 7ffb4c5ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb440cd270 con 0x7ffb440cf030 2023-06-08T04:01:38.669 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.664+0000 7ffb4c5ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4415da30 con 0x7ffb44156a80 2023-06-08T04:01:38.669 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.664+0000 7ffb4c5ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb440cda80 con 0x7ffb440d3170 2023-06-08T04:01:38.669 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.664+0000 7ffb4ab9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffb440d3170 0x7ffb440d35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.669 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.664+0000 7ffb4ab9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffb440d3170 0x7ffb440d35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51410/0 (socket says 172.21.15.169:51410) 2023-06-08T04:01:38.669 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.664+0000 7ffb4ab9c700 1 -- 172.21.15.169:0/4061397395 learned_addr learned my addr 172.21.15.169:0/4061397395 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:38.670 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.664+0000 7ffb4a39b700 1 --2- 172.21.15.169:0/4061397395 >> v2:172.21.15.16:3300/0 conn(0x7ffb44156a80 0x7ffb4415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.671 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.665+0000 7ffb4ab9c700 1 -- 172.21.15.169:0/4061397395 >> v2:172.21.15.16:3300/0 conn(0x7ffb44156a80 msgr2=0x7ffb4415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:38.671 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.665+0000 7ffb4ab9c700 1 --2- 172.21.15.169:0/4061397395 >> v2:172.21.15.16:3300/0 conn(0x7ffb44156a80 0x7ffb4415d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.671 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.665+0000 7ffb4ab9c700 1 -- 172.21.15.169:0/4061397395 >> v1:172.21.15.16:6789/0 conn(0x7ffb440cf030 legacy=0x7ffb440d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.671 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.665+0000 7ffb4ab9c700 1 -- 172.21.15.169:0/4061397395 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb440cd4c0 con 0x7ffb440d3170 2023-06-08T04:01:38.671 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.665+0000 7ffb4ab9c700 1 --2- 172.21.15.169:0/4061397395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb440d3170 0x7ffb440d35f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffb440b4d30 tx=0x7ffb3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f5d6865dd6dc7e7 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:38.671 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.665+0000 7ffb49399700 1 -- 172.21.15.169:0/4061397395 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c00e070 con 0x7ffb440d3170 2023-06-08T04:01:38.672 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.665+0000 7ffb49399700 1 -- 172.21.15.169:0/4061397395 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c00b910 con 0x7ffb440d3170 2023-06-08T04:01:38.672 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.665+0000 7ffb49399700 1 -- 172.21.15.169:0/4061397395 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c00bcc0 con 0x7ffb440d3170 2023-06-08T04:01:38.672 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.666+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/4061397395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb440d3170 msgr2=0x7ffb440d35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.672 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.666+0000 7ffb4c5ff700 1 --2- 172.21.15.169:0/4061397395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb440d3170 0x7ffb440d35f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffb440b4d30 tx=0x7ffb3c00b330 comp rx=0 tx=0).stop 2023-06-08T04:01:38.672 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.666+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/4061397395 shutdown_connections 2023-06-08T04:01:38.672 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.666+0000 7ffb4c5ff700 1 --2- 172.21.15.169:0/4061397395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb440d3170 0x7ffb440d35f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.673 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.666+0000 7ffb4c5ff700 1 --2- 172.21.15.169:0/4061397395 >> v2:172.21.15.16:3300/0 conn(0x7ffb44156a80 0x7ffb4415d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.673 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.666+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/4061397395 >> 172.21.15.169:0/4061397395 conn(0x7ffb4406b2e0 msgr2=0x7ffb4406b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:38.673 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.666+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/4061397395 shutdown_connections 2023-06-08T04:01:38.673 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.666+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/4061397395 wait complete. 2023-06-08T04:01:38.675 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.667+0000 7ffb4c5ff700 1 Processor -- start 2023-06-08T04:01:38.675 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.668+0000 7ffb4c5ff700 1 -- start start 2023-06-08T04:01:38.675 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.668+0000 7ffb4c5ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb440cf030 0x7ffb4415f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.675 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.668+0000 7ffb4c5ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb440d3170 0x7ffb440cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.675 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.668+0000 7ffb4c5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb44156a80 0x7ffb441550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.676 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.668+0000 7ffb4c5ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb440c9cf0 con 0x7ffb440cf030 2023-06-08T04:01:38.676 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb4c5ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4415fdf0 con 0x7ffb440d3170 2023-06-08T04:01:38.676 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb4c5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb440c9f40 con 0x7ffb44156a80 2023-06-08T04:01:38.676 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb49b9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb440d3170 0x7ffb440cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.676 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb4a39b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb440cf030 0x7ffb4415f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.676 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb4ab9c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb44156a80 0x7ffb441550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.676 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb49b9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb440d3170 0x7ffb440cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51414/0 (socket says 172.21.15.169:51414) 2023-06-08T04:01:38.677 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb49b9a700 1 -- 172.21.15.169:0/1343077127 learned_addr learned my addr 172.21.15.169:0/1343077127 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:38.677 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb49b9a700 1 -- 172.21.15.169:0/1343077127 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb44156a80 msgr2=0x7ffb441550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.677 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb49b9a700 1 --2- 172.21.15.169:0/1343077127 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb44156a80 0x7ffb441550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.677 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb49b9a700 1 -- 172.21.15.169:0/1343077127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb440cf030 msgr2=0x7ffb4415f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.677 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb49b9a700 1 --2- 172.21.15.169:0/1343077127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb440cf030 0x7ffb4415f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.677 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb49b9a700 1 -- 172.21.15.169:0/1343077127 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c009b30 con 0x7ffb440d3170 2023-06-08T04:01:38.677 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.669+0000 7ffb49b9a700 1 --2- 172.21.15.169:0/1343077127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb440d3170 0x7ffb440cc680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400c4d0 tx=0x7ffb3400c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:38.677 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.670+0000 7ffb3affd700 1 -- 172.21.15.169:0/1343077127 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb340052d0 con 0x7ffb440d3170 2023-06-08T04:01:38.678 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.670+0000 7ffb3affd700 1 -- 172.21.15.169:0/1343077127 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb34005430 con 0x7ffb440d3170 2023-06-08T04:01:38.678 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.670+0000 7ffb3affd700 1 -- 172.21.15.169:0/1343077127 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb340038f0 con 0x7ffb440d3170 2023-06-08T04:01:38.678 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.670+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/1343077127 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb440ca220 con 0x7ffb440d3170 2023-06-08T04:01:38.678 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.670+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/1343077127 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb44155620 con 0x7ffb440d3170 2023-06-08T04:01:38.678 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.670+0000 7ffb3affd700 1 -- 172.21.15.169:0/1343077127 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffb34003d50 con 0x7ffb440d3170 2023-06-08T04:01:38.678 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.670+0000 7ffb3affd700 1 -- 172.21.15.169:0/1343077127 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7ffb34011cc0 con 0x7ffb440d3170 2023-06-08T04:01:38.678 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.671+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/1343077127 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb440740e0 con 0x7ffb440d3170 2023-06-08T04:01:38.679 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.673+0000 7ffb3affd700 1 -- 172.21.15.169:0/1343077127 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ffb34017070 con 0x7ffb440d3170 2023-06-08T04:01:38.696 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:38.692+0000 7fce0e2e3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-08T04:01:38.764 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.760+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/1343077127 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8ae38eac-16e1-43a4-96f8-2aef6d82963b", "id": 2} v 0) v1 -- 0x7ffb440b50d0 con 0x7ffb440d3170 2023-06-08T04:01:38.767 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.763+0000 7ffb3affd700 1 -- 172.21.15.169:0/1343077127 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ae38eac-16e1-43a4-96f8-2aef6d82963b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffb34011590 con 0x7ffb440d3170 2023-06-08T04:01:38.768 INFO:teuthology.orchestra.run.smithi169.stdout:2 2023-06-08T04:01:38.769 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.764+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/1343077127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb440d3170 msgr2=0x7ffb440cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.769 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.764+0000 7ffb4c5ff700 1 --2- 172.21.15.169:0/1343077127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb440d3170 0x7ffb440cc680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400c4d0 tx=0x7ffb3400c7e0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.769 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.764+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/1343077127 shutdown_connections 2023-06-08T04:01:38.769 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.764+0000 7ffb4c5ff700 1 --2- 172.21.15.169:0/1343077127 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb44156a80 0x7ffb441550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.769 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.764+0000 7ffb4c5ff700 1 --2- 172.21.15.169:0/1343077127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb440cf030 0x7ffb4415f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.769 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.764+0000 7ffb4c5ff700 1 --2- 172.21.15.169:0/1343077127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb440d3170 0x7ffb440cc680 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.769 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.764+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/1343077127 >> 172.21.15.169:0/1343077127 conn(0x7ffb4406b2e0 msgr2=0x7ffb440b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:38.770 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.765+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/1343077127 shutdown_connections 2023-06-08T04:01:38.770 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.765+0000 7ffb4c5ff700 1 -- 172.21.15.169:0/1343077127 wait complete. 2023-06-08T04:01:38.785 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 7520a9ec-fda8-434d-bbcd-7c1045ed46cb 3 2023-06-08T04:01:38.937 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:38.933+0000 7fce0e2e3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-08T04:01:38.979 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.975+0000 7f40cbfff700 1 Processor -- start 2023-06-08T04:01:38.979 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.975+0000 7f40cbfff700 1 -- start start 2023-06-08T04:01:38.980 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.976+0000 7f40cbfff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f40c4160a60 0x7f40c40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.980 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.976+0000 7f40cbfff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c40b4b50 0x7f40c40d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.980 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.976+0000 7f40cbfff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c40d0800 con 0x7f40c40b83f0 2023-06-08T04:01:38.981 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.976+0000 7f40cbfff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c4160ed0 con 0x7f40c4160a60 2023-06-08T04:01:38.981 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.976+0000 7f40cbfff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40b4fd0 con 0x7f40c40b4b50 2023-06-08T04:01:38.982 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.976+0000 7f40ca59c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c40b4b50 0x7f40c40d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.982 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.976+0000 7f40c959a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f40c4160a60 0x7f40c40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.982 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.976+0000 7f40c959a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f40c4160a60 0x7f40c40b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51428/0 (socket says 172.21.15.169:51428) 2023-06-08T04:01:38.982 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.976+0000 7f40ca59c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c40b4b50 0x7f40c40d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:40974/0 (socket says 172.21.15.169:40974) 2023-06-08T04:01:38.982 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.976+0000 7f40c959a700 1 -- 172.21.15.169:0/1897505 learned_addr learned my addr 172.21.15.169:0/1897505 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:38.982 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.977+0000 7f40c959a700 1 -- 172.21.15.169:0/1897505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c40b4b50 msgr2=0x7f40c40d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:38.983 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.977+0000 7f40c959a700 1 --2- 172.21.15.169:0/1897505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c40b4b50 0x7f40c40d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.983 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.977+0000 7f40c959a700 1 -- 172.21.15.169:0/1897505 >> v1:172.21.15.169:6789/0 conn(0x7f40c40b83f0 legacy=0x7f40c40ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.983 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.977+0000 7f40c959a700 1 -- 172.21.15.169:0/1897505 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c40cd1e0 con 0x7f40c4160a60 2023-06-08T04:01:38.983 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.977+0000 7f40ca59c700 1 --2- 172.21.15.169:0/1897505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c40b4b50 0x7f40c40d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:38.983 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.977+0000 7f40c959a700 1 --2- 172.21.15.169:0/1897505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40c4160a60 0x7f40c40b4610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40b40098f0 tx=0x7f40b4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226a73e2ec130d92 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:38.983 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.977+0000 7f40c8d99700 1 -- 172.21.15.169:0/1897505 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4011830 con 0x7f40c4160a60 2023-06-08T04:01:38.983 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.977+0000 7f40c8d99700 1 -- 172.21.15.169:0/1897505 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b4011990 con 0x7f40c4160a60 2023-06-08T04:01:38.983 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.977+0000 7f40c8d99700 1 -- 172.21.15.169:0/1897505 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4011d20 con 0x7f40c4160a60 2023-06-08T04:01:38.984 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.978+0000 7f40cbfff700 1 -- 172.21.15.169:0/1897505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40c4160a60 msgr2=0x7f40c40b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.984 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.978+0000 7f40cbfff700 1 --2- 172.21.15.169:0/1897505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40c4160a60 0x7f40c40b4610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f40b40098f0 tx=0x7f40b4009c00 comp rx=0 tx=0).stop 2023-06-08T04:01:38.985 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.978+0000 7f40cbfff700 1 -- 172.21.15.169:0/1897505 shutdown_connections 2023-06-08T04:01:38.985 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.978+0000 7f40cbfff700 1 --2- 172.21.15.169:0/1897505 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c40b4b50 0x7f40c40d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.985 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.978+0000 7f40cbfff700 1 --2- 172.21.15.169:0/1897505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40c4160a60 0x7f40c40b4610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.985 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.978+0000 7f40cbfff700 1 -- 172.21.15.169:0/1897505 >> 172.21.15.169:0/1897505 conn(0x7f40c40cf610 msgr2=0x7f40c40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:38.985 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.978+0000 7f40cbfff700 1 -- 172.21.15.169:0/1897505 shutdown_connections 2023-06-08T04:01:38.985 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.978+0000 7f40cbfff700 1 -- 172.21.15.169:0/1897505 wait complete. 2023-06-08T04:01:38.985 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.980+0000 7f40cbfff700 1 Processor -- start 2023-06-08T04:01:38.986 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.980+0000 7f40cbfff700 1 -- start start 2023-06-08T04:01:38.987 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.981+0000 7f40cbfff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40c40b4b50 0x7f40c4154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.987 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.981+0000 7f40cbfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c40b83f0 0x7f40c40b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.987 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.981+0000 7f40cbfff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c4160a60 0x7f40c40b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:38.988 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.981+0000 7f40cbfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c41e86e0 con 0x7f40c40b83f0 2023-06-08T04:01:38.988 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.981+0000 7f40cbfff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c41e6030 con 0x7f40c40b4b50 2023-06-08T04:01:38.988 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.981+0000 7f40cbfff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c41e7ad0 con 0x7f40c4160a60 2023-06-08T04:01:38.988 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.981+0000 7f40c9d9b700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40c40b4b50 0x7f40c4154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.988 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40ca59c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c4160a60 0x7f40c40b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.988 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40c9d9b700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40c40b4b50 0x7f40c4154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51432/0 (socket says 172.21.15.169:51432) 2023-06-08T04:01:38.988 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40c9d9b700 1 -- 172.21.15.169:0/785294063 learned_addr learned my addr 172.21.15.169:0/785294063 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:38.989 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40c959a700 1 --2- 172.21.15.169:0/785294063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c40b83f0 0x7f40c40b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:38.989 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40c9d9b700 1 -- 172.21.15.169:0/785294063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c4160a60 msgr2=0x7f40c40b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.989 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40c9d9b700 1 --2- 172.21.15.169:0/785294063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c4160a60 0x7f40c40b6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.989 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40c9d9b700 1 -- 172.21.15.169:0/785294063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c40b83f0 msgr2=0x7f40c40b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:38.989 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40c9d9b700 1 --2- 172.21.15.169:0/785294063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c40b83f0 0x7f40c40b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:38.989 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40c9d9b700 1 -- 172.21.15.169:0/785294063 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc009a70 con 0x7f40c40b4b50 2023-06-08T04:01:38.989 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40ca59c700 1 --2- 172.21.15.169:0/785294063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c4160a60 0x7f40c40b6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:38.990 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40c9d9b700 1 --2- 172.21.15.169:0/785294063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40c40b4b50 0x7f40c4154240 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f40c000c4e0 tx=0x7f40c000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:38.990 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.982+0000 7f40ba7fc700 1 -- 172.21.15.169:0/785294063 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00052d0 con 0x7f40c40b4b50 2023-06-08T04:01:38.990 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.983+0000 7f40ba7fc700 1 -- 172.21.15.169:0/785294063 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0005430 con 0x7f40c40b4b50 2023-06-08T04:01:38.990 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.983+0000 7f40cbfff700 1 -- 172.21.15.169:0/785294063 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b4009550 con 0x7f40c40b4b50 2023-06-08T04:01:38.990 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.983+0000 7f40ba7fc700 1 -- 172.21.15.169:0/785294063 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00038c0 con 0x7f40c40b4b50 2023-06-08T04:01:38.990 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.983+0000 7f40cbfff700 1 -- 172.21.15.169:0/785294063 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c41e8090 con 0x7f40c40b4b50 2023-06-08T04:01:38.990 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.983+0000 7f40ba7fc700 1 -- 172.21.15.169:0/785294063 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f40c0003d20 con 0x7f40c40b4b50 2023-06-08T04:01:38.990 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.983+0000 7f40ba7fc700 1 -- 172.21.15.169:0/785294063 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f40c0012420 con 0x7f40c40b4b50 2023-06-08T04:01:38.991 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.984+0000 7f40cbfff700 1 -- 172.21.15.169:0/785294063 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c40740e0 con 0x7f40c40b4b50 2023-06-08T04:01:38.991 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:38.987+0000 7f40ba7fc700 1 -- 172.21.15.169:0/785294063 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f40c0021060 con 0x7f40c40b4b50 2023-06-08T04:01:39.034 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:39.030+0000 7f009f30f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-08T04:01:39.078 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.074+0000 7f40cbfff700 1 -- 172.21.15.169:0/785294063 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7520a9ec-fda8-434d-bbcd-7c1045ed46cb", "id": 3} v 0) v1 -- 0x7f40c406a220 con 0x7f40c40b4b50 2023-06-08T04:01:39.082 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.078+0000 7f40ba7fc700 1 -- 172.21.15.169:0/785294063 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7520a9ec-fda8-434d-bbcd-7c1045ed46cb", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f40c0017070 con 0x7f40c40b4b50 2023-06-08T04:01:39.082 INFO:teuthology.orchestra.run.smithi169.stdout:3 2023-06-08T04:01:39.084 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.079+0000 7f40cbfff700 1 -- 172.21.15.169:0/785294063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40c40b4b50 msgr2=0x7f40c4154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.084 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.079+0000 7f40cbfff700 1 --2- 172.21.15.169:0/785294063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40c40b4b50 0x7f40c4154240 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f40c000c4e0 tx=0x7f40c000c7f0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.084 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.079+0000 7f40cbfff700 1 -- 172.21.15.169:0/785294063 shutdown_connections 2023-06-08T04:01:39.084 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.079+0000 7f40cbfff700 1 --2- 172.21.15.169:0/785294063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40c4160a60 0x7f40c40b6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.084 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.079+0000 7f40cbfff700 1 --2- 172.21.15.169:0/785294063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40c40b4b50 0x7f40c4154240 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.084 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.079+0000 7f40cbfff700 1 --2- 172.21.15.169:0/785294063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40c40b83f0 0x7f40c40b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.085 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.079+0000 7f40cbfff700 1 -- 172.21.15.169:0/785294063 >> 172.21.15.169:0/785294063 conn(0x7f40c40cf610 msgr2=0x7f40c40d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:39.085 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.079+0000 7f40cbfff700 1 -- 172.21.15.169:0/785294063 shutdown_connections 2023-06-08T04:01:39.085 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.080+0000 7f40cbfff700 1 -- 172.21.15.169:0/785294063 wait complete. 2023-06-08T04:01:39.100 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new e578cf78-6df5-4e44-aa6c-497af796b6e2 4 2023-06-08T04:01:39.290 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.286+0000 7f81af7ff700 1 Processor -- start 2023-06-08T04:01:39.291 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.287+0000 7f81af7ff700 1 -- start start 2023-06-08T04:01:39.292 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81af7ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f81a80b83f0 0x7f81a8160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.292 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81af7ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f81a80ced40 0x7f81a80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.292 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81af7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a80b4b50 0x7f81a806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.293 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81af7ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80b4fd0 con 0x7f81a80b83f0 2023-06-08T04:01:39.293 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81af7ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80d0800 con 0x7f81a80ced40 2023-06-08T04:01:39.293 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81af7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80cd1e0 con 0x7f81a80b4b50 2023-06-08T04:01:39.293 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81acd9a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f81a80ced40 0x7f81a80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.293 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81add9c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a80b4b50 0x7f81a806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.293 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81acd9a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f81a80ced40 0x7f81a80b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51434/0 (socket says 172.21.15.169:51434) 2023-06-08T04:01:39.293 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81acd9a700 1 -- 172.21.15.169:0/3821268120 learned_addr learned my addr 172.21.15.169:0/3821268120 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:39.294 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81ad59b700 1 --2- 172.21.15.169:0/3821268120 >> v2:172.21.15.16:3300/0 conn(0x7f81a80b83f0 0x7f81a8160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.295 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81acd9a700 1 -- 172.21.15.169:0/3821268120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a80b4b50 msgr2=0x7f81a806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:39.295 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81acd9a700 1 --2- 172.21.15.169:0/3821268120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a80b4b50 0x7f81a806b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.295 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81acd9a700 1 -- 172.21.15.169:0/3821268120 >> v2:172.21.15.16:3300/0 conn(0x7f81a80b83f0 msgr2=0x7f81a8160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:39.295 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.288+0000 7f81acd9a700 1 --2- 172.21.15.169:0/3821268120 >> v2:172.21.15.16:3300/0 conn(0x7f81a80b83f0 0x7f81a8160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.295 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.289+0000 7f81acd9a700 1 -- 172.21.15.169:0/3821268120 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80cd4c0 con 0x7f81a80ced40 2023-06-08T04:01:39.296 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.289+0000 7f81acd9a700 1 --2- 172.21.15.169:0/3821268120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a80ced40 0x7f81a80b4610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f81a806c4e0 tx=0x7f8198009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd07dd904aaa1e6c server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:39.296 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.289+0000 7f819ffff700 1 -- 172.21.15.169:0/3821268120 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198011830 con 0x7f81a80ced40 2023-06-08T04:01:39.296 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.289+0000 7f819ffff700 1 -- 172.21.15.169:0/3821268120 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198011990 con 0x7f81a80ced40 2023-06-08T04:01:39.296 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.289+0000 7f819ffff700 1 -- 172.21.15.169:0/3821268120 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198011d20 con 0x7f81a80ced40 2023-06-08T04:01:39.296 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.290+0000 7f81af7ff700 1 -- 172.21.15.169:0/3821268120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a80ced40 msgr2=0x7f81a80b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.296 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.290+0000 7f81af7ff700 1 --2- 172.21.15.169:0/3821268120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a80ced40 0x7f81a80b4610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f81a806c4e0 tx=0x7f8198009bd0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.296 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.290+0000 7f81af7ff700 1 -- 172.21.15.169:0/3821268120 shutdown_connections 2023-06-08T04:01:39.296 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.290+0000 7f81af7ff700 1 --2- 172.21.15.169:0/3821268120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a80b4b50 0x7f81a806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.297 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.290+0000 7f81af7ff700 1 --2- 172.21.15.169:0/3821268120 >> v2:172.21.15.16:3300/0 conn(0x7f81a80b83f0 0x7f81a8160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.297 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.290+0000 7f81af7ff700 1 --2- 172.21.15.169:0/3821268120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a80ced40 0x7f81a80b4610 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.297 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.290+0000 7f81af7ff700 1 -- 172.21.15.169:0/3821268120 >> 172.21.15.169:0/3821268120 conn(0x7f81a80cf610 msgr2=0x7f81a80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:39.297 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.290+0000 7f81af7ff700 1 -- 172.21.15.169:0/3821268120 shutdown_connections 2023-06-08T04:01:39.297 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.290+0000 7f81af7ff700 1 -- 172.21.15.169:0/3821268120 wait complete. 2023-06-08T04:01:39.299 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.292+0000 7f81af7ff700 1 Processor -- start 2023-06-08T04:01:39.299 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.292+0000 7f81af7ff700 1 -- start start 2023-06-08T04:01:39.299 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81af7ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81a80b4b50 0x7f81a81f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.299 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81af7ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a80b83f0 0x7f81a80cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.299 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81af7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a80ced40 0x7f81a80ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.299 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81af7ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80cacd0 con 0x7f81a80b4b50 2023-06-08T04:01:39.300 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81af7ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a8154980 con 0x7f81a80b83f0 2023-06-08T04:01:39.300 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81af7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80cb990 con 0x7f81a80ced40 2023-06-08T04:01:39.300 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81acd9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a80b83f0 0x7f81a80cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.300 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81add9c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a80ced40 0x7f81a80ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.300 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81acd9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a80b83f0 0x7f81a80cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:51448/0 (socket says 172.21.15.169:51448) 2023-06-08T04:01:39.300 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81acd9a700 1 -- 172.21.15.169:0/4239611367 learned_addr learned my addr 172.21.15.169:0/4239611367 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:39.300 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81ad59b700 1 --2- 172.21.15.169:0/4239611367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81a80b4b50 0x7f81a81f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.300 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81acd9a700 1 -- 172.21.15.169:0/4239611367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a80ced40 msgr2=0x7f81a80ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.301 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81acd9a700 1 --2- 172.21.15.169:0/4239611367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a80ced40 0x7f81a80ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.301 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81acd9a700 1 -- 172.21.15.169:0/4239611367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81a80b4b50 msgr2=0x7f81a81f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.301 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81acd9a700 1 --2- 172.21.15.169:0/4239611367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81a80b4b50 0x7f81a81f1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.301 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81acd9a700 1 -- 172.21.15.169:0/4239611367 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8198009550 con 0x7f81a80b83f0 2023-06-08T04:01:39.301 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81add9c700 1 --2- 172.21.15.169:0/4239611367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a80ced40 0x7f81a80ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:39.301 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.293+0000 7f81ad59b700 1 --2- 172.21.15.169:0/4239611367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81a80b4b50 0x7f81a81f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:39.301 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.294+0000 7f81acd9a700 1 --2- 172.21.15.169:0/4239611367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a80b83f0 0x7f81a80cb2d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8198009c10 tx=0x7f8198004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:39.301 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.294+0000 7f819dffb700 1 -- 172.21.15.169:0/4239611367 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198004450 con 0x7f81a80b83f0 2023-06-08T04:01:39.302 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.294+0000 7f819dffb700 1 -- 172.21.15.169:0/4239611367 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819801e070 con 0x7f81a80b83f0 2023-06-08T04:01:39.302 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.294+0000 7f81af7ff700 1 -- 172.21.15.169:0/4239611367 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a80cbc70 con 0x7f81a80b83f0 2023-06-08T04:01:39.302 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.294+0000 7f819dffb700 1 -- 172.21.15.169:0/4239611367 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980038e0 con 0x7f81a80b83f0 2023-06-08T04:01:39.302 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.294+0000 7f81af7ff700 1 -- 172.21.15.169:0/4239611367 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a80cc230 con 0x7f81a80b83f0 2023-06-08T04:01:39.302 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.294+0000 7f819dffb700 1 -- 172.21.15.169:0/4239611367 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8198003d40 con 0x7f81a80b83f0 2023-06-08T04:01:39.302 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.294+0000 7f819dffb700 1 -- 172.21.15.169:0/4239611367 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f819802d450 con 0x7f81a80b83f0 2023-06-08T04:01:39.303 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.295+0000 7f81af7ff700 1 -- 172.21.15.169:0/4239611367 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a80740e0 con 0x7f81a80b83f0 2023-06-08T04:01:39.303 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.297+0000 7f819dffb700 1 -- 172.21.15.169:0/4239611367 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8198020070 con 0x7f81a80b83f0 2023-06-08T04:01:39.387 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.383+0000 7f81af7ff700 1 -- 172.21.15.169:0/4239611367 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e578cf78-6df5-4e44-aa6c-497af796b6e2", "id": 4} v 0) v1 -- 0x7f81a80b7340 con 0x7f81a80b83f0 2023-06-08T04:01:39.391 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.387+0000 7f819dffb700 1 -- 172.21.15.169:0/4239611367 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e578cf78-6df5-4e44-aa6c-497af796b6e2", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8198015020 con 0x7f81a80b83f0 2023-06-08T04:01:39.392 INFO:teuthology.orchestra.run.smithi169.stdout:4 2023-06-08T04:01:39.393 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.388+0000 7f81af7ff700 1 -- 172.21.15.169:0/4239611367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a80b83f0 msgr2=0x7f81a80cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.393 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.388+0000 7f81af7ff700 1 --2- 172.21.15.169:0/4239611367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a80b83f0 0x7f81a80cb2d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8198009c10 tx=0x7f8198004750 comp rx=0 tx=0).stop 2023-06-08T04:01:39.393 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.389+0000 7f81af7ff700 1 -- 172.21.15.169:0/4239611367 shutdown_connections 2023-06-08T04:01:39.393 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.389+0000 7f81af7ff700 1 --2- 172.21.15.169:0/4239611367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81a80ced40 0x7f81a80ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.393 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.389+0000 7f81af7ff700 1 --2- 172.21.15.169:0/4239611367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81a80b4b50 0x7f81a81f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.393 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.389+0000 7f81af7ff700 1 --2- 172.21.15.169:0/4239611367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81a80b83f0 0x7f81a80cb2d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.394 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.389+0000 7f81af7ff700 1 -- 172.21.15.169:0/4239611367 >> 172.21.15.169:0/4239611367 conn(0x7f81a80cf610 msgr2=0x7f81a80b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:39.394 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.389+0000 7f81af7ff700 1 -- 172.21.15.169:0/4239611367 shutdown_connections 2023-06-08T04:01:39.394 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.389+0000 7f81af7ff700 1 -- 172.21.15.169:0/4239611367 wait complete. 2023-06-08T04:01:39.394 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:39.390+0000 7fce0e2e3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-08T04:01:39.410 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 195828e6-c2a1-43a1-a172-fada96c4cd98 5 2023-06-08T04:01:39.602 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.598+0000 7f373b3ff700 1 Processor -- start 2023-06-08T04:01:39.602 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.598+0000 7f373b3ff700 1 -- start start 2023-06-08T04:01:39.604 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.600+0000 7f373b3ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3734156a80 0x7f373415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.604 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.600+0000 7f373b3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340d3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.604 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.600+0000 7f373b3ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37340cd270 con 0x7f37340cf030 2023-06-08T04:01:39.604 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.600+0000 7f373b3ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373415da30 con 0x7f3734156a80 2023-06-08T04:01:39.604 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.600+0000 7f373b3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37340cda80 con 0x7f37340d3170 2023-06-08T04:01:39.605 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.600+0000 7f373999c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.606 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.600+0000 7f373919b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3734156a80 0x7f373415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.606 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.600+0000 7f373999c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340d3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:41016/0 (socket says 172.21.15.169:41016) 2023-06-08T04:01:39.606 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.600+0000 7f373999c700 1 -- 172.21.15.169:0/2319667512 learned_addr learned my addr 172.21.15.169:0/2319667512 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:39.606 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.600+0000 7f373999c700 1 -- 172.21.15.169:0/2319667512 >> v2:172.21.15.16:3300/0 conn(0x7f3734156a80 msgr2=0x7f373415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:39.606 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.600+0000 7f373999c700 1 --2- 172.21.15.169:0/2319667512 >> v2:172.21.15.16:3300/0 conn(0x7f3734156a80 0x7f373415d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.606 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.601+0000 7f373999c700 1 -- 172.21.15.169:0/2319667512 >> v1:172.21.15.16:6789/0 conn(0x7f37340cf030 legacy=0x7f37340d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.606 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.601+0000 7f373999c700 1 -- 172.21.15.169:0/2319667512 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37340cd4c0 con 0x7f37340d3170 2023-06-08T04:01:39.606 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.601+0000 7f373999c700 1 --2- 172.21.15.169:0/2319667512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340d3610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f372c009e50 tx=0x7f372c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da6815df654b21a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:39.607 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.601+0000 7f372bfff700 1 -- 172.21.15.169:0/2319667512 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c00e070 con 0x7f37340d3170 2023-06-08T04:01:39.607 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.601+0000 7f372bfff700 1 -- 172.21.15.169:0/2319667512 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c00b910 con 0x7f37340d3170 2023-06-08T04:01:39.607 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.601+0000 7f372bfff700 1 -- 172.21.15.169:0/2319667512 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c00bcc0 con 0x7f37340d3170 2023-06-08T04:01:39.608 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.602+0000 7f373b3ff700 1 -- 172.21.15.169:0/2319667512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 msgr2=0x7f37340d3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.608 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.602+0000 7f373b3ff700 1 --2- 172.21.15.169:0/2319667512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340d3610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f372c009e50 tx=0x7f372c00b330 comp rx=0 tx=0).stop 2023-06-08T04:01:39.608 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.602+0000 7f373b3ff700 1 -- 172.21.15.169:0/2319667512 shutdown_connections 2023-06-08T04:01:39.608 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.602+0000 7f373b3ff700 1 --2- 172.21.15.169:0/2319667512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340d3610 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.608 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.602+0000 7f373b3ff700 1 --2- 172.21.15.169:0/2319667512 >> v2:172.21.15.16:3300/0 conn(0x7f3734156a80 0x7f373415d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.608 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.602+0000 7f373b3ff700 1 -- 172.21.15.169:0/2319667512 >> 172.21.15.169:0/2319667512 conn(0x7f373406b2e0 msgr2=0x7f373406b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:39.609 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.602+0000 7f373b3ff700 1 -- 172.21.15.169:0/2319667512 shutdown_connections 2023-06-08T04:01:39.609 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.602+0000 7f373b3ff700 1 -- 172.21.15.169:0/2319667512 wait complete. 2023-06-08T04:01:39.609 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.604+0000 7f373b3ff700 1 Processor -- start 2023-06-08T04:01:39.609 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.604+0000 7f373b3ff700 1 -- start start 2023-06-08T04:01:39.610 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373b3ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37340cf030 0x7f37340cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.611 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373b3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.611 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373b3ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3734156a80 0x7f37341f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.611 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373b3ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37341f2fe0 con 0x7f3734156a80 2023-06-08T04:01:39.611 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373b3ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37340b60e0 con 0x7f37340cf030 2023-06-08T04:01:39.611 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373b3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37340b63c0 con 0x7f37340d3170 2023-06-08T04:01:39.611 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373899a700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.611 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373919b700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37340cf030 0x7f37340cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.612 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373899a700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:41018/0 (socket says 172.21.15.169:41018) 2023-06-08T04:01:39.612 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373899a700 1 -- 172.21.15.169:0/2746417828 learned_addr learned my addr 172.21.15.169:0/2746417828 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:39.612 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373999c700 1 --2- 172.21.15.169:0/2746417828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3734156a80 0x7f37341f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.612 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373899a700 1 -- 172.21.15.169:0/2746417828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37340cf030 msgr2=0x7f37340cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.612 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373899a700 1 --2- 172.21.15.169:0/2746417828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37340cf030 0x7f37340cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.612 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373899a700 1 -- 172.21.15.169:0/2746417828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3734156a80 msgr2=0x7f37341f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.612 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373899a700 1 --2- 172.21.15.169:0/2746417828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3734156a80 0x7f37341f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.613 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373899a700 1 -- 172.21.15.169:0/2746417828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c009b30 con 0x7f37340d3170 2023-06-08T04:01:39.613 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.605+0000 7f373999c700 1 --2- 172.21.15.169:0/2746417828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3734156a80 0x7f37341f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:39.613 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.606+0000 7f373899a700 1 --2- 172.21.15.169:0/2746417828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340b5a50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f372400c4d0 tx=0x7f372400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:39.613 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.606+0000 7f3729ffb700 1 -- 172.21.15.169:0/2746417828 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37240052d0 con 0x7f37340d3170 2023-06-08T04:01:39.613 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.606+0000 7f3729ffb700 1 -- 172.21.15.169:0/2746417828 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3724005430 con 0x7f37340d3170 2023-06-08T04:01:39.613 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.606+0000 7f373b3ff700 1 -- 172.21.15.169:0/2746417828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37340b66a0 con 0x7f37340d3170 2023-06-08T04:01:39.613 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.606+0000 7f3729ffb700 1 -- 172.21.15.169:0/2746417828 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37240038f0 con 0x7f37340d3170 2023-06-08T04:01:39.613 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.606+0000 7f373b3ff700 1 -- 172.21.15.169:0/2746417828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37340b2bb0 con 0x7f37340d3170 2023-06-08T04:01:39.614 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.606+0000 7f3729ffb700 1 -- 172.21.15.169:0/2746417828 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3724003d50 con 0x7f37340d3170 2023-06-08T04:01:39.614 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.606+0000 7f3729ffb700 1 -- 172.21.15.169:0/2746417828 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3724011cc0 con 0x7f37340d3170 2023-06-08T04:01:39.614 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.608+0000 7f373b3ff700 1 -- 172.21.15.169:0/2746417828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37340740e0 con 0x7f37340d3170 2023-06-08T04:01:39.614 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.610+0000 7f3729ffb700 1 -- 172.21.15.169:0/2746417828 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3724017070 con 0x7f37340d3170 2023-06-08T04:01:39.701 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.697+0000 7f373b3ff700 1 -- 172.21.15.169:0/2746417828 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "195828e6-c2a1-43a1-a172-fada96c4cd98", "id": 5} v 0) v1 -- 0x7f37341f3120 con 0x7f37340d3170 2023-06-08T04:01:39.705 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.701+0000 7f3729ffb700 1 -- 172.21.15.169:0/2746417828 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "195828e6-c2a1-43a1-a172-fada96c4cd98", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f37341f3120 con 0x7f37340d3170 2023-06-08T04:01:39.705 INFO:teuthology.orchestra.run.smithi169.stdout:5 2023-06-08T04:01:39.706 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.702+0000 7f373b3ff700 1 -- 172.21.15.169:0/2746417828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 msgr2=0x7f37340b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.706 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.702+0000 7f373b3ff700 1 --2- 172.21.15.169:0/2746417828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340b5a50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f372400c4d0 tx=0x7f372400c7e0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.707 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.702+0000 7f373b3ff700 1 -- 172.21.15.169:0/2746417828 shutdown_connections 2023-06-08T04:01:39.707 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.702+0000 7f373b3ff700 1 --2- 172.21.15.169:0/2746417828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3734156a80 0x7f37341f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.707 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.702+0000 7f373b3ff700 1 --2- 172.21.15.169:0/2746417828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37340cf030 0x7f37340cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.707 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.702+0000 7f373b3ff700 1 --2- 172.21.15.169:0/2746417828 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37340d3170 0x7f37340b5a50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.707 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.702+0000 7f373b3ff700 1 -- 172.21.15.169:0/2746417828 >> 172.21.15.169:0/2746417828 conn(0x7f373406b2e0 msgr2=0x7f37340d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:39.707 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.702+0000 7f373b3ff700 1 -- 172.21.15.169:0/2746417828 shutdown_connections 2023-06-08T04:01:39.707 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.702+0000 7f373b3ff700 1 -- 172.21.15.169:0/2746417828 wait complete. 2023-06-08T04:01:39.731 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 8f6f1127-bb27-4cde-b275-769e074a2a24 6 2023-06-08T04:01:39.888 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:39.884+0000 7f009f30f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-08T04:01:39.923 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.919+0000 7f577e7ff700 1 Processor -- start 2023-06-08T04:01:39.924 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.919+0000 7f577e7ff700 1 -- start start 2023-06-08T04:01:39.925 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f577e7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5778160a60 0x7f57780b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.925 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f577e7ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f57780b4b50 0x7f57780d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.925 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f577e7ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57780d0800 con 0x7f57780b83f0 2023-06-08T04:01:39.925 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f577e7ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5778160ed0 con 0x7f57780b4b50 2023-06-08T04:01:39.926 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f577e7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57780b4fd0 con 0x7f5778160a60 2023-06-08T04:01:39.926 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f576ffff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5778160a60 0x7f57780b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.926 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f576ffff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5778160a60 0x7f57780b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:41020/0 (socket says 172.21.15.169:41020) 2023-06-08T04:01:39.926 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f576ffff700 1 -- 172.21.15.169:0/1867595283 learned_addr learned my addr 172.21.15.169:0/1867595283 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:39.926 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f577cd9c700 1 --2- 172.21.15.169:0/1867595283 >> v2:172.21.15.16:3300/0 conn(0x7f57780b4b50 0x7f57780d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.927 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f576ffff700 1 -- 172.21.15.169:0/1867595283 >> v2:172.21.15.16:3300/0 conn(0x7f57780b4b50 msgr2=0x7f57780d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:39.927 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f576ffff700 1 --2- 172.21.15.169:0/1867595283 >> v2:172.21.15.16:3300/0 conn(0x7f57780b4b50 0x7f57780d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f576ffff700 1 -- 172.21.15.169:0/1867595283 >> v1:172.21.15.16:6789/0 conn(0x7f57780b83f0 legacy=0x7f57780ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.921+0000 7f576ffff700 1 -- 172.21.15.169:0/1867595283 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57780cd1e0 con 0x7f5778160a60 2023-06-08T04:01:39.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.922+0000 7f576ffff700 1 --2- 172.21.15.169:0/1867595283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5778160a60 0x7f57780b4610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57600098f0 tx=0x7f5760009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41c132bdded0ed52 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:39.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.922+0000 7f57777fe700 1 -- 172.21.15.169:0/1867595283 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760011830 con 0x7f5778160a60 2023-06-08T04:01:39.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.922+0000 7f57777fe700 1 -- 172.21.15.169:0/1867595283 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5760011990 con 0x7f5778160a60 2023-06-08T04:01:39.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.922+0000 7f57777fe700 1 -- 172.21.15.169:0/1867595283 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760011d20 con 0x7f5778160a60 2023-06-08T04:01:39.928 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.922+0000 7f577e7ff700 1 -- 172.21.15.169:0/1867595283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5778160a60 msgr2=0x7f57780b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.929 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.922+0000 7f577e7ff700 1 --2- 172.21.15.169:0/1867595283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5778160a60 0x7f57780b4610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f57600098f0 tx=0x7f5760009c00 comp rx=0 tx=0).stop 2023-06-08T04:01:39.929 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.923+0000 7f577e7ff700 1 -- 172.21.15.169:0/1867595283 shutdown_connections 2023-06-08T04:01:39.929 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.923+0000 7f577e7ff700 1 --2- 172.21.15.169:0/1867595283 >> v2:172.21.15.16:3300/0 conn(0x7f57780b4b50 0x7f57780d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.929 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.923+0000 7f577e7ff700 1 --2- 172.21.15.169:0/1867595283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5778160a60 0x7f57780b4610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.929 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.923+0000 7f577e7ff700 1 -- 172.21.15.169:0/1867595283 >> 172.21.15.169:0/1867595283 conn(0x7f57780cf610 msgr2=0x7f57780cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:39.929 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.923+0000 7f577e7ff700 1 -- 172.21.15.169:0/1867595283 shutdown_connections 2023-06-08T04:01:39.929 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.923+0000 7f577e7ff700 1 -- 172.21.15.169:0/1867595283 wait complete. 2023-06-08T04:01:39.931 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.924+0000 7f577e7ff700 1 Processor -- start 2023-06-08T04:01:39.931 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.925+0000 7f577e7ff700 1 -- start start 2023-06-08T04:01:39.931 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.925+0000 7f577e7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57780b4b50 0x7f57781512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.931 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f577e7ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57780b83f0 0x7f57781f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.931 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f577e7ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5778160a60 0x7f57780b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:39.932 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f577e7ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577815cb60 con 0x7f57780b83f0 2023-06-08T04:01:39.932 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f577e7ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57781e7020 con 0x7f5778160a60 2023-06-08T04:01:39.932 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f577e7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577815ce00 con 0x7f57780b4b50 2023-06-08T04:01:39.932 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f5777fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57780b4b50 0x7f57781512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.932 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f5777fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57780b4b50 0x7f57781512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:41034/0 (socket says 172.21.15.169:41034) 2023-06-08T04:01:39.932 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f5777fff700 1 -- 172.21.15.169:0/4262939815 learned_addr learned my addr 172.21.15.169:0/4262939815 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:39.932 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f576ffff700 1 --2- 172.21.15.169:0/4262939815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57780b83f0 0x7f57781f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.933 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f577cd9c700 1 --2- 172.21.15.169:0/4262939815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5778160a60 0x7f57780b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:39.933 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f5777fff700 1 -- 172.21.15.169:0/4262939815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5778160a60 msgr2=0x7f57780b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.933 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f5777fff700 1 --2- 172.21.15.169:0/4262939815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5778160a60 0x7f57780b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.933 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f5777fff700 1 -- 172.21.15.169:0/4262939815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57780b83f0 msgr2=0x7f57781f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:39.933 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f5777fff700 1 --2- 172.21.15.169:0/4262939815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57780b83f0 0x7f57781f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:39.933 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.926+0000 7f5777fff700 1 -- 172.21.15.169:0/4262939815 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5760009550 con 0x7f57780b4b50 2023-06-08T04:01:39.933 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.927+0000 7f5777fff700 1 --2- 172.21.15.169:0/4262939815 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57780b4b50 0x7f57781512a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f576800c4e0 tx=0x7f576800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:39.933 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.927+0000 7f57757fa700 1 -- 172.21.15.169:0/4262939815 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680052d0 con 0x7f57780b4b50 2023-06-08T04:01:39.934 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.927+0000 7f57757fa700 1 -- 172.21.15.169:0/4262939815 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768005430 con 0x7f57780b4b50 2023-06-08T04:01:39.934 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.927+0000 7f57757fa700 1 -- 172.21.15.169:0/4262939815 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680038c0 con 0x7f57780b4b50 2023-06-08T04:01:39.934 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.927+0000 7f577e7ff700 1 -- 172.21.15.169:0/4262939815 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577815d0e0 con 0x7f57780b4b50 2023-06-08T04:01:39.934 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.927+0000 7f577e7ff700 1 -- 172.21.15.169:0/4262939815 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57781e7300 con 0x7f57780b4b50 2023-06-08T04:01:39.935 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.927+0000 7f57757fa700 1 -- 172.21.15.169:0/4262939815 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5768003d20 con 0x7f57780b4b50 2023-06-08T04:01:39.935 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.927+0000 7f57757fa700 1 -- 172.21.15.169:0/4262939815 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f5768011d60 con 0x7f57780b4b50 2023-06-08T04:01:39.935 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.928+0000 7f577e7ff700 1 -- 172.21.15.169:0/4262939815 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57780740e0 con 0x7f57780b4b50 2023-06-08T04:01:39.935 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:39.930+0000 7f57757fa700 1 -- 172.21.15.169:0/4262939815 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5768017070 con 0x7f57780b4b50 2023-06-08T04:01:39.986 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:39.982+0000 7f009f30f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-08T04:01:40.021 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.017+0000 7f577e7ff700 1 -- 172.21.15.169:0/4262939815 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8f6f1127-bb27-4cde-b275-769e074a2a24", "id": 6} v 0) v1 -- 0x7f5778160360 con 0x7f57780b4b50 2023-06-08T04:01:40.025 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.021+0000 7f57757fa700 1 -- 172.21.15.169:0/4262939815 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f6f1127-bb27-4cde-b275-769e074a2a24", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5768011590 con 0x7f57780b4b50 2023-06-08T04:01:40.026 INFO:teuthology.orchestra.run.smithi169.stdout:6 2023-06-08T04:01:40.027 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.022+0000 7f577e7ff700 1 -- 172.21.15.169:0/4262939815 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57780b4b50 msgr2=0x7f57781512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.027 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.022+0000 7f577e7ff700 1 --2- 172.21.15.169:0/4262939815 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57780b4b50 0x7f57781512a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f576800c4e0 tx=0x7f576800c7f0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.027 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.023+0000 7f577e7ff700 1 -- 172.21.15.169:0/4262939815 shutdown_connections 2023-06-08T04:01:40.027 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.023+0000 7f577e7ff700 1 --2- 172.21.15.169:0/4262939815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5778160a60 0x7f57780b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.027 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.023+0000 7f577e7ff700 1 --2- 172.21.15.169:0/4262939815 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f57780b4b50 0x7f57781512a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.027 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.023+0000 7f577e7ff700 1 --2- 172.21.15.169:0/4262939815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57780b83f0 0x7f57781f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.028 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.023+0000 7f577e7ff700 1 -- 172.21.15.169:0/4262939815 >> 172.21.15.169:0/4262939815 conn(0x7f57780cf610 msgr2=0x7f57780cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:40.028 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.023+0000 7f577e7ff700 1 -- 172.21.15.169:0/4262939815 shutdown_connections 2023-06-08T04:01:40.028 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.023+0000 7f577e7ff700 1 -- 172.21.15.169:0/4262939815 wait complete. 2023-06-08T04:01:40.044 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 2d074f9a-0d63-49a0-b37e-5077219df41c 7 2023-06-08T04:01:40.166 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:40.162+0000 7f009f30f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-08T04:01:40.224 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:40.220+0000 7fce0e2e3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-08T04:01:40.237 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.233+0000 7fa809bff700 1 Processor -- start 2023-06-08T04:01:40.237 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.233+0000 7fa809bff700 1 -- start start 2023-06-08T04:01:40.239 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.235+0000 7fa809bff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa804160a60 0x7fa8040b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:40.239 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.235+0000 7fa809bff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040d0800 con 0x7fa8040b4b50 2023-06-08T04:01:40.239 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.235+0000 7fa809bff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040cd1e0 con 0x7fa8040b83f0 2023-06-08T04:01:40.240 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.235+0000 7fa809bff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa804160ed0 con 0x7fa804160a60 2023-06-08T04:01:40.240 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.235+0000 7fa8037fe700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fa8040b83f0 0x7fa8040ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:50682/0 (socket says 172.21.15.169:50682) 2023-06-08T04:01:40.240 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.235+0000 7fa8037fe700 1 -- 172.21.15.169:0/3189787632 learned_addr learned my addr 172.21.15.169:0/3189787632 (peer_addr_for_me v1:172.21.15.169:0/0) 2023-06-08T04:01:40.240 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.235+0000 7fa802ffd700 1 --2- 172.21.15.169:0/3189787632 >> v2:172.21.15.16:3300/0 conn(0x7fa804160a60 0x7fa8040b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:40.241 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.235+0000 7fa8027fc700 1 -- 172.21.15.169:0/3189787632 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937556817 0 0) 0x7fa8040cd1e0 con 0x7fa8040b83f0 2023-06-08T04:01:40.241 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.236+0000 7fa8027fc700 1 -- 172.21.15.169:0/3189787632 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ec0035b0 con 0x7fa8040b83f0 2023-06-08T04:01:40.242 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.236+0000 7fa802ffd700 1 -- 172.21.15.169:0/3189787632 >> v1:172.21.15.169:6789/0 conn(0x7fa8040b83f0 legacy=0x7fa8040ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.242 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.236+0000 7fa802ffd700 1 -- 172.21.15.169:0/3189787632 >> v1:172.21.15.16:6789/0 conn(0x7fa8040b4b50 legacy=0x7fa8040d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.242 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.236+0000 7fa802ffd700 1 -- 172.21.15.169:0/3189787632 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040cd4c0 con 0x7fa804160a60 2023-06-08T04:01:40.242 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.236+0000 7fa802ffd700 1 --2- 172.21.15.169:0/3189787632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa804160a60 0x7fa8040b4610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009840 tx=0x7fa7f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfce0254dcc0fd81 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:40.242 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.236+0000 7fa8027fc700 1 -- 172.21.15.169:0/3189787632 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8011830 con 0x7fa804160a60 2023-06-08T04:01:40.242 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.236+0000 7fa8027fc700 1 -- 172.21.15.169:0/3189787632 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f8011990 con 0x7fa804160a60 2023-06-08T04:01:40.242 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.236+0000 7fa8027fc700 1 -- 172.21.15.169:0/3189787632 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8011d20 con 0x7fa804160a60 2023-06-08T04:01:40.243 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.237+0000 7fa809bff700 1 -- 172.21.15.169:0/3189787632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa804160a60 msgr2=0x7fa8040b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.243 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.237+0000 7fa809bff700 1 --2- 172.21.15.169:0/3189787632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa804160a60 0x7fa8040b4610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009840 tx=0x7fa7f8009b50 comp rx=0 tx=0).stop 2023-06-08T04:01:40.243 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.237+0000 7fa809bff700 1 -- 172.21.15.169:0/3189787632 shutdown_connections 2023-06-08T04:01:40.243 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.237+0000 7fa809bff700 1 --2- 172.21.15.169:0/3189787632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa804160a60 0x7fa8040b4610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.243 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.237+0000 7fa809bff700 1 -- 172.21.15.169:0/3189787632 >> 172.21.15.169:0/3189787632 conn(0x7fa8040cf610 msgr2=0x7fa8040cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:40.243 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.237+0000 7fa809bff700 1 -- 172.21.15.169:0/3189787632 shutdown_connections 2023-06-08T04:01:40.243 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.237+0000 7fa809bff700 1 -- 172.21.15.169:0/3189787632 wait complete. 2023-06-08T04:01:40.244 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.239+0000 7fa809bff700 1 Processor -- start 2023-06-08T04:01:40.245 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.239+0000 7fa809bff700 1 -- start start 2023-06-08T04:01:40.245 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa809bff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8040b4b50 0x7fa80415a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:40.245 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa809bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8040b83f0 0x7fa8040c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:40.245 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa809bff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa804160a60 0x7fa8040d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:40.245 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa809bff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8041f2c60 con 0x7fa8040b4b50 2023-06-08T04:01:40.245 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa809bff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040c7e30 con 0x7fa804160a60 2023-06-08T04:01:40.246 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa809bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8041f2eb0 con 0x7fa8040b83f0 2023-06-08T04:01:40.246 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa802ffd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8040b83f0 0x7fa8040c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:40.246 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa803fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa804160a60 0x7fa8040d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:40.246 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa8037fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8040b4b50 0x7fa80415a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:40.246 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa802ffd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8040b83f0 0x7fa8040c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:41036/0 (socket says 172.21.15.169:41036) 2023-06-08T04:01:40.246 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa802ffd700 1 -- 172.21.15.169:0/2457314249 learned_addr learned my addr 172.21.15.169:0/2457314249 (peer_addr_for_me v2:172.21.15.169:0/0) 2023-06-08T04:01:40.246 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa802ffd700 1 -- 172.21.15.169:0/2457314249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa804160a60 msgr2=0x7fa8040d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.246 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa802ffd700 1 --2- 172.21.15.169:0/2457314249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa804160a60 0x7fa8040d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.247 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa802ffd700 1 -- 172.21.15.169:0/2457314249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8040b4b50 msgr2=0x7fa80415a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.247 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa802ffd700 1 --2- 172.21.15.169:0/2457314249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8040b4b50 0x7fa80415a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.247 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa802ffd700 1 -- 172.21.15.169:0/2457314249 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80094a0 con 0x7fa8040b83f0 2023-06-08T04:01:40.247 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.240+0000 7fa8037fe700 1 --2- 172.21.15.169:0/2457314249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8040b4b50 0x7fa80415a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:40.248 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.241+0000 7fa802ffd700 1 --2- 172.21.15.169:0/2457314249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8040b83f0 0x7fa8040c74c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009fd0 tx=0x7fa7f8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:40.248 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.241+0000 7fa7ebfff700 1 -- 172.21.15.169:0/2457314249 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80036a0 con 0x7fa8040b83f0 2023-06-08T04:01:40.248 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.241+0000 7fa7ebfff700 1 -- 172.21.15.169:0/2457314249 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f801f070 con 0x7fa8040b83f0 2023-06-08T04:01:40.248 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.241+0000 7fa7ebfff700 1 -- 172.21.15.169:0/2457314249 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8003a60 con 0x7fa8040b83f0 2023-06-08T04:01:40.248 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.241+0000 7fa809bff700 1 -- 172.21.15.169:0/2457314249 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8041f3190 con 0x7fa8040b83f0 2023-06-08T04:01:40.249 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.241+0000 7fa809bff700 1 -- 172.21.15.169:0/2457314249 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80415a650 con 0x7fa8040b83f0 2023-06-08T04:01:40.249 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.241+0000 7fa7ebfff700 1 -- 172.21.15.169:0/2457314249 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa7f8026480 con 0x7fa8040b83f0 2023-06-08T04:01:40.249 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.242+0000 7fa7ebfff700 1 -- 172.21.15.169:0/2457314249 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa7f8021070 con 0x7fa8040b83f0 2023-06-08T04:01:40.249 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.242+0000 7fa809bff700 1 -- 172.21.15.169:0/2457314249 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8041f37e0 con 0x7fa8040b83f0 2023-06-08T04:01:40.249 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.244+0000 7fa7ebfff700 1 -- 172.21.15.169:0/2457314249 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa7f802b020 con 0x7fa8040b83f0 2023-06-08T04:01:40.262 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:40.258+0000 7f009f30f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-08T04:01:40.319 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:40.315+0000 7fce0e2e3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-08T04:01:40.336 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.331+0000 7fa809bff700 1 -- 172.21.15.169:0/2457314249 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d074f9a-0d63-49a0-b37e-5077219df41c", "id": 7} v 0) v1 -- 0x7fa8040740e0 con 0x7fa8040b83f0 2023-06-08T04:01:40.340 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.336+0000 7fa7ebfff700 1 -- 172.21.15.169:0/2457314249 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d074f9a-0d63-49a0-b37e-5077219df41c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa7f8015020 con 0x7fa8040b83f0 2023-06-08T04:01:40.340 INFO:teuthology.orchestra.run.smithi169.stdout:7 2023-06-08T04:01:40.341 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.337+0000 7fa809bff700 1 -- 172.21.15.169:0/2457314249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8040b83f0 msgr2=0x7fa8040c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.341 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.337+0000 7fa809bff700 1 --2- 172.21.15.169:0/2457314249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8040b83f0 0x7fa8040c74c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009fd0 tx=0x7fa7f8004750 comp rx=0 tx=0).stop 2023-06-08T04:01:40.341 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.337+0000 7fa809bff700 1 -- 172.21.15.169:0/2457314249 shutdown_connections 2023-06-08T04:01:40.341 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.337+0000 7fa809bff700 1 --2- 172.21.15.169:0/2457314249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa804160a60 0x7fa8040d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.342 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.337+0000 7fa809bff700 1 --2- 172.21.15.169:0/2457314249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8040b4b50 0x7fa80415a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.342 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.337+0000 7fa809bff700 1 --2- 172.21.15.169:0/2457314249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8040b83f0 0x7fa8040c74c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.342 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.337+0000 7fa809bff700 1 -- 172.21.15.169:0/2457314249 >> 172.21.15.169:0/2457314249 conn(0x7fa8040cf610 msgr2=0x7fa80406b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:40.342 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.337+0000 7fa809bff700 1 -- 172.21.15.169:0/2457314249 shutdown_connections 2023-06-08T04:01:40.342 INFO:teuthology.orchestra.run.smithi169.stderr:2023-06-08T04:01:40.337+0000 7fa809bff700 1 -- 172.21.15.169:0/2457314249 wait complete. 2023-06-08T04:01:40.358 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-08T04:01:40.359 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-08T04:01:40.363 INFO:tasks.ceph.osd.0:Started 2023-06-08T04:01:40.363 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-08T04:01:40.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-08T04:01:40.367 INFO:tasks.ceph.osd.1:Started 2023-06-08T04:01:40.367 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-08T04:01:40.367 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-08T04:01:40.372 INFO:tasks.ceph.osd.2:Started 2023-06-08T04:01:40.373 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-08T04:01:40.373 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-08T04:01:40.378 INFO:tasks.ceph.osd.3:Started 2023-06-08T04:01:40.378 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-08T04:01:40.378 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-08T04:01:40.382 INFO:tasks.ceph.osd.4:Started 2023-06-08T04:01:40.383 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-08T04:01:40.383 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-08T04:01:40.387 INFO:tasks.ceph.osd.5:Started 2023-06-08T04:01:40.387 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-08T04:01:40.387 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-08T04:01:40.392 INFO:tasks.ceph.osd.6:Started 2023-06-08T04:01:40.393 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-08T04:01:40.393 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-08T04:01:40.398 INFO:tasks.ceph.osd.7:Started 2023-06-08T04:01:40.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:01:40.510 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:40.506+0000 7f009f30f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-08T04:01:40.566 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:40.562+0000 7fce0e2e3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-08T04:01:40.628 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:40.624+0000 7f009f30f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-08T04:01:40.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.661+0000 7f3c75fff700 1 Processor -- start 2023-06-08T04:01:40.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.661+0000 7f3c75fff700 1 -- start start 2023-06-08T04:01:40.665 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:40.662+0000 7fce0e2e3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-08T04:01:40.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.662+0000 7f3c75fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c70160a60 0x7f3c700b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:40.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.662+0000 7f3c75fff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3c700b4b50 0x7f3c700d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:40.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.662+0000 7f3c75fff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c700d0800 con 0x7f3c700b83f0 2023-06-08T04:01:40.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.662+0000 7f3c75fff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c70160ed0 con 0x7f3c700b4b50 2023-06-08T04:01:40.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.662+0000 7f3c75fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700b4fd0 con 0x7f3c70160a60 2023-06-08T04:01:40.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.662+0000 7f3c6ffff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3c700b4b50 0x7f3c700d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:40.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.662+0000 7f3c6effd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c70160a60 0x7f3c700b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:40.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.662+0000 7f3c6f7fe700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f3c700b83f0 0x7f3c700ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:44024/0 (socket says 172.21.15.16:44024) 2023-06-08T04:01:40.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.662+0000 7f3c6f7fe700 1 -- 172.21.15.16:0/3652972797 learned_addr learned my addr 172.21.15.16:0/3652972797 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:01:40.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.663+0000 7f3c6e7fc700 1 -- 172.21.15.16:0/3652972797 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534042518 0 0) 0x7f3c700d0800 con 0x7f3c700b83f0 2023-06-08T04:01:40.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.663+0000 7f3c6e7fc700 1 -- 172.21.15.16:0/3652972797 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c580035b0 con 0x7f3c700b83f0 2023-06-08T04:01:40.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.663+0000 7f3c6ffff700 1 -- 172.21.15.16:0/3652972797 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c70160a60 msgr2=0x7f3c700b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:40.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.663+0000 7f3c6ffff700 1 --2- 172.21.15.16:0/3652972797 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c70160a60 0x7f3c700b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.663+0000 7f3c6ffff700 1 -- 172.21.15.16:0/3652972797 >> v1:172.21.15.169:6789/0 conn(0x7f3c700b83f0 legacy=0x7f3c700ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.663+0000 7f3c6ffff700 1 -- 172.21.15.16:0/3652972797 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c700cd1e0 con 0x7f3c700b4b50 2023-06-08T04:01:40.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.663+0000 7f3c6ffff700 1 --2- 172.21.15.16:0/3652972797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c700b4b50 0x7f3c700d0fc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009d90 tx=0x7f3c6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7a774b8a724dffe server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:40.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.664+0000 7f3c6e7fc700 1 -- 172.21.15.16:0/3652972797 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6800e070 con 0x7f3c700b4b50 2023-06-08T04:01:40.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.664+0000 7f3c6e7fc700 1 -- 172.21.15.16:0/3652972797 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6800bb20 con 0x7f3c700b4b50 2023-06-08T04:01:40.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.664+0000 7f3c6e7fc700 1 -- 172.21.15.16:0/3652972797 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68012430 con 0x7f3c700b4b50 2023-06-08T04:01:40.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.664+0000 7f3c75fff700 1 -- 172.21.15.16:0/3652972797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c700b4b50 msgr2=0x7f3c700d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.664+0000 7f3c75fff700 1 --2- 172.21.15.16:0/3652972797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c700b4b50 0x7f3c700d0fc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009d90 tx=0x7f3c6800b330 comp rx=0 tx=0).stop 2023-06-08T04:01:40.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.664+0000 7f3c75fff700 1 -- 172.21.15.16:0/3652972797 shutdown_connections 2023-06-08T04:01:40.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.664+0000 7f3c75fff700 1 --2- 172.21.15.16:0/3652972797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c700b4b50 0x7f3c700d0fc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.664+0000 7f3c75fff700 1 --2- 172.21.15.16:0/3652972797 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c70160a60 0x7f3c700b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.664+0000 7f3c75fff700 1 -- 172.21.15.16:0/3652972797 >> 172.21.15.16:0/3652972797 conn(0x7f3c700cf610 msgr2=0x7f3c700cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:40.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.664+0000 7f3c75fff700 1 -- 172.21.15.16:0/3652972797 shutdown_connections 2023-06-08T04:01:40.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.664+0000 7f3c75fff700 1 -- 172.21.15.16:0/3652972797 wait complete. 2023-06-08T04:01:40.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.667+0000 7f3c75fff700 1 Processor -- start 2023-06-08T04:01:40.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.667+0000 7f3c75fff700 1 -- start start 2023-06-08T04:01:40.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.669+0000 7f3c75fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c700b4b50 0x7f3c701576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:40.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.669+0000 7f3c75fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c700b83f0 0x7f3c700d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:40.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.669+0000 7f3c75fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c70160a60 0x7f3c700d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:40.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.669+0000 7f3c75fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7015df10 con 0x7f3c700b83f0 2023-06-08T04:01:40.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.669+0000 7f3c75fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7015d680 con 0x7f3c70160a60 2023-06-08T04:01:40.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.669+0000 7f3c75fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7015d960 con 0x7f3c700b4b50 2023-06-08T04:01:40.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.669+0000 7f3c6effd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c700b83f0 0x7f3c700d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:40.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.669+0000 7f3c6f7fe700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c700b4b50 0x7f3c701576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:40.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.669+0000 7f3c6f7fe700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c700b4b50 0x7f3c701576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:41228/0 (socket says 172.21.15.16:41228) 2023-06-08T04:01:40.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.669+0000 7f3c6f7fe700 1 -- 172.21.15.16:0/337566290 learned_addr learned my addr 172.21.15.16:0/337566290 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:40.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.669+0000 7f3c6ffff700 1 --2- 172.21.15.16:0/337566290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c70160a60 0x7f3c700d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:40.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c6effd700 1 -- 172.21.15.16:0/337566290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c700b4b50 msgr2=0x7f3c701576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c6effd700 1 --2- 172.21.15.16:0/337566290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c700b4b50 0x7f3c701576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c6effd700 1 -- 172.21.15.16:0/337566290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c70160a60 msgr2=0x7f3c700d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c6effd700 1 --2- 172.21.15.16:0/337566290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c70160a60 0x7f3c700d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c6effd700 1 -- 172.21.15.16:0/337566290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c68009a70 con 0x7f3c700b83f0 2023-06-08T04:01:40.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c6effd700 1 --2- 172.21.15.16:0/337566290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c700b83f0 0x7f3c700d0e60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400e870 tx=0x7f3c6400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:40.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c57fff700 1 -- 172.21.15.16:0/337566290 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64013680 con 0x7f3c700b83f0 2023-06-08T04:01:40.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c57fff700 1 -- 172.21.15.16:0/337566290 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c640137e0 con 0x7f3c700b83f0 2023-06-08T04:01:40.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c75fff700 1 -- 172.21.15.16:0/337566290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c7015e120 con 0x7f3c700b83f0 2023-06-08T04:01:40.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c57fff700 1 -- 172.21.15.16:0/337566290 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64013b90 con 0x7f3c700b83f0 2023-06-08T04:01:40.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c75fff700 1 -- 172.21.15.16:0/337566290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c700a9560 con 0x7f3c700b83f0 2023-06-08T04:01:40.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.670+0000 7f3c57fff700 1 -- 172.21.15.16:0/337566290 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c6401c450 con 0x7f3c700b83f0 2023-06-08T04:01:40.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.671+0000 7f3c57fff700 1 -- 172.21.15.16:0/337566290 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3c6401cdd0 con 0x7f3c700b83f0 2023-06-08T04:01:40.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.671+0000 7f3c75fff700 1 -- 172.21.15.16:0/337566290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c700740e0 con 0x7f3c700b83f0 2023-06-08T04:01:40.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.674+0000 7f3c57fff700 1 -- 172.21.15.16:0/337566290 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3c6403bb00 con 0x7f3c700b83f0 2023-06-08T04:01:40.728 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:40.724+0000 7f009f30f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-08T04:01:40.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.747+0000 7f3c75fff700 1 -- 172.21.15.16:0/337566290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c7015e640 con 0x7f3c700b83f0 2023-06-08T04:01:40.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.748+0000 7f3c57fff700 1 -- 172.21.15.16:0/337566290 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3c6402a070 con 0x7f3c700b83f0 2023-06-08T04:01:40.752 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:40.752 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:40.334174+0000","last_up_change":"0.000000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:01:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.749+0000 7f3c75fff700 1 -- 172.21.15.16:0/337566290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c700b83f0 msgr2=0x7f3c700d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.749+0000 7f3c75fff700 1 --2- 172.21.15.16:0/337566290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c700b83f0 0x7f3c700d0e60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400e870 tx=0x7f3c6400eb80 comp rx=0 tx=0).stop 2023-06-08T04:01:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.749+0000 7f3c75fff700 1 -- 172.21.15.16:0/337566290 shutdown_connections 2023-06-08T04:01:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.749+0000 7f3c75fff700 1 --2- 172.21.15.16:0/337566290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c70160a60 0x7f3c700d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.749+0000 7f3c75fff700 1 --2- 172.21.15.16:0/337566290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c700b4b50 0x7f3c701576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.749+0000 7f3c75fff700 1 --2- 172.21.15.16:0/337566290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c700b83f0 0x7f3c700d0e60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:40.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.749+0000 7f3c75fff700 1 -- 172.21.15.16:0/337566290 >> 172.21.15.16:0/337566290 conn(0x7f3c700cf610 msgr2=0x7f3c700b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:40.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.749+0000 7f3c75fff700 1 -- 172.21.15.16:0/337566290 shutdown_connections 2023-06-08T04:01:40.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:40.749+0000 7f3c75fff700 1 -- 172.21.15.16:0/337566290 wait complete. 2023-06-08T04:01:40.772 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-08T04:01:40.772 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-08T04:01:40.835 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:40.831+0000 7f009f30f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-08T04:01:40.892 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:40.889+0000 7fce0e2e3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-08T04:01:40.996 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:40.992+0000 7fce0e2e3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-08T04:01:41.067 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:41.063+0000 7f009f30f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-08T04:01:41.070 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-06-08T04:01:41.066+0000 7ff7c6890640 -1 Falling back to public interface 2023-06-08T04:01:41.075 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-06-08T04:01:41.072+0000 7f5caf100640 -1 Falling back to public interface 2023-06-08T04:01:41.088 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-06-08T04:01:41.084+0000 7f0afd061640 -1 Falling back to public interface 2023-06-08T04:01:41.090 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-06-08T04:01:41.087+0000 7f227b1a7640 -1 Falling back to public interface 2023-06-08T04:01:41.099 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:41.095+0000 7fce0e2e3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-08T04:01:41.100 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-06-08T04:01:41.096+0000 7fba21ae5640 -1 Falling back to public interface 2023-06-08T04:01:41.113 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-06-08T04:01:41.109+0000 7f63acee4640 -1 Falling back to public interface 2023-06-08T04:01:41.137 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-06-08T04:01:41.134+0000 7f5d66374640 -1 Falling back to public interface 2023-06-08T04:01:41.142 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-06-08T04:01:41.139+0000 7fadcace8640 -1 Falling back to public interface 2023-06-08T04:01:41.185 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:41.181+0000 7f009f30f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-08T04:01:41.219 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:41.216+0000 7fce0e2e3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-08T04:01:41.454 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:41.450+0000 7fce0e2e3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-08T04:01:41.553 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:41.549+0000 7f009f30f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-08T04:01:41.559 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:41.556+0000 7fce0e2e3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-08T04:01:41.577 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-08T04:01:41.645 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:41.641+0000 7f009f30f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-08T04:01:41.761 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.757+0000 7f95fa1ff700 1 Processor -- start 2023-06-08T04:01:41.761 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.757+0000 7f95fa1ff700 1 -- start start 2023-06-08T04:01:41.762 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.758+0000 7f95fa1ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f95f40cd2b0 0x7f95f40cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:41.762 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.758+0000 7f95fa1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95f40b46e0 0x7f95f40b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:41.763 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.758+0000 7f95fa1ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f40d12e0 con 0x7f95f415c770 2023-06-08T04:01:41.763 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.758+0000 7f95fa1ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f40b5060 con 0x7f95f40cd2b0 2023-06-08T04:01:41.763 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.758+0000 7f95fa1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40cdd70 con 0x7f95f40b46e0 2023-06-08T04:01:41.763 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.759+0000 7f95f2ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f95f40cd2b0 0x7f95f40cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:41.763 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.759+0000 7f95f2ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f95f40cd2b0 0x7f95f40cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45738/0 (socket says 172.21.15.16:45738) 2023-06-08T04:01:41.763 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.759+0000 7f95f2ffd700 1 -- 172.21.15.16:0/1504547778 learned_addr learned my addr 172.21.15.16:0/1504547778 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:41.763 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.759+0000 7f95f3fff700 1 --2- 172.21.15.16:0/1504547778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95f40b46e0 0x7f95f40b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:41.765 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.759+0000 7f95f2ffd700 1 -- 172.21.15.16:0/1504547778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95f40b46e0 msgr2=0x7f95f40b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:41.765 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.759+0000 7f95f2ffd700 1 --2- 172.21.15.16:0/1504547778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95f40b46e0 0x7f95f40b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:41.765 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.759+0000 7f95f2ffd700 1 -- 172.21.15.16:0/1504547778 >> v1:172.21.15.169:6789/0 conn(0x7f95f415c770 legacy=0x7f95f40c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:41.765 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.759+0000 7f95f2ffd700 1 -- 172.21.15.16:0/1504547778 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40d09b0 con 0x7f95f40cd2b0 2023-06-08T04:01:41.765 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.759+0000 7f95f27fc700 1 -- 172.21.15.16:0/1504547778 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121789055 0 0) 0x7f95f40d12e0 con 0x7f95f415c770 2023-06-08T04:01:41.765 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.759+0000 7f95f2ffd700 1 --2- 172.21.15.16:0/1504547778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f40cd2b0 0x7f95f40cd720 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f95e80098f0 tx=0x7f95e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f31ed8ed10ae50 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:41.766 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.760+0000 7f95f27fc700 1 -- 172.21.15.16:0/1504547778 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8011830 con 0x7f95f40cd2b0 2023-06-08T04:01:41.766 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.760+0000 7f95f27fc700 1 -- 172.21.15.16:0/1504547778 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e8011990 con 0x7f95f40cd2b0 2023-06-08T04:01:41.766 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.760+0000 7f95f27fc700 1 -- 172.21.15.16:0/1504547778 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8011d20 con 0x7f95f40cd2b0 2023-06-08T04:01:41.766 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.760+0000 7f95fa1ff700 1 -- 172.21.15.16:0/1504547778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f40cd2b0 msgr2=0x7f95f40cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:41.766 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.760+0000 7f95fa1ff700 1 --2- 172.21.15.16:0/1504547778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f40cd2b0 0x7f95f40cd720 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f95e80098f0 tx=0x7f95e8009c00 comp rx=0 tx=0).stop 2023-06-08T04:01:41.766 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.760+0000 7f95fa1ff700 1 -- 172.21.15.16:0/1504547778 shutdown_connections 2023-06-08T04:01:41.766 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.760+0000 7f95fa1ff700 1 --2- 172.21.15.16:0/1504547778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95f40b46e0 0x7f95f40b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:41.767 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.760+0000 7f95fa1ff700 1 --2- 172.21.15.16:0/1504547778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f40cd2b0 0x7f95f40cd720 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:41.767 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.760+0000 7f95fa1ff700 1 -- 172.21.15.16:0/1504547778 >> 172.21.15.16:0/1504547778 conn(0x7f95f40cf6e0 msgr2=0x7f95f40cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:41.767 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.760+0000 7f95fa1ff700 1 -- 172.21.15.16:0/1504547778 shutdown_connections 2023-06-08T04:01:41.767 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.760+0000 7f95fa1ff700 1 -- 172.21.15.16:0/1504547778 wait complete. 2023-06-08T04:01:41.767 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.763+0000 7f95fa1ff700 1 Processor -- start 2023-06-08T04:01:41.768 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.763+0000 7f95fa1ff700 1 -- start start 2023-06-08T04:01:41.769 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.764+0000 7f95fa1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95f40b46e0 0x7f95f415f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:41.769 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.764+0000 7f95fa1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f40cd2b0 0x7f95f41f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:41.769 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.764+0000 7f95fa1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95f415c770 0x7f95f41e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:41.769 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.764+0000 7f95fa1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f41f2120 con 0x7f95f40cd2b0 2023-06-08T04:01:41.769 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.764+0000 7f95fa1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40b7f60 con 0x7f95f415c770 2023-06-08T04:01:41.770 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.764+0000 7f95fa1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40b8240 con 0x7f95f40b46e0 2023-06-08T04:01:41.770 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.764+0000 7f95f2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f40cd2b0 0x7f95f41f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:41.770 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.765+0000 7f95f2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f40cd2b0 0x7f95f41f32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45746/0 (socket says 172.21.15.16:45746) 2023-06-08T04:01:41.770 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.765+0000 7f95f37fe700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95f40b46e0 0x7f95f415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:41.770 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.765+0000 7f95f2ffd700 1 -- 172.21.15.16:0/2666858553 learned_addr learned my addr 172.21.15.16:0/2666858553 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:41.770 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.765+0000 7f95f3fff700 1 --2- 172.21.15.16:0/2666858553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95f415c770 0x7f95f41e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:41.770 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.765+0000 7f95f2ffd700 1 -- 172.21.15.16:0/2666858553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95f40b46e0 msgr2=0x7f95f415f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:41.770 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.765+0000 7f95f2ffd700 1 --2- 172.21.15.16:0/2666858553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95f40b46e0 0x7f95f415f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:41.771 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.765+0000 7f95f2ffd700 1 -- 172.21.15.16:0/2666858553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95f415c770 msgr2=0x7f95f41e5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:41.771 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.765+0000 7f95f2ffd700 1 --2- 172.21.15.16:0/2666858553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95f415c770 0x7f95f41e5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:41.771 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.765+0000 7f95f2ffd700 1 -- 172.21.15.16:0/2666858553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8009550 con 0x7f95f40cd2b0 2023-06-08T04:01:41.771 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.765+0000 7f95f2ffd700 1 --2- 172.21.15.16:0/2666858553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f40cd2b0 0x7f95f41f32e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009c40 tx=0x7f95e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:41.772 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.766+0000 7f95dbfff700 1 -- 172.21.15.16:0/2666858553 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8004300 con 0x7f95f40cd2b0 2023-06-08T04:01:41.772 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.766+0000 7f95dbfff700 1 -- 172.21.15.16:0/2666858553 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e801f070 con 0x7f95f40cd2b0 2023-06-08T04:01:41.772 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.766+0000 7f95dbfff700 1 -- 172.21.15.16:0/2666858553 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e80036a0 con 0x7f95f40cd2b0 2023-06-08T04:01:41.772 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.766+0000 7f95fa1ff700 1 -- 172.21.15.16:0/2666858553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f40b8520 con 0x7f95f40cd2b0 2023-06-08T04:01:41.772 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.766+0000 7f95fa1ff700 1 -- 172.21.15.16:0/2666858553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f415f660 con 0x7f95f40cd2b0 2023-06-08T04:01:41.773 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.766+0000 7f95dbfff700 1 -- 172.21.15.16:0/2666858553 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f95e8021030 con 0x7f95f40cd2b0 2023-06-08T04:01:41.773 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.766+0000 7f95dbfff700 1 -- 172.21.15.16:0/2666858553 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f95e801a450 con 0x7f95f40cd2b0 2023-06-08T04:01:41.773 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.767+0000 7f95fa1ff700 1 -- 172.21.15.16:0/2666858553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f41f2290 con 0x7f95f40cd2b0 2023-06-08T04:01:41.773 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.770+0000 7f95dbfff700 1 -- 172.21.15.16:0/2666858553 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f95e8015020 con 0x7f95f40cd2b0 2023-06-08T04:01:41.850 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.846+0000 7f95fa1ff700 1 -- 172.21.15.16:0/2666858553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95f4066610 con 0x7f95f40cd2b0 2023-06-08T04:01:41.851 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.847+0000 7f95dbfff700 1 -- 172.21.15.16:0/2666858553 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f95e8033020 con 0x7f95f40cd2b0 2023-06-08T04:01:41.851 INFO:teuthology.misc.health.smithi016.stdout: 2023-06-08T04:01:41.851 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:40.334174+0000","last_up_change":"0.000000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:01:41.852 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.848+0000 7f95fa1ff700 1 -- 172.21.15.16:0/2666858553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f40cd2b0 msgr2=0x7f95f41f32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:41.852 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.848+0000 7f95fa1ff700 1 --2- 172.21.15.16:0/2666858553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f40cd2b0 0x7f95f41f32e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009c40 tx=0x7f95e8004750 comp rx=0 tx=0).stop 2023-06-08T04:01:41.852 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.848+0000 7f95fa1ff700 1 -- 172.21.15.16:0/2666858553 shutdown_connections 2023-06-08T04:01:41.852 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.848+0000 7f95fa1ff700 1 --2- 172.21.15.16:0/2666858553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95f415c770 0x7f95f41e5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:41.853 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.848+0000 7f95fa1ff700 1 --2- 172.21.15.16:0/2666858553 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95f40b46e0 0x7f95f415f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:41.853 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.848+0000 7f95fa1ff700 1 --2- 172.21.15.16:0/2666858553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f40cd2b0 0x7f95f41f32e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:41.853 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.848+0000 7f95fa1ff700 1 -- 172.21.15.16:0/2666858553 >> 172.21.15.16:0/2666858553 conn(0x7f95f40cf6e0 msgr2=0x7f95f40d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:41.853 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.848+0000 7f95fa1ff700 1 -- 172.21.15.16:0/2666858553 shutdown_connections 2023-06-08T04:01:41.853 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:41.848+0000 7f95fa1ff700 1 -- 172.21.15.16:0/2666858553 wait complete. 2023-06-08T04:01:41.867 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-08T04:01:41.936 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:41.932+0000 7fce0e2e3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-08T04:01:42.030 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:42.026+0000 7fce0e2e3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-08T04:01:42.286 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:42.282+0000 7f009f30f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-08T04:01:42.677 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:42.674+0000 7fce0e2e3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-08T04:01:42.678 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:42.674+0000 7f009f30f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-08T04:01:42.862 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:42.858+0000 7f009f30f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-08T04:01:43.065 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:43.060+0000 7fce0e2e3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-08T04:01:43.250 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:43.246+0000 7fce0e2e3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-08T04:01:43.315 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:43.311+0000 7f009f30f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-08T04:01:43.502 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:43.498+0000 7f009f30f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-08T04:01:43.719 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:43.715+0000 7f009f30f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-08T04:01:43.728 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:43.724+0000 7fce0e2e3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-08T04:01:43.938 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:43.934+0000 7fce0e2e3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-08T04:01:44.168 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:44.163+0000 7fce0e2e3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-08T04:01:44.169 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:44.165+0000 7f009f30f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-08T04:01:44.557 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-06-08T04:01:44.553+0000 7fce0e2e3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-08T04:01:44.592 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-06-08T04:01:44.588+0000 7ff7c6890640 -1 osd.4 0 log_to_monitors true 2023-06-08T04:01:44.610 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-06-08T04:01:44.606+0000 7f5caf100640 -1 osd.0 0 log_to_monitors true 2023-06-08T04:01:44.673 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-06-08T04:01:44.669+0000 7fba21ae5640 -1 osd.5 0 log_to_monitors true 2023-06-08T04:01:44.716 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-06-08T04:01:44.712+0000 7f5d66374640 -1 osd.3 0 log_to_monitors true 2023-06-08T04:01:44.900 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-06-08T04:01:44.896+0000 7f227b1a7640 -1 osd.1 0 log_to_monitors true 2023-06-08T04:01:44.906 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-06-08T04:01:44.903+0000 7f0afd061640 -1 osd.6 0 log_to_monitors true 2023-06-08T04:01:44.965 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-06-08T04:01:44.960+0000 7f63acee4640 -1 osd.7 0 log_to_monitors true 2023-06-08T04:01:44.967 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-06-08T04:01:44.963+0000 7fadcace8640 -1 osd.2 0 log_to_monitors true 2023-06-08T04:01:45.192 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:45.188+0000 7f0058bfa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-08T04:01:45.192 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:01:45.188+0000 7f0058bfa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-08T04:01:47.713 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-06-08T04:01:47.709+0000 7f5d549f6700 -1 osd.3 0 waiting for initial osdmap 2023-06-08T04:01:47.731 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-06-08T04:01:47.726+0000 7f5d4c9fb700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T04:01:47.778 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-06-08T04:01:47.772+0000 7f5c9d7f6700 -1 osd.0 0 waiting for initial osdmap 2023-06-08T04:01:47.783 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-06-08T04:01:47.779+0000 7fadb93f6700 -1 osd.2 0 waiting for initial osdmap 2023-06-08T04:01:47.791 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-06-08T04:01:47.787+0000 7f5c957fb700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T04:01:47.796 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-06-08T04:01:47.792+0000 7fadb13fb700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T04:01:47.806 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-06-08T04:01:47.801+0000 7f22697f6700 -1 osd.1 0 waiting for initial osdmap 2023-06-08T04:01:47.819 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-06-08T04:01:47.814+0000 7f22617fb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T04:01:48.328 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-06-08T04:01:48.324+0000 7fba101f6700 -1 osd.5 0 waiting for initial osdmap 2023-06-08T04:01:48.345 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-06-08T04:01:48.341+0000 7fba081fb700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T04:01:48.353 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-06-08T04:01:48.349+0000 7f639b5f6700 -1 osd.7 0 waiting for initial osdmap 2023-06-08T04:01:48.373 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-06-08T04:01:48.368+0000 7ff7b4ff6700 -1 osd.4 0 waiting for initial osdmap 2023-06-08T04:01:48.373 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-06-08T04:01:48.369+0000 7f63935fb700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T04:01:48.388 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-06-08T04:01:48.384+0000 7ff7acffb700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T04:01:48.438 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-06-08T04:01:48.434+0000 7f0aeb7f6700 -1 osd.6 0 waiting for initial osdmap 2023-06-08T04:01:48.456 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-06-08T04:01:48.452+0000 7f0ae37fb700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-08T04:01:48.678 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-08T04:01:48.873 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.868+0000 7f84e17ff700 1 Processor -- start 2023-06-08T04:01:48.873 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.868+0000 7f84e17ff700 1 -- start start 2023-06-08T04:01:48.874 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.869+0000 7f84e17ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f84dc15c770 0x7f84dc0c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:48.875 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.869+0000 7f84e17ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f84dc0c6cf0 0x7f84dc0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:48.875 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84e17ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84dc0d12e0 con 0x7f84dc0cd7f0 2023-06-08T04:01:48.875 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84e17ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84dc0cdd70 con 0x7f84dc15c770 2023-06-08T04:01:48.875 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84e17ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84dc0d09b0 con 0x7f84dc0c6cf0 2023-06-08T04:01:48.875 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84daffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f84dc15c770 0x7f84dc0c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:48.875 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84daffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f84dc15c770 0x7f84dc0c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50840/0 (socket says 172.21.15.16:50840) 2023-06-08T04:01:48.876 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84daffd700 1 -- 172.21.15.16:0/3671289644 learned_addr learned my addr 172.21.15.16:0/3671289644 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:48.876 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84da7fc700 1 --2- 172.21.15.16:0/3671289644 >> v2:172.21.15.169:3300/0 conn(0x7f84dc0c6cf0 0x7f84dc0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:48.877 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84daffd700 1 -- 172.21.15.16:0/3671289644 >> v2:172.21.15.169:3300/0 conn(0x7f84dc0c6cf0 msgr2=0x7f84dc0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:48.877 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84daffd700 1 --2- 172.21.15.16:0/3671289644 >> v2:172.21.15.169:3300/0 conn(0x7f84dc0c6cf0 0x7f84dc0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:48.877 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84daffd700 1 -- 172.21.15.16:0/3671289644 >> v1:172.21.15.169:6789/0 conn(0x7f84dc0cd7f0 legacy=0x7f84dc0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:48.877 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84daffd700 1 -- 172.21.15.16:0/3671289644 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc0d0c90 con 0x7f84dc15c770 2023-06-08T04:01:48.877 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84da7fc700 1 --2- 172.21.15.16:0/3671289644 >> v2:172.21.15.169:3300/0 conn(0x7f84dc0c6cf0 0x7f84dc0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:01:48.878 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.870+0000 7f84daffd700 1 --2- 172.21.15.16:0/3671289644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84dc15c770 0x7f84dc0c67b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f84dc06c5e0 tx=0x7f84cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8215ba173883e0a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:48.878 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.871+0000 7f84d9ffb700 1 -- 172.21.15.16:0/3671289644 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00b870 con 0x7f84dc15c770 2023-06-08T04:01:48.878 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.871+0000 7f84d9ffb700 1 -- 172.21.15.16:0/3671289644 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc00b9d0 con 0x7f84dc15c770 2023-06-08T04:01:48.878 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.871+0000 7f84d9ffb700 1 -- 172.21.15.16:0/3671289644 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00bd60 con 0x7f84dc15c770 2023-06-08T04:01:48.878 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.871+0000 7f84e17ff700 1 -- 172.21.15.16:0/3671289644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84dc15c770 msgr2=0x7f84dc0c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:48.878 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.871+0000 7f84e17ff700 1 --2- 172.21.15.16:0/3671289644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84dc15c770 0x7f84dc0c67b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f84dc06c5e0 tx=0x7f84cc009bd0 comp rx=0 tx=0).stop 2023-06-08T04:01:48.878 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.871+0000 7f84e17ff700 1 -- 172.21.15.16:0/3671289644 shutdown_connections 2023-06-08T04:01:48.879 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.871+0000 7f84e17ff700 1 --2- 172.21.15.16:0/3671289644 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84dc15c770 0x7f84dc0c67b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:48.879 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.871+0000 7f84e17ff700 1 --2- 172.21.15.16:0/3671289644 >> v2:172.21.15.169:3300/0 conn(0x7f84dc0c6cf0 0x7f84dc0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:48.879 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.871+0000 7f84e17ff700 1 -- 172.21.15.16:0/3671289644 >> 172.21.15.16:0/3671289644 conn(0x7f84dc0cf6e0 msgr2=0x7f84dc0cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:48.879 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.871+0000 7f84e17ff700 1 -- 172.21.15.16:0/3671289644 shutdown_connections 2023-06-08T04:01:48.879 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.871+0000 7f84e17ff700 1 -- 172.21.15.16:0/3671289644 wait complete. 2023-06-08T04:01:48.881 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.873+0000 7f84e17ff700 1 Processor -- start 2023-06-08T04:01:48.882 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.873+0000 7f84e17ff700 1 -- start start 2023-06-08T04:01:48.882 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.874+0000 7f84e17ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84dc0c6cf0 0x7f84dc0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:48.882 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.874+0000 7f84e17ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84dc0cd7f0 0x7f84dc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:48.882 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.874+0000 7f84e17ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84dc15c770 0x7f84dc0b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:48.882 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.874+0000 7f84e17ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc157420 con 0x7f84dc0c6cf0 2023-06-08T04:01:48.882 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.874+0000 7f84e17ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc157700 con 0x7f84dc0cd7f0 2023-06-08T04:01:48.882 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.874+0000 7f84e17ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc1579e0 con 0x7f84dc15c770 2023-06-08T04:01:48.883 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.874+0000 7f84daffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84dc0c6cf0 0x7f84dc0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:48.883 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.874+0000 7f84daffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84dc0c6cf0 0x7f84dc0b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50848/0 (socket says 172.21.15.16:50848) 2023-06-08T04:01:48.883 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.874+0000 7f84daffd700 1 -- 172.21.15.16:0/78751628 learned_addr learned my addr 172.21.15.16:0/78751628 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:48.883 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.875+0000 7f84da7fc700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84dc0cd7f0 0x7f84dc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:48.883 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.875+0000 7f84db7fe700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84dc15c770 0x7f84dc0b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:48.883 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.875+0000 7f84daffd700 1 -- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84dc15c770 msgr2=0x7f84dc0b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:48.883 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.875+0000 7f84daffd700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84dc15c770 0x7f84dc0b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:48.883 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.875+0000 7f84daffd700 1 -- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84dc0cd7f0 msgr2=0x7f84dc156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:48.884 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.875+0000 7f84daffd700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84dc0cd7f0 0x7f84dc156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:48.884 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.875+0000 7f84daffd700 1 -- 172.21.15.16:0/78751628 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc009550 con 0x7f84dc0c6cf0 2023-06-08T04:01:48.884 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.875+0000 7f84daffd700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84dc0c6cf0 0x7f84dc0b5a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84cc000c00 tx=0x7f84cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:48.884 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.875+0000 7f84c37fe700 1 -- 172.21.15.16:0/78751628 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc004310 con 0x7f84dc0c6cf0 2023-06-08T04:01:48.884 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.875+0000 7f84c37fe700 1 -- 172.21.15.16:0/78751628 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc01e070 con 0x7f84dc0c6cf0 2023-06-08T04:01:48.884 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.876+0000 7f84e17ff700 1 -- 172.21.15.16:0/78751628 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84dc157cc0 con 0x7f84dc0c6cf0 2023-06-08T04:01:48.884 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.876+0000 7f84c37fe700 1 -- 172.21.15.16:0/78751628 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0036a0 con 0x7f84dc0c6cf0 2023-06-08T04:01:48.885 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.876+0000 7f84e17ff700 1 -- 172.21.15.16:0/78751628 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84dc0b5fd0 con 0x7f84dc0c6cf0 2023-06-08T04:01:48.885 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.877+0000 7f84e17ff700 1 -- 172.21.15.16:0/78751628 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84dc04e090 con 0x7f84dc0c6cf0 2023-06-08T04:01:48.886 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.878+0000 7f84c37fe700 1 -- 172.21.15.16:0/78751628 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f84cc020030 con 0x7f84dc0c6cf0 2023-06-08T04:01:48.886 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.879+0000 7f84c37fe700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f84c806ac50 0x7f84c806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:48.886 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.879+0000 7f84c37fe700 1 -- 172.21.15.16:0/78751628 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f84cc089d00 con 0x7f84dc0c6cf0 2023-06-08T04:01:48.886 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.879+0000 7f84da7fc700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f84c806ac50 0x7f84c806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:48.886 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.880+0000 7f84da7fc700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f84c806ac50 0x7f84c806d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f84dc15bc60 tx=0x7f84d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:48.888 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:48.884+0000 7f84c37fe700 1 -- 172.21.15.16:0/78751628 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f84cc055430 con 0x7f84dc0c6cf0 2023-06-08T04:01:49.099 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.094+0000 7f84e17ff700 1 -- 172.21.15.16:0/78751628 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84dc15ae40 con 0x7f84dc0c6cf0 2023-06-08T04:01:49.099 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.095+0000 7f84c37fe700 1 -- 172.21.15.16:0/78751628 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10884 (secure 0 0 0) 0x7f84cc058a50 con 0x7f84dc0c6cf0 2023-06-08T04:01:49.100 INFO:teuthology.misc.health.smithi016.stdout: 2023-06-08T04:01:49.100 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":13,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:48.713277+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:01:49.102 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 -- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f84c806ac50 msgr2=0x7f84c806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:49.102 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f84c806ac50 0x7f84c806d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f84dc15bc60 tx=0x7f84d0008040 comp rx=0 tx=0).stop 2023-06-08T04:01:49.103 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 -- 172.21.15.16:0/78751628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84dc0c6cf0 msgr2=0x7f84dc0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:49.103 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84dc0c6cf0 0x7f84dc0b5a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84cc000c00 tx=0x7f84cc004750 comp rx=0 tx=0).stop 2023-06-08T04:01:49.103 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 -- 172.21.15.16:0/78751628 shutdown_connections 2023-06-08T04:01:49.103 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f84c806ac50 0x7f84c806d100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.103 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f84dc15c770 0x7f84dc0b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.103 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84dc0c6cf0 0x7f84dc0b5a90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.103 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 --2- 172.21.15.16:0/78751628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84dc0cd7f0 0x7f84dc156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.103 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 -- 172.21.15.16:0/78751628 >> 172.21.15.16:0/78751628 conn(0x7f84dc0cf6e0 msgr2=0x7f84dc0c7190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:49.104 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 -- 172.21.15.16:0/78751628 shutdown_connections 2023-06-08T04:01:49.104 INFO:teuthology.misc.health.smithi016.stderr:2023-06-08T04:01:49.097+0000 7f84e17ff700 1 -- 172.21.15.16:0/78751628 wait complete. 2023-06-08T04:01:49.118 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-08T04:01:49.118 INFO:tasks.ceph:Creating RBD pool 2023-06-08T04:01:49.118 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-08T04:01:49.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.309+0000 7f2fc79ff700 1 Processor -- start 2023-06-08T04:01:49.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.309+0000 7f2fc79ff700 1 -- start start 2023-06-08T04:01:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.310+0000 7f2fc79ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2fc00b83f0 0x7f2fc0160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.310+0000 7f2fc79ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2fc00ced40 0x7f2fc00b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.310+0000 7f2fc79ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc00d0800 con 0x7f2fc00b4b50 2023-06-08T04:01:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.310+0000 7f2fc79ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc00b4fd0 con 0x7f2fc00b83f0 2023-06-08T04:01:49.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.310+0000 7f2fc79ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc00cd1e0 con 0x7f2fc00ced40 2023-06-08T04:01:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.310+0000 7f2fc579b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2fc00b83f0 0x7f2fc0160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.310+0000 7f2fc579b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2fc00b83f0 0x7f2fc0160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50854/0 (socket says 172.21.15.16:50854) 2023-06-08T04:01:49.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.310+0000 7f2fc579b700 1 -- 172.21.15.16:0/2512034717 learned_addr learned my addr 172.21.15.16:0/2512034717 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.311+0000 7f2fc4f9a700 1 --2- 172.21.15.16:0/2512034717 >> v2:172.21.15.169:3300/0 conn(0x7f2fc00ced40 0x7f2fc00b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.311+0000 7f2fc579b700 1 -- 172.21.15.16:0/2512034717 >> v2:172.21.15.169:3300/0 conn(0x7f2fc00ced40 msgr2=0x7f2fc00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:49.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.311+0000 7f2fc579b700 1 --2- 172.21.15.16:0/2512034717 >> v2:172.21.15.169:3300/0 conn(0x7f2fc00ced40 0x7f2fc00b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.311+0000 7f2fc579b700 1 -- 172.21.15.16:0/2512034717 >> v1:172.21.15.169:6789/0 conn(0x7f2fc00b4b50 legacy=0x7f2fc006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.311+0000 7f2fc579b700 1 -- 172.21.15.16:0/2512034717 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc00cd4c0 con 0x7f2fc00b83f0 2023-06-08T04:01:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.311+0000 7f2fc4f9a700 1 --2- 172.21.15.16:0/2512034717 >> v2:172.21.15.169:3300/0 conn(0x7f2fc00ced40 0x7f2fc00b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:01:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.311+0000 7f2fc579b700 1 --2- 172.21.15.16:0/2512034717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fc00b83f0 0x7f2fc0160a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fc006c4e0 tx=0x7f2fbc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6435d29482530ed server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.311+0000 7f2fb7fff700 1 -- 172.21.15.16:0/2512034717 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc004230 con 0x7f2fc00b83f0 2023-06-08T04:01:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.311+0000 7f2fb7fff700 1 -- 172.21.15.16:0/2512034717 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc004390 con 0x7f2fc00b83f0 2023-06-08T04:01:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.311+0000 7f2fb7fff700 1 -- 172.21.15.16:0/2512034717 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0036a0 con 0x7f2fc00b83f0 2023-06-08T04:01:49.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.312+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2512034717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fc00b83f0 msgr2=0x7f2fc0160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.312+0000 7f2fc79ff700 1 --2- 172.21.15.16:0/2512034717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fc00b83f0 0x7f2fc0160a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fc006c4e0 tx=0x7f2fbc009bd0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.312+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2512034717 shutdown_connections 2023-06-08T04:01:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.312+0000 7f2fc79ff700 1 --2- 172.21.15.16:0/2512034717 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fc00b83f0 0x7f2fc0160a60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.312+0000 7f2fc79ff700 1 --2- 172.21.15.16:0/2512034717 >> v2:172.21.15.169:3300/0 conn(0x7f2fc00ced40 0x7f2fc00b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.312+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2512034717 >> 172.21.15.16:0/2512034717 conn(0x7f2fc00cf610 msgr2=0x7f2fc00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.312+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2512034717 shutdown_connections 2023-06-08T04:01:49.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.312+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2512034717 wait complete. 2023-06-08T04:01:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.314+0000 7f2fc79ff700 1 Processor -- start 2023-06-08T04:01:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.314+0000 7f2fc79ff700 1 -- start start 2023-06-08T04:01:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.315+0000 7f2fc79ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fc00b4b50 0x7f2fc00cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.315+0000 7f2fc79ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc00b83f0 0x7f2fc015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.315+0000 7f2fc79ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fc00ced40 0x7f2fc00aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.315+0000 7f2fc79ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00a9f30 con 0x7f2fc00ced40 2023-06-08T04:01:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.315+0000 7f2fc79ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00cb9d0 con 0x7f2fc00b83f0 2023-06-08T04:01:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.315+0000 7f2fc79ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00cbcb0 con 0x7f2fc00b4b50 2023-06-08T04:01:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.315+0000 7f2fc5f9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fc00ced40 0x7f2fc00aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.315+0000 7f2fc4f9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc00b83f0 0x7f2fc015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.315+0000 7f2fc5f9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fc00ced40 0x7f2fc00aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50860/0 (socket says 172.21.15.16:50860) 2023-06-08T04:01:49.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.315+0000 7f2fc5f9c700 1 -- 172.21.15.16:0/2464969542 learned_addr learned my addr 172.21.15.16:0/2464969542 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.315+0000 7f2fc579b700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fc00b4b50 0x7f2fc00cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.316+0000 7f2fc5f9c700 1 -- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fc00b4b50 msgr2=0x7f2fc00cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.316+0000 7f2fc5f9c700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fc00b4b50 0x7f2fc00cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.316+0000 7f2fc5f9c700 1 -- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc00b83f0 msgr2=0x7f2fc015a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.316+0000 7f2fc5f9c700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc00b83f0 0x7f2fc015a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.316+0000 7f2fc5f9c700 1 -- 172.21.15.16:0/2464969542 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc009550 con 0x7f2fc00ced40 2023-06-08T04:01:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.316+0000 7f2fc5f9c700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fc00ced40 0x7f2fc00aab50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800cc10 tx=0x7f2fb800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:49.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.316+0000 7f2fb5ffb700 1 -- 172.21.15.16:0/2464969542 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800aa60 con 0x7f2fc00ced40 2023-06-08T04:01:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.316+0000 7f2fb5ffb700 1 -- 172.21.15.16:0/2464969542 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb800abc0 con 0x7f2fc00ced40 2023-06-08T04:01:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.316+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2464969542 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc00cbf90 con 0x7f2fc00ced40 2023-06-08T04:01:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.316+0000 7f2fb5ffb700 1 -- 172.21.15.16:0/2464969542 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8012420 con 0x7f2fc00ced40 2023-06-08T04:01:49.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.316+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2464969542 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc00cc550 con 0x7f2fc00ced40 2023-06-08T04:01:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.317+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2464969542 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc00cf1b0 con 0x7f2fc00ced40 2023-06-08T04:01:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.318+0000 7f2fb5ffb700 1 -- 172.21.15.16:0/2464969542 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f2fb8012580 con 0x7f2fc00ced40 2023-06-08T04:01:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.319+0000 7f2fb5ffb700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2fa406ac50 0x7f2fa406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.319+0000 7f2fb5ffb700 1 -- 172.21.15.16:0/2464969542 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f2fb8089140 con 0x7f2fc00ced40 2023-06-08T04:01:49.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.320+0000 7f2fc579b700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2fa406ac50 0x7f2fa406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.320+0000 7f2fc579b700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2fa406ac50 0x7f2fa406d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009130 tx=0x7f2fbc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:49.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.324+0000 7f2fb5ffb700 1 -- 172.21.15.16:0/2464969542 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2fb8054860 con 0x7f2fc00ced40 2023-06-08T04:01:49.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.531+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2464969542 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f2fc0066d50 con 0x7f2fc00ced40 2023-06-08T04:01:49.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.718+0000 7f2fb5ffb700 1 -- 172.21.15.16:0/2464969542 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f2fb8057e80 con 0x7f2fc00ced40 2023-06-08T04:01:49.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.720+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2fa406ac50 msgr2=0x7f2fa406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:49.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.720+0000 7f2fc79ff700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2fa406ac50 0x7f2fa406d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009130 tx=0x7f2fbc008030 comp rx=0 tx=0).stop 2023-06-08T04:01:49.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.720+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2464969542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fc00ced40 msgr2=0x7f2fc00aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:49.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.720+0000 7f2fc79ff700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fc00ced40 0x7f2fc00aab50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800cc10 tx=0x7f2fb800cf20 comp rx=0 tx=0).stop 2023-06-08T04:01:49.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.720+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2464969542 shutdown_connections 2023-06-08T04:01:49.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.720+0000 7f2fc79ff700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2fa406ac50 0x7f2fa406d100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.720+0000 7f2fc79ff700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fc00ced40 0x7f2fc00aab50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.720+0000 7f2fc79ff700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fc00b4b50 0x7f2fc00cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.720+0000 7f2fc79ff700 1 --2- 172.21.15.16:0/2464969542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fc00b83f0 0x7f2fc015a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.720+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2464969542 >> 172.21.15.16:0/2464969542 conn(0x7f2fc00cf610 msgr2=0x7f2fc015aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:49.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.721+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2464969542 shutdown_connections 2023-06-08T04:01:49.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.721+0000 7f2fc79ff700 1 -- 172.21.15.16:0/2464969542 wait complete. 2023-06-08T04:01:49.727 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'rbd' created 2023-06-08T04:01:49.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-08T04:01:49.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.937+0000 7f20287ff700 1 Processor -- start 2023-06-08T04:01:49.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.937+0000 7f20287ff700 1 -- start start 2023-06-08T04:01:49.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.938+0000 7f20287ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f20200b4660 0x7f20200b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.938+0000 7f20287ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2020160300 0x7f20201606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.938+0000 7f20287ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2020161030 con 0x7f20200b1f20 2023-06-08T04:01:49.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.938+0000 7f20287ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20200b5040 con 0x7f2020160300 2023-06-08T04:01:49.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.938+0000 7f20287ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20200b22f0 con 0x7f20200b4660 2023-06-08T04:01:49.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.938+0000 7f2026d9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2020160300 0x7f20201606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.938+0000 7f2026d9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2020160300 0x7f20201606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50876/0 (socket says 172.21.15.16:50876) 2023-06-08T04:01:49.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.938+0000 7f2026d9c700 1 -- 172.21.15.16:0/888705815 learned_addr learned my addr 172.21.15.16:0/888705815 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:49.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.939+0000 7f2025d9a700 1 --2- 172.21.15.16:0/888705815 >> v2:172.21.15.169:3300/0 conn(0x7f20200b4660 0x7f20200b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.939+0000 7f2026d9c700 1 -- 172.21.15.16:0/888705815 >> v2:172.21.15.169:3300/0 conn(0x7f20200b4660 msgr2=0x7f20200b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:49.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.939+0000 7f2026d9c700 1 --2- 172.21.15.16:0/888705815 >> v2:172.21.15.169:3300/0 conn(0x7f20200b4660 0x7f20200b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.939+0000 7f2026d9c700 1 -- 172.21.15.16:0/888705815 >> v1:172.21.15.169:6789/0 conn(0x7f20200b1f20 legacy=0x7f20200d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.939+0000 7f2026d9c700 1 -- 172.21.15.16:0/888705815 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20200d0c10 con 0x7f2020160300 2023-06-08T04:01:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.939+0000 7f2026d9c700 1 --2- 172.21.15.16:0/888705815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2020160300 0x7f20201606d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2020066820 tx=0x7f201800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e435c9b7fdc93369 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.939+0000 7f2025599700 1 -- 172.21.15.16:0/888705815 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201800e070 con 0x7f2020160300 2023-06-08T04:01:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.939+0000 7f2025599700 1 -- 172.21.15.16:0/888705815 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201800b9c0 con 0x7f2020160300 2023-06-08T04:01:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.939+0000 7f2025599700 1 -- 172.21.15.16:0/888705815 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201800bd70 con 0x7f2020160300 2023-06-08T04:01:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.940+0000 7f20287ff700 1 -- 172.21.15.16:0/888705815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2020160300 msgr2=0x7f20201606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:49.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.940+0000 7f20287ff700 1 --2- 172.21.15.16:0/888705815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2020160300 0x7f20201606d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2020066820 tx=0x7f201800b330 comp rx=0 tx=0).stop 2023-06-08T04:01:49.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.940+0000 7f20287ff700 1 -- 172.21.15.16:0/888705815 shutdown_connections 2023-06-08T04:01:49.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.940+0000 7f20287ff700 1 --2- 172.21.15.16:0/888705815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2020160300 0x7f20201606d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.940+0000 7f20287ff700 1 --2- 172.21.15.16:0/888705815 >> v2:172.21.15.169:3300/0 conn(0x7f20200b4660 0x7f20200b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.940+0000 7f20287ff700 1 -- 172.21.15.16:0/888705815 >> 172.21.15.16:0/888705815 conn(0x7f20200cf660 msgr2=0x7f20200cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:49.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.940+0000 7f20287ff700 1 -- 172.21.15.16:0/888705815 shutdown_connections 2023-06-08T04:01:49.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.940+0000 7f20287ff700 1 -- 172.21.15.16:0/888705815 wait complete. 2023-06-08T04:01:49.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.942+0000 7f20287ff700 1 Processor -- start 2023-06-08T04:01:49.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.942+0000 7f20287ff700 1 -- start start 2023-06-08T04:01:49.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f20287ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20200b1f20 0x7f20201f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f20287ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20200b4660 0x7f20201f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f20287ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2020160300 0x7f20200b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f20287ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2020148980 con 0x7f20200b4660 2023-06-08T04:01:49.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f20287ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20201f2cd0 con 0x7f20200b1f20 2023-06-08T04:01:49.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f20287ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202014ac60 con 0x7f2020160300 2023-06-08T04:01:49.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f2025d9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20200b4660 0x7f20201f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f2025d9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20200b4660 0x7f20201f1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50890/0 (socket says 172.21.15.16:50890) 2023-06-08T04:01:49.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f2025d9a700 1 -- 172.21.15.16:0/852364407 learned_addr learned my addr 172.21.15.16:0/852364407 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:49.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f202659b700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20200b1f20 0x7f20201f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f2026d9c700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2020160300 0x7f20200b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.943+0000 7f2025d9a700 1 -- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2020160300 msgr2=0x7f20200b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:49.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.944+0000 7f2025d9a700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2020160300 0x7f20200b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.944+0000 7f2025d9a700 1 -- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20200b1f20 msgr2=0x7f20201f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:49.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.944+0000 7f2025d9a700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20200b1f20 0x7f20201f2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:49.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.944+0000 7f2025d9a700 1 -- 172.21.15.16:0/852364407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2018009b30 con 0x7f20200b4660 2023-06-08T04:01:49.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.944+0000 7f2025d9a700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20200b4660 0x7f20201f1490 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f201000e810 tx=0x7f201000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:49.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.944+0000 7f2016ffd700 1 -- 172.21.15.16:0/852364407 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2010013610 con 0x7f20200b4660 2023-06-08T04:01:49.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.944+0000 7f2016ffd700 1 -- 172.21.15.16:0/852364407 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2010013770 con 0x7f20200b4660 2023-06-08T04:01:49.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.944+0000 7f20287ff700 1 -- 172.21.15.16:0/852364407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202014af40 con 0x7f20200b4660 2023-06-08T04:01:49.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.944+0000 7f2016ffd700 1 -- 172.21.15.16:0/852364407 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2010013b20 con 0x7f20200b4660 2023-06-08T04:01:49.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.944+0000 7f20287ff700 1 -- 172.21.15.16:0/852364407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202014b500 con 0x7f20200b4660 2023-06-08T04:01:49.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.945+0000 7f20287ff700 1 -- 172.21.15.16:0/852364407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20200740e0 con 0x7f20200b4660 2023-06-08T04:01:49.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.946+0000 7f2016ffd700 1 -- 172.21.15.16:0/852364407 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f2010013c80 con 0x7f20200b4660 2023-06-08T04:01:49.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.947+0000 7f2016ffd700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f200406ac50 0x7f200406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:49.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.948+0000 7f2016ffd700 1 -- 172.21.15.16:0/852364407 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4813+0+0 (secure 0 0 0) 0x7f2010088c10 con 0x7f20200b4660 2023-06-08T04:01:49.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.948+0000 7f202659b700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f200406ac50 0x7f200406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.949+0000 7f202659b700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f200406ac50 0x7f200406d100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f201c000f60 tx=0x7f201c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:49.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:49.952+0000 7f2016ffd700 1 -- 172.21.15.16:0/852364407 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f20100541f0 con 0x7f20200b4660 2023-06-08T04:01:50.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.159+0000 7f20287ff700 1 -- 172.21.15.16:0/852364407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f20200cb920 con 0x7f20200b4660 2023-06-08T04:01:50.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.723+0000 7f2016ffd700 1 -- 172.21.15.16:0/852364407 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2010057810 con 0x7f20200b4660 2023-06-08T04:01:50.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.727+0000 7f20287ff700 1 -- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f200406ac50 msgr2=0x7f200406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:50.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.727+0000 7f20287ff700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f200406ac50 0x7f200406d100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f201c000f60 tx=0x7f201c009040 comp rx=0 tx=0).stop 2023-06-08T04:01:50.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.727+0000 7f20287ff700 1 -- 172.21.15.16:0/852364407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20200b4660 msgr2=0x7f20201f1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:50.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.727+0000 7f20287ff700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20200b4660 0x7f20201f1490 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f201000e810 tx=0x7f201000ebd0 comp rx=0 tx=0).stop 2023-06-08T04:01:50.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.727+0000 7f20287ff700 1 -- 172.21.15.16:0/852364407 shutdown_connections 2023-06-08T04:01:50.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.727+0000 7f20287ff700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f200406ac50 0x7f200406d100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:50.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.727+0000 7f20287ff700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2020160300 0x7f20200b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:50.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.727+0000 7f20287ff700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20200b1f20 0x7f20201f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:50.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.727+0000 7f20287ff700 1 --2- 172.21.15.16:0/852364407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20200b4660 0x7f20201f1490 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:50.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.727+0000 7f20287ff700 1 -- 172.21.15.16:0/852364407 >> 172.21.15.16:0/852364407 conn(0x7f20200cf660 msgr2=0x7f20200b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:50.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.727+0000 7f20287ff700 1 -- 172.21.15.16:0/852364407 shutdown_connections 2023-06-08T04:01:50.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.728+0000 7f20287ff700 1 -- 172.21.15.16:0/852364407 wait complete. 2023-06-08T04:01:50.734 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-08T04:01:50.753 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-08T04:01:50.753 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-08T04:01:50.753 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-08T04:01:50.757 INFO:tasks.ceph.mds.a:Started 2023-06-08T04:01:50.758 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-08T04:01:50.758 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-08T04:01:50.762 INFO:tasks.ceph.mds.c:Started 2023-06-08T04:01:50.762 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-08T04:01:50.762 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-08T04:01:50.767 INFO:tasks.ceph.mds.b:Started 2023-06-08T04:01:50.767 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-08T04:01:50.767 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-08T04:01:50.771 INFO:tasks.ceph.mds.d:Started 2023-06-08T04:01:50.771 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-08T04:01:50.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:01:50.915 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2023-06-08T04:01:50.915 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2023-06-08T04:01:50.921 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2023-06-08T04:01:50.922 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2023-06-08T04:01:50.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.987+0000 7f4d917ff700 1 Processor -- start 2023-06-08T04:01:50.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.988+0000 7f4d917ff700 1 -- start start 2023-06-08T04:01:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.989+0000 7f4d917ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d8c160a60 0x7f4d8c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.989+0000 7f4d917ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c0d0800 con 0x7f4d8c0b83f0 2023-06-08T04:01:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.989+0000 7f4d917ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c0cd1e0 con 0x7f4d8c0b4b50 2023-06-08T04:01:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.989+0000 7f4d917ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c160ed0 con 0x7f4d8c160a60 2023-06-08T04:01:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.989+0000 7f4d83fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d8c160a60 0x7f4d8c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.989+0000 7f4d83fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d8c160a60 0x7f4d8c0b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50916/0 (socket says 172.21.15.16:50916) 2023-06-08T04:01:50.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.989+0000 7f4d83fff700 1 -- 172.21.15.16:0/2271912762 learned_addr learned my addr 172.21.15.16:0/2271912762 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.989+0000 7f4d83fff700 1 -- 172.21.15.16:0/2271912762 >> v1:172.21.15.169:6789/0 conn(0x7f4d8c0b4b50 legacy=0x7f4d8c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.989+0000 7f4d83fff700 1 -- 172.21.15.16:0/2271912762 >> v1:172.21.15.16:6789/0 conn(0x7f4d8c0b83f0 legacy=0x7f4d8c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.989+0000 7f4d83fff700 1 -- 172.21.15.16:0/2271912762 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c0cd4c0 con 0x7f4d8c160a60 2023-06-08T04:01:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.990+0000 7f4d83fff700 1 --2- 172.21.15.16:0/2271912762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d8c160a60 0x7f4d8c0b4610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4d740098f0 tx=0x7f4d74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff91ae6b6c86b69 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.990+0000 7f4d8a7fc700 1 -- 172.21.15.16:0/2271912762 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74004230 con 0x7f4d8c160a60 2023-06-08T04:01:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.990+0000 7f4d8a7fc700 1 -- 172.21.15.16:0/2271912762 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d74004390 con 0x7f4d8c160a60 2023-06-08T04:01:50.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.990+0000 7f4d8a7fc700 1 -- 172.21.15.16:0/2271912762 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d740036a0 con 0x7f4d8c160a60 2023-06-08T04:01:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.990+0000 7f4d917ff700 1 -- 172.21.15.16:0/2271912762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d8c160a60 msgr2=0x7f4d8c0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.990+0000 7f4d917ff700 1 --2- 172.21.15.16:0/2271912762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d8c160a60 0x7f4d8c0b4610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4d740098f0 tx=0x7f4d74009c00 comp rx=0 tx=0).stop 2023-06-08T04:01:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.991+0000 7f4d917ff700 1 -- 172.21.15.16:0/2271912762 shutdown_connections 2023-06-08T04:01:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.991+0000 7f4d917ff700 1 --2- 172.21.15.16:0/2271912762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d8c160a60 0x7f4d8c0b4610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.991+0000 7f4d917ff700 1 -- 172.21.15.16:0/2271912762 >> 172.21.15.16:0/2271912762 conn(0x7f4d8c0cf610 msgr2=0x7f4d8c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.991+0000 7f4d917ff700 1 -- 172.21.15.16:0/2271912762 shutdown_connections 2023-06-08T04:01:50.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.991+0000 7f4d917ff700 1 -- 172.21.15.16:0/2271912762 wait complete. 2023-06-08T04:01:50.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.992+0000 7f4d917ff700 1 Processor -- start 2023-06-08T04:01:50.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.993+0000 7f4d917ff700 1 -- start start 2023-06-08T04:01:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.994+0000 7f4d917ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b4b50 0x7f4d8c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.994+0000 7f4d917ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d8c0b83f0 0x7f4d8c1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.994+0000 7f4d917ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d8c160a60 0x7f4d8c0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.994+0000 7f4d917ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0c7a90 con 0x7f4d8c0b83f0 2023-06-08T04:01:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.994+0000 7f4d917ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0c6c00 con 0x7f4d8c160a60 2023-06-08T04:01:50.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.994+0000 7f4d917ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0c6e80 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.994+0000 7f4d8affd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b4b50 0x7f4d8c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.994+0000 7f4d83fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d8c0b83f0 0x7f4d8c1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.994+0000 7f4d8affd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b4b50 0x7f4d8c15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:46298/0 (socket says 172.21.15.16:46298) 2023-06-08T04:01:51.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.994+0000 7f4d8affd700 1 -- 172.21.15.16:0/1848301698 learned_addr learned my addr 172.21.15.16:0/1848301698 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:51.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.994+0000 7f4d8b7fe700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d8c160a60 0x7f4d8c0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.995+0000 7f4d8affd700 1 -- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d8c160a60 msgr2=0x7f4d8c0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.995+0000 7f4d8affd700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d8c160a60 0x7f4d8c0c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.995+0000 7f4d8affd700 1 -- 172.21.15.16:0/1848301698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d8c0b83f0 msgr2=0x7f4d8c1514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.995+0000 7f4d8affd700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d8c0b83f0 0x7f4d8c1514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.995+0000 7f4d8affd700 1 -- 172.21.15.16:0/1848301698 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d74009550 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.995+0000 7f4d83fff700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d8c0b83f0 0x7f4d8c1514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.995+0000 7f4d8affd700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b4b50 0x7f4d8c15f500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00c490 tx=0x7f4d7c00c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.996+0000 7f4d837fe700 1 -- 172.21.15.16:0/1848301698 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00cea0 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.996+0000 7f4d837fe700 1 -- 172.21.15.16:0/1848301698 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c0052f0 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.996+0000 7f4d837fe700 1 -- 172.21.15.16:0/1848301698 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c006860 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.996+0000 7f4d917ff700 1 -- 172.21.15.16:0/1848301698 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c0c7160 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.996+0000 7f4d917ff700 1 -- 172.21.15.16:0/1848301698 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c0c7720 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.998+0000 7f4d917ff700 1 -- 172.21.15.16:0/1848301698 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c0740e0 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:50.999+0000 7f4d837fe700 1 -- 172.21.15.16:0/1848301698 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f4d7c003680 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.000+0000 7f4d837fe700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d6c06acd0 0x7f4d6c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.000+0000 7f4d837fe700 1 -- 172.21.15.16:0/1848301698 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f4d7c088100 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.001+0000 7f4d83fff700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d6c06acd0 0x7f4d6c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.001+0000 7f4d83fff700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d6c06acd0 0x7f4d6c06d180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009130 tx=0x7f4d74008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:51.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.006+0000 7f4d837fe700 1 -- 172.21.15.16:0/1848301698 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4d7c0536d0 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.214+0000 7f4d917ff700 1 -- 172.21.15.16:0/1848301698 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d8c0cfcc0 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.216+0000 7f4d837fe700 1 -- 172.21.15.16:0/1848301698 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+14573 (secure 0 0 0) 0x7f4d7c056cf0 con 0x7f4d8c0b4b50 2023-06-08T04:01:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:51.220 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":15,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:50.718021+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:01:51.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.217+0000 7f4d917ff700 1 -- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d6c06acd0 msgr2=0x7f4d6c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.217+0000 7f4d917ff700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d6c06acd0 0x7f4d6c06d180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009130 tx=0x7f4d74008030 comp rx=0 tx=0).stop 2023-06-08T04:01:51.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.217+0000 7f4d917ff700 1 -- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b4b50 msgr2=0x7f4d8c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.217+0000 7f4d917ff700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b4b50 0x7f4d8c15f500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00c490 tx=0x7f4d7c00c7a0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.217+0000 7f4d917ff700 1 -- 172.21.15.16:0/1848301698 shutdown_connections 2023-06-08T04:01:51.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.217+0000 7f4d917ff700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d6c06acd0 0x7f4d6c06d180 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.217+0000 7f4d917ff700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d8c160a60 0x7f4d8c0c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.217+0000 7f4d917ff700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d8c0b4b50 0x7f4d8c15f500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.217+0000 7f4d917ff700 1 --2- 172.21.15.16:0/1848301698 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d8c0b83f0 0x7f4d8c1514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.217+0000 7f4d917ff700 1 -- 172.21.15.16:0/1848301698 >> 172.21.15.16:0/1848301698 conn(0x7f4d8c0cf610 msgr2=0x7f4d8c0d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:51.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.217+0000 7f4d917ff700 1 -- 172.21.15.16:0/1848301698 shutdown_connections 2023-06-08T04:01:51.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.218+0000 7f4d917ff700 1 -- 172.21.15.16:0/1848301698 wait complete. 2023-06-08T04:01:51.240 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:01:51.241 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:01:51.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.439+0000 7f43dafff700 1 Processor -- start 2023-06-08T04:01:51.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.440+0000 7f43dafff700 1 -- start start 2023-06-08T04:01:51.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.440+0000 7f43dafff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4160a60 0x7f43d40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.440+0000 7f43dafff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40d0800 con 0x7f43d40b83f0 2023-06-08T04:01:51.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.440+0000 7f43dafff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40cd1e0 con 0x7f43d40b4b50 2023-06-08T04:01:51.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.440+0000 7f43dafff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4160ed0 con 0x7f43d4160a60 2023-06-08T04:01:51.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.440+0000 7f43d8d9b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f43d40b83f0 0x7f43d40ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:56188/0 (socket says 172.21.15.16:56188) 2023-06-08T04:01:51.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.440+0000 7f43d8d9b700 1 -- 172.21.15.16:0/4041333163 learned_addr learned my addr 172.21.15.16:0/4041333163 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:01:51.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.440+0000 7f43d3fff700 1 --2- 172.21.15.16:0/4041333163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4160a60 0x7f43d40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.440+0000 7f43d37fe700 1 -- 172.21.15.16:0/4041333163 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324134495 0 0) 0x7f43d40d0800 con 0x7f43d40b83f0 2023-06-08T04:01:51.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.440+0000 7f43d37fe700 1 -- 172.21.15.16:0/4041333163 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43c40035b0 con 0x7f43d40b83f0 2023-06-08T04:01:51.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.442+0000 7f43d37fe700 1 -- 172.21.15.16:0/4041333163 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789769523 0 0) 0x7f43d40cd1e0 con 0x7f43d40b4b50 2023-06-08T04:01:51.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.442+0000 7f43d37fe700 1 -- 172.21.15.16:0/4041333163 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d40d0800 con 0x7f43d40b4b50 2023-06-08T04:01:51.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.442+0000 7f43d3fff700 1 -- 172.21.15.16:0/4041333163 >> v1:172.21.15.169:6789/0 conn(0x7f43d40b4b50 legacy=0x7f43d40d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.442+0000 7f43d3fff700 1 -- 172.21.15.16:0/4041333163 >> v1:172.21.15.16:6789/0 conn(0x7f43d40b83f0 legacy=0x7f43d40ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.442+0000 7f43d37fe700 1 -- 172.21.15.16:0/4041333163 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 976916419 0 0) 0x7f43c40035b0 con 0x7f43d40b83f0 2023-06-08T04:01:51.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.442+0000 7f43d3fff700 1 -- 172.21.15.16:0/4041333163 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40cd4c0 con 0x7f43d4160a60 2023-06-08T04:01:51.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.442+0000 7f43d3fff700 1 --2- 172.21.15.16:0/4041333163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4160a60 0x7f43d40b4610 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009870 tx=0x7f43c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ccb9bb4e38abbb server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:51.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.442+0000 7f43d37fe700 1 -- 172.21.15.16:0/4041333163 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8001670 con 0x7f43d4160a60 2023-06-08T04:01:51.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.442+0000 7f43d37fe700 1 -- 172.21.15.16:0/4041333163 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0004030 con 0x7f43d4160a60 2023-06-08T04:01:51.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.442+0000 7f43d37fe700 1 -- 172.21.15.16:0/4041333163 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00043c0 con 0x7f43d4160a60 2023-06-08T04:01:51.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.443+0000 7f43dafff700 1 -- 172.21.15.16:0/4041333163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4160a60 msgr2=0x7f43d40b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.443+0000 7f43dafff700 1 --2- 172.21.15.16:0/4041333163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4160a60 0x7f43d40b4610 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009870 tx=0x7f43c0009b80 comp rx=0 tx=0).stop 2023-06-08T04:01:51.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.443+0000 7f43dafff700 1 -- 172.21.15.16:0/4041333163 shutdown_connections 2023-06-08T04:01:51.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.443+0000 7f43dafff700 1 --2- 172.21.15.16:0/4041333163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4160a60 0x7f43d40b4610 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.443+0000 7f43dafff700 1 -- 172.21.15.16:0/4041333163 >> 172.21.15.16:0/4041333163 conn(0x7f43d40cf610 msgr2=0x7f43d40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:51.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.443+0000 7f43dafff700 1 -- 172.21.15.16:0/4041333163 shutdown_connections 2023-06-08T04:01:51.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.443+0000 7f43dafff700 1 -- 172.21.15.16:0/4041333163 wait complete. 2023-06-08T04:01:51.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.445+0000 7f43dafff700 1 Processor -- start 2023-06-08T04:01:51.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.445+0000 7f43dafff700 1 -- start start 2023-06-08T04:01:51.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43dafff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40b4b50 0x7f43d40c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43dafff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d40b83f0 0x7f43d4151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43dafff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4160a60 0x7f43d40ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43dafff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41f2cb0 con 0x7f43d40b83f0 2023-06-08T04:01:51.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43dafff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41f2130 con 0x7f43d40b4b50 2023-06-08T04:01:51.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43dafff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41f2410 con 0x7f43d4160a60 2023-06-08T04:01:51.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43d3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d40b83f0 0x7f43d4151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43d3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d40b83f0 0x7f43d4151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50942/0 (socket says 172.21.15.16:50942) 2023-06-08T04:01:51.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43d3fff700 1 -- 172.21.15.16:0/828974650 learned_addr learned my addr 172.21.15.16:0/828974650 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:51.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43d8d9b700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40b4b50 0x7f43d40c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43d959c700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4160a60 0x7f43d40ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43d3fff700 1 -- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4160a60 msgr2=0x7f43d40ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43d3fff700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4160a60 0x7f43d40ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43d3fff700 1 -- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40b4b50 msgr2=0x7f43d40c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43d3fff700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40b4b50 0x7f43d40c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.446+0000 7f43d3fff700 1 -- 172.21.15.16:0/828974650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c00094a0 con 0x7f43d40b83f0 2023-06-08T04:01:51.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.447+0000 7f43d3fff700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d40b83f0 0x7f43d4151060 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43c0000c00 tx=0x7f43c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:51.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.447+0000 7f43d17fa700 1 -- 172.21.15.16:0/828974650 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011630 con 0x7f43d40b83f0 2023-06-08T04:01:51.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.447+0000 7f43d17fa700 1 -- 172.21.15.16:0/828974650 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c001f070 con 0x7f43d40b83f0 2023-06-08T04:01:51.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.447+0000 7f43dafff700 1 -- 172.21.15.16:0/828974650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d41f26f0 con 0x7f43d40b83f0 2023-06-08T04:01:51.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.447+0000 7f43d17fa700 1 -- 172.21.15.16:0/828974650 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00119f0 con 0x7f43d40b83f0 2023-06-08T04:01:51.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.447+0000 7f43dafff700 1 -- 172.21.15.16:0/828974650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d41515a0 con 0x7f43d40b83f0 2023-06-08T04:01:51.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.448+0000 7f43dafff700 1 -- 172.21.15.16:0/828974650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d40740e0 con 0x7f43d40b83f0 2023-06-08T04:01:51.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.449+0000 7f43d17fa700 1 -- 172.21.15.16:0/828974650 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f43c0011b50 con 0x7f43d40b83f0 2023-06-08T04:01:51.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.450+0000 7f43d17fa700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f43b806ac50 0x7f43b806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.450+0000 7f43d17fa700 1 -- 172.21.15.16:0/828974650 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f43c0021070 con 0x7f43d40b83f0 2023-06-08T04:01:51.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.451+0000 7f43d8d9b700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f43b806ac50 0x7f43b806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.451+0000 7f43d8d9b700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f43b806ac50 0x7f43b806d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f43c8001380 tx=0x7f43c80015f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:51.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.455+0000 7f43d17fa700 1 -- 172.21.15.16:0/828974650 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43c0055ed0 con 0x7f43d40b83f0 2023-06-08T04:01:51.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.659+0000 7f43dafff700 1 -- 172.21.15.16:0/828974650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43d40c9250 con 0x7f43d40b83f0 2023-06-08T04:01:51.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.659+0000 7f43d17fa700 1 -- 172.21.15.16:0/828974650 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f43c00594f0 con 0x7f43d40b83f0 2023-06-08T04:01:51.663 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:01:51.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.661+0000 7f43dafff700 1 -- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f43b806ac50 msgr2=0x7f43b806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.661+0000 7f43dafff700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f43b806ac50 0x7f43b806d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f43c8001380 tx=0x7f43c80015f0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.661+0000 7f43dafff700 1 -- 172.21.15.16:0/828974650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d40b83f0 msgr2=0x7f43d4151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.661+0000 7f43dafff700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d40b83f0 0x7f43d4151060 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43c0000c00 tx=0x7f43c0004750 comp rx=0 tx=0).stop 2023-06-08T04:01:51.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.661+0000 7f43dafff700 1 -- 172.21.15.16:0/828974650 shutdown_connections 2023-06-08T04:01:51.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.661+0000 7f43dafff700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f43b806ac50 0x7f43b806d100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.661+0000 7f43dafff700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4160a60 0x7f43d40ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.661+0000 7f43dafff700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40b4b50 0x7f43d40c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.661+0000 7f43dafff700 1 --2- 172.21.15.16:0/828974650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d40b83f0 0x7f43d4151060 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.661+0000 7f43dafff700 1 -- 172.21.15.16:0/828974650 >> 172.21.15.16:0/828974650 conn(0x7f43d40cf610 msgr2=0x7f43d40b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.662+0000 7f43dafff700 1 -- 172.21.15.16:0/828974650 shutdown_connections 2023-06-08T04:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.662+0000 7f43dafff700 1 -- 172.21.15.16:0/828974650 wait complete. 2023-06-08T04:01:51.683 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:01:51.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.893+0000 7efe3edff700 1 Processor -- start 2023-06-08T04:01:51.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.893+0000 7efe3edff700 1 -- start start 2023-06-08T04:01:51.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.894+0000 7efe3edff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efe380b83f0 0x7efe38160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.894+0000 7efe3edff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe380b4d20 0x7efe380d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.894+0000 7efe3edff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe380d0800 con 0x7efe380ced40 2023-06-08T04:01:51.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.894+0000 7efe3edff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe380cd1e0 con 0x7efe380b83f0 2023-06-08T04:01:51.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.894+0000 7efe3edff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe380cd4c0 con 0x7efe380b4d20 2023-06-08T04:01:51.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.895+0000 7efe37fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7efe380ced40 0x7efe380b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:56198/0 (socket says 172.21.15.16:56198) 2023-06-08T04:01:51.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.895+0000 7efe37fff700 1 -- 172.21.15.16:0/2182821336 learned_addr learned my addr 172.21.15.16:0/2182821336 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:01:51.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.895+0000 7efe3d39c700 1 --2- 172.21.15.16:0/2182821336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe380b4d20 0x7efe380d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.895+0000 7efe3cb9b700 1 --2- 172.21.15.16:0/2182821336 >> v2:172.21.15.169:3300/0 conn(0x7efe380b83f0 0x7efe38160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.895+0000 7efe377fe700 1 -- 172.21.15.16:0/2182821336 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022828583 0 0) 0x7efe380d0800 con 0x7efe380ced40 2023-06-08T04:01:51.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.895+0000 7efe377fe700 1 -- 172.21.15.16:0/2182821336 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe280035b0 con 0x7efe380ced40 2023-06-08T04:01:51.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.895+0000 7efe3d39c700 1 -- 172.21.15.16:0/2182821336 >> v2:172.21.15.169:3300/0 conn(0x7efe380b83f0 msgr2=0x7efe38160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:51.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.895+0000 7efe3d39c700 1 --2- 172.21.15.16:0/2182821336 >> v2:172.21.15.169:3300/0 conn(0x7efe380b83f0 0x7efe38160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.895+0000 7efe3d39c700 1 -- 172.21.15.16:0/2182821336 >> v1:172.21.15.16:6789/0 conn(0x7efe380ced40 legacy=0x7efe380b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.895+0000 7efe3d39c700 1 -- 172.21.15.16:0/2182821336 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe380d0aa0 con 0x7efe380b4d20 2023-06-08T04:01:51.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.895+0000 7efe3cb9b700 1 --2- 172.21.15.16:0/2182821336 >> v2:172.21.15.169:3300/0 conn(0x7efe380b83f0 0x7efe38160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:51.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.896+0000 7efe3d39c700 1 --2- 172.21.15.16:0/2182821336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe380b4d20 0x7efe380d0fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efe30009d90 tx=0x7efe3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3668fded7487f44 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:51.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.896+0000 7efe377fe700 1 -- 172.21.15.16:0/2182821336 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3000e070 con 0x7efe380b4d20 2023-06-08T04:01:51.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.896+0000 7efe377fe700 1 -- 172.21.15.16:0/2182821336 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3000bb20 con 0x7efe380b4d20 2023-06-08T04:01:51.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.896+0000 7efe377fe700 1 -- 172.21.15.16:0/2182821336 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30012430 con 0x7efe380b4d20 2023-06-08T04:01:51.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.896+0000 7efe3edff700 1 -- 172.21.15.16:0/2182821336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe380b4d20 msgr2=0x7efe380d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.896+0000 7efe3edff700 1 --2- 172.21.15.16:0/2182821336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe380b4d20 0x7efe380d0fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efe30009d90 tx=0x7efe3000b330 comp rx=0 tx=0).stop 2023-06-08T04:01:51.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.896+0000 7efe3edff700 1 -- 172.21.15.16:0/2182821336 shutdown_connections 2023-06-08T04:01:51.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.896+0000 7efe3edff700 1 --2- 172.21.15.16:0/2182821336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe380b4d20 0x7efe380d0fc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.896+0000 7efe3edff700 1 --2- 172.21.15.16:0/2182821336 >> v2:172.21.15.169:3300/0 conn(0x7efe380b83f0 0x7efe38160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.896+0000 7efe3edff700 1 -- 172.21.15.16:0/2182821336 >> 172.21.15.16:0/2182821336 conn(0x7efe380cf610 msgr2=0x7efe380cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:51.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.897+0000 7efe3edff700 1 -- 172.21.15.16:0/2182821336 shutdown_connections 2023-06-08T04:01:51.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.897+0000 7efe3edff700 1 -- 172.21.15.16:0/2182821336 wait complete. 2023-06-08T04:01:51.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.898+0000 7efe3edff700 1 Processor -- start 2023-06-08T04:01:51.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.898+0000 7efe3edff700 1 -- start start 2023-06-08T04:01:51.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.899+0000 7efe3edff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe380b4d20 0x7efe3814c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.899+0000 7efe3edff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe380b83f0 0x7efe380a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.899+0000 7efe3edff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe380ced40 0x7efe380c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.899+0000 7efe3edff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe38149b10 con 0x7efe380b4d20 2023-06-08T04:01:51.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.899+0000 7efe3edff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3814c790 con 0x7efe380b83f0 2023-06-08T04:01:51.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.899+0000 7efe3edff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe38148f00 con 0x7efe380ced40 2023-06-08T04:01:51.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.900+0000 7efe3cb9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe380b4d20 0x7efe3814c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.900+0000 7efe3cb9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe380b4d20 0x7efe3814c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50956/0 (socket says 172.21.15.16:50956) 2023-06-08T04:01:51.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.900+0000 7efe3cb9b700 1 -- 172.21.15.16:0/797279592 learned_addr learned my addr 172.21.15.16:0/797279592 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:51.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.900+0000 7efe37fff700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe380b83f0 0x7efe380a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.900+0000 7efe3d39c700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe380ced40 0x7efe380c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.900+0000 7efe3cb9b700 1 -- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe380ced40 msgr2=0x7efe380c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.900+0000 7efe3cb9b700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe380ced40 0x7efe380c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.900+0000 7efe3cb9b700 1 -- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe380b83f0 msgr2=0x7efe380a9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:51.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.900+0000 7efe3cb9b700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe380b83f0 0x7efe380a9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:51.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.900+0000 7efe3cb9b700 1 -- 172.21.15.16:0/797279592 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c0094a0 con 0x7efe380b4d20 2023-06-08T04:01:51.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.900+0000 7efe3cb9b700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe380b4d20 0x7efe3814c250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00ec10 tx=0x7efe2c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:51.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.901+0000 7efe357fa700 1 -- 172.21.15.16:0/797279592 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00c850 con 0x7efe380b4d20 2023-06-08T04:01:51.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.901+0000 7efe357fa700 1 -- 172.21.15.16:0/797279592 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c00c9b0 con 0x7efe380b4d20 2023-06-08T04:01:51.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.901+0000 7efe357fa700 1 -- 172.21.15.16:0/797279592 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00cd20 con 0x7efe380b4d20 2023-06-08T04:01:51.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.901+0000 7efe3edff700 1 -- 172.21.15.16:0/797279592 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe30009a70 con 0x7efe380b4d20 2023-06-08T04:01:51.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.901+0000 7efe3edff700 1 -- 172.21.15.16:0/797279592 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe381494c0 con 0x7efe380b4d20 2023-06-08T04:01:51.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.902+0000 7efe3edff700 1 -- 172.21.15.16:0/797279592 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe380740e0 con 0x7efe380b4d20 2023-06-08T04:01:51.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.903+0000 7efe357fa700 1 -- 172.21.15.16:0/797279592 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7efe2c013470 con 0x7efe380b4d20 2023-06-08T04:01:51.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.904+0000 7efe357fa700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe1c06ac50 0x7efe1c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:51.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.904+0000 7efe357fa700 1 -- 172.21.15.16:0/797279592 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efe2c089100 con 0x7efe380b4d20 2023-06-08T04:01:51.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.905+0000 7efe37fff700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe1c06ac50 0x7efe1c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:51.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.905+0000 7efe37fff700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe1c06ac50 0x7efe1c06d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efe380b1760 tx=0x7efe24007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:51.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:51.909+0000 7efe357fa700 1 -- 172.21.15.16:0/797279592 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efe2c0545d0 con 0x7efe380b4d20 2023-06-08T04:01:52.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.122+0000 7efe3edff700 1 -- 172.21.15.16:0/797279592 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe3806a220 con 0x7efe380b4d20 2023-06-08T04:01:52.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.122+0000 7efe357fa700 1 -- 172.21.15.16:0/797279592 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe2c057bf0 con 0x7efe380b4d20 2023-06-08T04:01:52.127 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:01:52.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.124+0000 7efe3edff700 1 -- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe1c06ac50 msgr2=0x7efe1c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.124+0000 7efe3edff700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe1c06ac50 0x7efe1c06d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efe380b1760 tx=0x7efe24007dc0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.124+0000 7efe3edff700 1 -- 172.21.15.16:0/797279592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe380b4d20 msgr2=0x7efe3814c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.124+0000 7efe3edff700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe380b4d20 0x7efe3814c250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00ec10 tx=0x7efe2c00ef20 comp rx=0 tx=0).stop 2023-06-08T04:01:52.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.124+0000 7efe3edff700 1 -- 172.21.15.16:0/797279592 shutdown_connections 2023-06-08T04:01:52.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.124+0000 7efe3edff700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe1c06ac50 0x7efe1c06d100 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.124+0000 7efe3edff700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe380ced40 0x7efe380c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.124+0000 7efe3edff700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe380b4d20 0x7efe3814c250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.125+0000 7efe3edff700 1 --2- 172.21.15.16:0/797279592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe380b83f0 0x7efe380a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.125+0000 7efe3edff700 1 -- 172.21.15.16:0/797279592 >> 172.21.15.16:0/797279592 conn(0x7efe380cf610 msgr2=0x7efe380b72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:52.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.125+0000 7efe3edff700 1 -- 172.21.15.16:0/797279592 shutdown_connections 2023-06-08T04:01:52.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.125+0000 7efe3edff700 1 -- 172.21.15.16:0/797279592 wait complete. 2023-06-08T04:01:52.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T04:01:52.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.347+0000 7fcf9f9ff700 1 Processor -- start 2023-06-08T04:01:52.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.347+0000 7fcf9f9ff700 1 -- start start 2023-06-08T04:01:52.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.349+0000 7fcf9f9ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf9815fb60 0x7fcf980c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.349+0000 7fcf9f9ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcf9806a4c0 0x7fcf980cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.349+0000 7fcf9f9ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf980af3f0 con 0x7fcf980b0940 2023-06-08T04:01:52.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.349+0000 7fcf9f9ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf980b0e40 con 0x7fcf9806a4c0 2023-06-08T04:01:52.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.349+0000 7fcf9f9ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf980af1e0 con 0x7fcf9815fb60 2023-06-08T04:01:52.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf9df9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcf9806a4c0 0x7fcf980cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf9d79b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf9815fb60 0x7fcf980c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf9df9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcf9806a4c0 0x7fcf980cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:51686/0 (socket says 172.21.15.16:51686) 2023-06-08T04:01:52.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf9cf9a700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fcf980b0940 0x7fcf98069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:49974/0 (socket says 172.21.15.16:49974) 2023-06-08T04:01:52.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf9df9c700 1 -- 172.21.15.16:0/2136198651 learned_addr learned my addr 172.21.15.16:0/2136198651 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:52.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf9d79b700 1 -- 172.21.15.16:0/2136198651 >> v2:172.21.15.169:3300/0 conn(0x7fcf9806a4c0 msgr2=0x7fcf980cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:52.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf9d79b700 1 --2- 172.21.15.16:0/2136198651 >> v2:172.21.15.169:3300/0 conn(0x7fcf9806a4c0 0x7fcf980cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf9d79b700 1 -- 172.21.15.16:0/2136198651 >> v1:172.21.15.169:6789/0 conn(0x7fcf980b0940 legacy=0x7fcf98069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf9d79b700 1 -- 172.21.15.16:0/2136198651 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf980af6d0 con 0x7fcf9815fb60 2023-06-08T04:01:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf9df9c700 1 --2- 172.21.15.16:0/2136198651 >> v2:172.21.15.169:3300/0 conn(0x7fcf9806a4c0 0x7fcf980cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf8ffff700 1 -- 172.21.15.16:0/2136198651 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137337806 0 0) 0x7fcf980af3f0 con 0x7fcf980b0940 2023-06-08T04:01:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.350+0000 7fcf9d79b700 1 --2- 172.21.15.16:0/2136198651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf9815fb60 0x7fcf980c9ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009840 tx=0x7fcf94009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99fdd41766e9becb server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.351+0000 7fcf8ffff700 1 -- 172.21.15.16:0/2136198651 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94011830 con 0x7fcf9815fb60 2023-06-08T04:01:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.351+0000 7fcf8ffff700 1 -- 172.21.15.16:0/2136198651 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf94011990 con 0x7fcf9815fb60 2023-06-08T04:01:52.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.351+0000 7fcf8ffff700 1 -- 172.21.15.16:0/2136198651 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94011d20 con 0x7fcf9815fb60 2023-06-08T04:01:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.351+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/2136198651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf9815fb60 msgr2=0x7fcf980c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.351+0000 7fcf9f9ff700 1 --2- 172.21.15.16:0/2136198651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf9815fb60 0x7fcf980c9ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009840 tx=0x7fcf94009b50 comp rx=0 tx=0).stop 2023-06-08T04:01:52.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.351+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/2136198651 shutdown_connections 2023-06-08T04:01:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.351+0000 7fcf9f9ff700 1 --2- 172.21.15.16:0/2136198651 >> v2:172.21.15.169:3300/0 conn(0x7fcf9806a4c0 0x7fcf980cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.351+0000 7fcf9f9ff700 1 --2- 172.21.15.16:0/2136198651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf9815fb60 0x7fcf980c9ed0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.351+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/2136198651 >> 172.21.15.16:0/2136198651 conn(0x7fcf98098a50 msgr2=0x7fcf980cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.352+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/2136198651 shutdown_connections 2023-06-08T04:01:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.352+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/2136198651 wait complete. 2023-06-08T04:01:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.353+0000 7fcf9f9ff700 1 Processor -- start 2023-06-08T04:01:52.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.353+0000 7fcf9f9ff700 1 -- start start 2023-06-08T04:01:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.354+0000 7fcf9f9ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf9806a4c0 0x7fcf980b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.354+0000 7fcf9f9ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf980b0940 0x7fcf981f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.354+0000 7fcf9f9ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9815fb60 0x7fcf981f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.354+0000 7fcf9f9ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf980b5090 con 0x7fcf9815fb60 2023-06-08T04:01:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.354+0000 7fcf9f9ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf980b4ad0 con 0x7fcf9806a4c0 2023-06-08T04:01:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.354+0000 7fcf9f9ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf980b4db0 con 0x7fcf980b0940 2023-06-08T04:01:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.355+0000 7fcf9df9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9815fb60 0x7fcf981f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.355+0000 7fcf9df9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9815fb60 0x7fcf981f5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37702/0 (socket says 172.21.15.16:37702) 2023-06-08T04:01:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.355+0000 7fcf9df9c700 1 -- 172.21.15.16:0/3591050255 learned_addr learned my addr 172.21.15.16:0/3591050255 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.355+0000 7fcf9d79b700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf9806a4c0 0x7fcf980b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.355+0000 7fcf9cf9a700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf980b0940 0x7fcf981f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.355+0000 7fcf9df9c700 1 -- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf980b0940 msgr2=0x7fcf981f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.355+0000 7fcf9df9c700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf980b0940 0x7fcf981f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.355+0000 7fcf9df9c700 1 -- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf9806a4c0 msgr2=0x7fcf980b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.355+0000 7fcf9df9c700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf9806a4c0 0x7fcf980b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.355+0000 7fcf9df9c700 1 -- 172.21.15.16:0/3591050255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf90009b30 con 0x7fcf9815fb60 2023-06-08T04:01:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.356+0000 7fcf9df9c700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9815fb60 0x7fcf981f5c80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000ef90 tx=0x7fcf9000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.356+0000 7fcf8dffb700 1 -- 172.21.15.16:0/3591050255 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90018070 con 0x7fcf9815fb60 2023-06-08T04:01:52.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.356+0000 7fcf8dffb700 1 -- 172.21.15.16:0/3591050255 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9000f040 con 0x7fcf9815fb60 2023-06-08T04:01:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.356+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/3591050255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf940094a0 con 0x7fcf9815fb60 2023-06-08T04:01:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.356+0000 7fcf8dffb700 1 -- 172.21.15.16:0/3591050255 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf90003c60 con 0x7fcf9815fb60 2023-06-08T04:01:52.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.356+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/3591050255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9814c230 con 0x7fcf9815fb60 2023-06-08T04:01:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.357+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/3591050255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf980b1060 con 0x7fcf9815fb60 2023-06-08T04:01:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.358+0000 7fcf8dffb700 1 -- 172.21.15.16:0/3591050255 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fcf9000c880 con 0x7fcf9815fb60 2023-06-08T04:01:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.359+0000 7fcf8dffb700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fcf7c06ac50 0x7fcf7c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.359+0000 7fcf8dffb700 1 -- 172.21.15.16:0/3591050255 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcf90089180 con 0x7fcf9815fb60 2023-06-08T04:01:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.359+0000 7fcf9d79b700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fcf7c06ac50 0x7fcf7c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.360+0000 7fcf9d79b700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fcf7c06ac50 0x7fcf7c06d100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf940090b0 tx=0x7fcf94008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:52.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.364+0000 7fcf8dffb700 1 -- 172.21.15.16:0/3591050255 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf90054650 con 0x7fcf9815fb60 2023-06-08T04:01:52.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.627+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/3591050255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf980740e0 con 0x7fcf9815fb60 2023-06-08T04:01:52.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.628+0000 7fcf8dffb700 1 -- 172.21.15.16:0/3591050255 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7fcf90057c70 con 0x7fcf9815fb60 2023-06-08T04:01:52.632 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:52.632 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3633702519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3633702519},{"type":"v1","addr":"172.21.15.16:6834","nonce":3633702519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/711045362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":711045362},{"type":"v1","addr":"172.21.15.169:6837","nonce":711045362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1926912680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1926912680},{"type":"v1","addr":"172.21.15.16:6835","nonce":1926912680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6836/1286012043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1286012043},{"type":"v1","addr":"172.21.15.169:6836","nonce":1286012043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-08T04:01:52.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.630+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fcf7c06ac50 msgr2=0x7fcf7c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.630+0000 7fcf9f9ff700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fcf7c06ac50 0x7fcf7c06d100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf940090b0 tx=0x7fcf94008030 comp rx=0 tx=0).stop 2023-06-08T04:01:52.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.630+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/3591050255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9815fb60 msgr2=0x7fcf981f5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.630+0000 7fcf9f9ff700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9815fb60 0x7fcf981f5c80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000ef90 tx=0x7fcf9000c3a0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.631+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/3591050255 shutdown_connections 2023-06-08T04:01:52.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.631+0000 7fcf9f9ff700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fcf7c06ac50 0x7fcf7c06d100 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.631+0000 7fcf9f9ff700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf9815fb60 0x7fcf981f5c80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.631+0000 7fcf9f9ff700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcf9806a4c0 0x7fcf980b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.631+0000 7fcf9f9ff700 1 --2- 172.21.15.16:0/3591050255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcf980b0940 0x7fcf981f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.631+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/3591050255 >> 172.21.15.16:0/3591050255 conn(0x7fcf98098a50 msgr2=0x7fcf980cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:52.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.631+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/3591050255 shutdown_connections 2023-06-08T04:01:52.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.631+0000 7fcf9f9ff700 1 -- 172.21.15.16:0/3591050255 wait complete. 2023-06-08T04:01:52.636 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 3 2023-06-08T04:01:52.652 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:01:52.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.854+0000 7f963b1ff700 1 Processor -- start 2023-06-08T04:01:52.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.854+0000 7f963b1ff700 1 -- start start 2023-06-08T04:01:52.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.855+0000 7f963b1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96340b83f0 0x7f9634160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.855+0000 7f963b1ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f96340b4d20 0x7f96340d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.855+0000 7f963b1ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96340d0800 con 0x7f96340ced40 2023-06-08T04:01:52.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.855+0000 7f963b1ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96340cd1e0 con 0x7f96340b4d20 2023-06-08T04:01:52.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.855+0000 7f963b1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96340cd4c0 con 0x7f96340b83f0 2023-06-08T04:01:52.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.856+0000 7f963979c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f96340b4d20 0x7f96340d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.856+0000 7f9638f9b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96340b83f0 0x7f9634160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.856+0000 7f9633fff700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f96340ced40 0x7f96340b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:49986/0 (socket says 172.21.15.16:49986) 2023-06-08T04:01:52.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.856+0000 7f9633fff700 1 -- 172.21.15.16:0/853618905 learned_addr learned my addr 172.21.15.16:0/853618905 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:01:52.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.856+0000 7f9638f9b700 1 -- 172.21.15.16:0/853618905 >> v2:172.21.15.16:3300/0 conn(0x7f96340b4d20 msgr2=0x7f96340d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:52.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.856+0000 7f9638f9b700 1 --2- 172.21.15.16:0/853618905 >> v2:172.21.15.16:3300/0 conn(0x7f96340b4d20 0x7f96340d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.856+0000 7f9638f9b700 1 -- 172.21.15.16:0/853618905 >> v1:172.21.15.169:6789/0 conn(0x7f96340ced40 legacy=0x7f96340b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.856+0000 7f9638f9b700 1 -- 172.21.15.16:0/853618905 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340d0aa0 con 0x7f96340b83f0 2023-06-08T04:01:52.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.856+0000 7f96337fe700 1 -- 172.21.15.16:0/853618905 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754264215 0 0) 0x7f96340d0800 con 0x7f96340ced40 2023-06-08T04:01:52.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.856+0000 7f963979c700 1 --2- 172.21.15.16:0/853618905 >> v2:172.21.15.16:3300/0 conn(0x7f96340b4d20 0x7f96340d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:52.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.857+0000 7f9638f9b700 1 --2- 172.21.15.16:0/853618905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96340b83f0 0x7f9634160a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9628009840 tx=0x7f9628009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e32c8c1176912cb8 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:52.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.857+0000 7f96337fe700 1 -- 172.21.15.16:0/853618905 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628011830 con 0x7f96340b83f0 2023-06-08T04:01:52.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.857+0000 7f96337fe700 1 -- 172.21.15.16:0/853618905 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9628011990 con 0x7f96340b83f0 2023-06-08T04:01:52.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.857+0000 7f96337fe700 1 -- 172.21.15.16:0/853618905 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628011d20 con 0x7f96340b83f0 2023-06-08T04:01:52.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.857+0000 7f963b1ff700 1 -- 172.21.15.16:0/853618905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96340b83f0 msgr2=0x7f9634160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.857+0000 7f963b1ff700 1 --2- 172.21.15.16:0/853618905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96340b83f0 0x7f9634160a60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9628009840 tx=0x7f9628009b50 comp rx=0 tx=0).stop 2023-06-08T04:01:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.857+0000 7f963b1ff700 1 -- 172.21.15.16:0/853618905 shutdown_connections 2023-06-08T04:01:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.857+0000 7f963b1ff700 1 --2- 172.21.15.16:0/853618905 >> v2:172.21.15.16:3300/0 conn(0x7f96340b4d20 0x7f96340d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.857+0000 7f963b1ff700 1 --2- 172.21.15.16:0/853618905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96340b83f0 0x7f9634160a60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.857+0000 7f963b1ff700 1 -- 172.21.15.16:0/853618905 >> 172.21.15.16:0/853618905 conn(0x7f96340cf610 msgr2=0x7f96340cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.857+0000 7f963b1ff700 1 -- 172.21.15.16:0/853618905 shutdown_connections 2023-06-08T04:01:52.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.858+0000 7f963b1ff700 1 -- 172.21.15.16:0/853618905 wait complete. 2023-06-08T04:01:52.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.859+0000 7f963b1ff700 1 Processor -- start 2023-06-08T04:01:52.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.859+0000 7f963b1ff700 1 -- start start 2023-06-08T04:01:52.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.860+0000 7f963b1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96340b4d20 0x7f9634154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.860+0000 7f963b1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96340b83f0 0x7f9634158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.860+0000 7f963b1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96340ced40 0x7f9634159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.860+0000 7f963b1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96341f0220 con 0x7f96340b83f0 2023-06-08T04:01:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.860+0000 7f963b1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963415f610 con 0x7f96340b4d20 2023-06-08T04:01:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.860+0000 7f963b1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96341f2db0 con 0x7f96340ced40 2023-06-08T04:01:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f9633fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96340b83f0 0x7f9634158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f9638f9b700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96340b4d20 0x7f9634154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f9633fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96340b83f0 0x7f9634158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37706/0 (socket says 172.21.15.16:37706) 2023-06-08T04:01:52.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f9633fff700 1 -- 172.21.15.16:0/3028417156 learned_addr learned my addr 172.21.15.16:0/3028417156 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:52.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f963979c700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96340ced40 0x7f9634159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f9638f9b700 1 -- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96340ced40 msgr2=0x7f9634159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f9638f9b700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96340ced40 0x7f9634159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f9638f9b700 1 -- 172.21.15.16:0/3028417156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96340b83f0 msgr2=0x7f9634158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:52.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f9638f9b700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96340b83f0 0x7f9634158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f9638f9b700 1 -- 172.21.15.16:0/3028417156 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c009a70 con 0x7f96340b4d20 2023-06-08T04:01:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f9633fff700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96340b83f0 0x7f9634158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.861+0000 7f9638f9b700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96340b4d20 0x7f9634154040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9628016000 tx=0x7f9628004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.862+0000 7f96317fa700 1 -- 172.21.15.16:0/3028417156 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280045d0 con 0x7f96340b4d20 2023-06-08T04:01:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.862+0000 7f96317fa700 1 -- 172.21.15.16:0/3028417156 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962801f070 con 0x7f96340b4d20 2023-06-08T04:01:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.862+0000 7f96317fa700 1 -- 172.21.15.16:0/3028417156 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96280038a0 con 0x7f96340b4d20 2023-06-08T04:01:52.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.862+0000 7f963b1ff700 1 -- 172.21.15.16:0/3028417156 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96280094a0 con 0x7f96340b4d20 2023-06-08T04:01:52.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.862+0000 7f963b1ff700 1 -- 172.21.15.16:0/3028417156 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96341efbd0 con 0x7f96340b4d20 2023-06-08T04:01:52.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.863+0000 7f963b1ff700 1 -- 172.21.15.16:0/3028417156 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96341f0500 con 0x7f96340b4d20 2023-06-08T04:01:52.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.864+0000 7f96317fa700 1 -- 172.21.15.16:0/3028417156 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f9628003a00 con 0x7f96340b4d20 2023-06-08T04:01:52.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.865+0000 7f96317fa700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f961806ac50 0x7f961806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:52.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.866+0000 7f96317fa700 1 -- 172.21.15.16:0/3028417156 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9628021070 con 0x7f96340b4d20 2023-06-08T04:01:52.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.866+0000 7f9633fff700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f961806ac50 0x7f961806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:52.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.866+0000 7f9633fff700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f961806ac50 0x7f961806d100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f963415fa30 tx=0x7f9620007f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:52.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:52.869+0000 7f96317fa700 1 -- 172.21.15.16:0/3028417156 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9628055ff0 con 0x7f96340b4d20 2023-06-08T04:01:53.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.072+0000 7f96317fa700 1 -- 172.21.15.16:0/3028417156 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f96280563c0 con 0x7f96340b4d20 2023-06-08T04:01:53.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.081+0000 7f963b1ff700 1 -- 172.21.15.16:0/3028417156 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96340740e0 con 0x7f96340b4d20 2023-06-08T04:01:53.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.082+0000 7f96317fa700 1 -- 172.21.15.16:0/3028417156 <== mon.1 v2:172.21.15.169:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14555 (secure 0 0 0) 0x7f9628071050 con 0x7f96340b4d20 2023-06-08T04:01:53.086 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:53.086 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:52.735116+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:01:53.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 -- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f961806ac50 msgr2=0x7f961806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f961806ac50 0x7f961806d100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f963415fa30 tx=0x7f9620007f30 comp rx=0 tx=0).stop 2023-06-08T04:01:53.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 -- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96340b4d20 msgr2=0x7f9634154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96340b4d20 0x7f9634154040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9628016000 tx=0x7f9628004750 comp rx=0 tx=0).stop 2023-06-08T04:01:53.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 -- 172.21.15.16:0/3028417156 shutdown_connections 2023-06-08T04:01:53.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f961806ac50 0x7f961806d100 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96340ced40 0x7f9634159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96340b4d20 0x7f9634154040 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 --2- 172.21.15.16:0/3028417156 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96340b83f0 0x7f9634158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 -- 172.21.15.16:0/3028417156 >> 172.21.15.16:0/3028417156 conn(0x7f96340cf610 msgr2=0x7f963415bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:53.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 -- 172.21.15.16:0/3028417156 shutdown_connections 2023-06-08T04:01:53.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.085+0000 7f963b1ff700 1 -- 172.21.15.16:0/3028417156 wait complete. 2023-06-08T04:01:53.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:01:53.107 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:01:53.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.308+0000 7f89f49ff700 1 Processor -- start 2023-06-08T04:01:53.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.308+0000 7f89f49ff700 1 -- start start 2023-06-08T04:01:53.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.310+0000 7f89f49ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f89f00b4d20 0x7f89f0167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.310+0000 7f89f49ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f00d0800 con 0x7f89f00b83f0 2023-06-08T04:01:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.310+0000 7f89f49ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f00cd1e0 con 0x7f89f0160a60 2023-06-08T04:01:53.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.310+0000 7f89f49ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f0160ed0 con 0x7f89f00b4d20 2023-06-08T04:01:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.310+0000 7f89edd9b700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f89f0160a60 0x7f89f00b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:49992/0 (socket says 172.21.15.16:49992) 2023-06-08T04:01:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.310+0000 7f89edd9b700 1 -- 172.21.15.16:0/3284408803 learned_addr learned my addr 172.21.15.16:0/3284408803 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:01:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.310+0000 7f89eed9d700 1 --2- 172.21.15.16:0/3284408803 >> v2:172.21.15.16:3300/0 conn(0x7f89f00b4d20 0x7f89f0167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.310+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218811621 0 0) 0x7f89f00cd1e0 con 0x7f89f0160a60 2023-06-08T04:01:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d80035b0 con 0x7f89f0160a60 2023-06-08T04:01:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 750093504 0 0) 0x7f89d80035b0 con 0x7f89f0160a60 2023-06-08T04:01:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 >> v2:172.21.15.16:3300/0 conn(0x7f89f00b4d20 msgr2=0x7f89f0167260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 --2- 172.21.15.16:0/3284408803 >> v2:172.21.15.16:3300/0 conn(0x7f89f00b4d20 0x7f89f0167260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 >> v1:172.21.15.16:6789/0 conn(0x7f89f00b83f0 legacy=0x7f89f00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f00cd4c0 con 0x7f89f0160a60 2023-06-08T04:01:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7f89e4001670 con 0x7f89f0160a60 2023-06-08T04:01:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 >> v1:172.21.15.169:6789/0 conn(0x7f89f0160a60 legacy=0x7f89f00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d8003a50 0x7f89d8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89d8004850 0x7f89d8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d80052d0 0x7f89d800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d800c1d0 con 0x7f89d8003a50 2023-06-08T04:01:53.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d800c340 con 0x7f89d8004850 2023-06-08T04:01:53.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d800c500 con 0x7f89d80052d0 2023-06-08T04:01:53.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89edd9b700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89d8004850 0x7f89d8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.311+0000 7f89eed9d700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d80052d0 0x7f89d800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89ee59c700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d8003a50 0x7f89d8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89eed9d700 1 -- 172.21.15.16:0/3284408803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89d8004850 msgr2=0x7f89d8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89eed9d700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89d8004850 0x7f89d8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89eed9d700 1 -- 172.21.15.16:0/3284408803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d8003a50 msgr2=0x7f89d8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89eed9d700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d8003a50 0x7f89d8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89eed9d700 1 -- 172.21.15.16:0/3284408803 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d80035b0 con 0x7f89d80052d0 2023-06-08T04:01:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89edd9b700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89d8004850 0x7f89d8004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:53.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89ee59c700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d8003a50 0x7f89d8003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:01:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89eed9d700 1 -- 172.21.15.16:0/3284408803 reap_dead start 2023-06-08T04:01:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89eed9d700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d80052d0 0x7f89d800ba10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f89f00b8d00 tx=0x7f89d8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42455f7727e8c7f9 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:53.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8018070 con 0x7f89d80052d0 2023-06-08T04:01:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e800f040 con 0x7f89d80052d0 2023-06-08T04:01:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.312+0000 7f89ed59a700 1 -- 172.21.15.16:0/3284408803 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e800ec10 con 0x7f89d80052d0 2023-06-08T04:01:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.313+0000 7f89f49ff700 1 -- 172.21.15.16:0/3284408803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d80052d0 msgr2=0x7f89d800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.313+0000 7f89f49ff700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d80052d0 0x7f89d800ba10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f89f00b8d00 tx=0x7f89d8005880 comp rx=0 tx=0).stop 2023-06-08T04:01:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.313+0000 7f89f49ff700 1 -- 172.21.15.16:0/3284408803 shutdown_connections 2023-06-08T04:01:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.313+0000 7f89f49ff700 1 --2- 172.21.15.16:0/3284408803 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d80052d0 0x7f89d800ba10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.313+0000 7f89f49ff700 1 -- 172.21.15.16:0/3284408803 >> 172.21.15.16:0/3284408803 conn(0x7f89f00cf610 msgr2=0x7f89f00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.313+0000 7f89f49ff700 1 -- 172.21.15.16:0/3284408803 shutdown_connections 2023-06-08T04:01:53.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.313+0000 7f89f49ff700 1 -- 172.21.15.16:0/3284408803 wait complete. 2023-06-08T04:01:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.316+0000 7f89f49ff700 1 Processor -- start 2023-06-08T04:01:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.316+0000 7f89f49ff700 1 -- start start 2023-06-08T04:01:53.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.317+0000 7f89f49ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d80052d0 0x7f89f014e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.317+0000 7f89f49ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89f00b5f60 0x7f89f00b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.317+0000 7f89f49ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89f01e5f10 0x7f89f01e6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.317+0000 7f89f49ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f00b6910 con 0x7f89d80052d0 2023-06-08T04:01:53.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.317+0000 7f89f49ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f01e7880 con 0x7f89f00b5f60 2023-06-08T04:01:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.317+0000 7f89f49ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f01e6c70 con 0x7f89f01e5f10 2023-06-08T04:01:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.317+0000 7f89ee59c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d80052d0 0x7f89f014e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.317+0000 7f89ee59c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d80052d0 0x7f89f014e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37730/0 (socket says 172.21.15.16:37730) 2023-06-08T04:01:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.317+0000 7f89ee59c700 1 -- 172.21.15.16:0/3253461287 learned_addr learned my addr 172.21.15.16:0/3253461287 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.318+0000 7f89edd9b700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89f00b5f60 0x7f89f00b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.318+0000 7f89eed9d700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89f01e5f10 0x7f89f01e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.318+0000 7f89ee59c700 1 -- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89f01e5f10 msgr2=0x7f89f01e6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.318+0000 7f89ee59c700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89f01e5f10 0x7f89f01e6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.318+0000 7f89ee59c700 1 -- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89f00b5f60 msgr2=0x7f89f00b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.318+0000 7f89ee59c700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89f00b5f60 0x7f89f00b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.318+0000 7f89ee59c700 1 -- 172.21.15.16:0/3253461287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f01e6f50 con 0x7f89d80052d0 2023-06-08T04:01:53.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.318+0000 7f89ee59c700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d80052d0 0x7f89f014e0e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89e000e4c0 tx=0x7f89e000e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:53.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.388+0000 7f89deffd700 1 -- 172.21.15.16:0/3253461287 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e000ee50 con 0x7f89d80052d0 2023-06-08T04:01:53.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.388+0000 7f89deffd700 1 -- 172.21.15.16:0/3253461287 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e00052e0 con 0x7f89d80052d0 2023-06-08T04:01:53.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.388+0000 7f89deffd700 1 -- 172.21.15.16:0/3253461287 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0003680 con 0x7f89d80052d0 2023-06-08T04:01:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.389+0000 7f89f49ff700 1 -- 172.21.15.16:0/3253461287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f01e7230 con 0x7f89d80052d0 2023-06-08T04:01:53.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.389+0000 7f89f49ff700 1 -- 172.21.15.16:0/3253461287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f014e620 con 0x7f89d80052d0 2023-06-08T04:01:53.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.390+0000 7f89f49ff700 1 -- 172.21.15.16:0/3253461287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f01e7c10 con 0x7f89d80052d0 2023-06-08T04:01:53.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.392+0000 7f89deffd700 1 -- 172.21.15.16:0/3253461287 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f89e00037e0 con 0x7f89d80052d0 2023-06-08T04:01:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.393+0000 7f89deffd700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f89d006ad30 0x7f89d006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.393+0000 7f89deffd700 1 -- 172.21.15.16:0/3253461287 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f89e0088ef0 con 0x7f89d80052d0 2023-06-08T04:01:53.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.393+0000 7f89edd9b700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f89d006ad30 0x7f89d006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.394+0000 7f89edd9b700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f89d006ad30 0x7f89d006d1e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89e4001050 tx=0x7f89e4007a70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:53.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.397+0000 7f89deffd700 1 -- 172.21.15.16:0/3253461287 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89e0054440 con 0x7f89d80052d0 2023-06-08T04:01:53.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.604+0000 7f89f49ff700 1 -- 172.21.15.16:0/3253461287 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f89f01e79c0 con 0x7f89d80052d0 2023-06-08T04:01:53.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.604+0000 7f89deffd700 1 -- 172.21.15.16:0/3253461287 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f89e0019020 con 0x7f89d80052d0 2023-06-08T04:01:53.608 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:01:53.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.606+0000 7f89f49ff700 1 -- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f89d006ad30 msgr2=0x7f89d006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.606+0000 7f89f49ff700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f89d006ad30 0x7f89d006d1e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f89e4001050 tx=0x7f89e4007a70 comp rx=0 tx=0).stop 2023-06-08T04:01:53.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.606+0000 7f89f49ff700 1 -- 172.21.15.16:0/3253461287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d80052d0 msgr2=0x7f89f014e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.606+0000 7f89f49ff700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d80052d0 0x7f89f014e0e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89e000e4c0 tx=0x7f89e000e7d0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.607+0000 7f89f49ff700 1 -- 172.21.15.16:0/3253461287 shutdown_connections 2023-06-08T04:01:53.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.607+0000 7f89f49ff700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f89d006ad30 0x7f89d006d1e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.607+0000 7f89f49ff700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89f01e5f10 0x7f89f01e6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.607+0000 7f89f49ff700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89d80052d0 0x7f89f014e0e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.607+0000 7f89f49ff700 1 --2- 172.21.15.16:0/3253461287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89f00b5f60 0x7f89f00b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.607+0000 7f89f49ff700 1 -- 172.21.15.16:0/3253461287 >> 172.21.15.16:0/3253461287 conn(0x7f89f00cf610 msgr2=0x7f89f00b7550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:53.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.607+0000 7f89f49ff700 1 -- 172.21.15.16:0/3253461287 shutdown_connections 2023-06-08T04:01:53.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.607+0000 7f89f49ff700 1 -- 172.21.15.16:0/3253461287 wait complete. 2023-06-08T04:01:53.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:01:53.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.831+0000 7ffb7a3ff700 1 Processor -- start 2023-06-08T04:01:53.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.831+0000 7ffb7a3ff700 1 -- start start 2023-06-08T04:01:53.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.832+0000 7ffb7a3ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffb740cd960 0x7ffb74070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.832+0000 7ffb7a3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb740b2b00 0x7ffb7415c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.832+0000 7ffb7a3ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7406ca80 con 0x7ffb740ce990 2023-06-08T04:01:53.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.832+0000 7ffb7a3ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb740ce540 con 0x7ffb740cd960 2023-06-08T04:01:53.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.832+0000 7ffb7a3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740cdd30 con 0x7ffb740b2b00 2023-06-08T04:01:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.832+0000 7ffb737fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ffb740ce990 0x7ffb740b23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42182/0 (socket says 172.21.15.16:42182) 2023-06-08T04:01:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.833+0000 7ffb737fe700 1 -- 172.21.15.16:0/2996021861 learned_addr learned my addr 172.21.15.16:0/2996021861 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:01:53.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.833+0000 7ffb73fff700 1 --2- 172.21.15.16:0/2996021861 >> v2:172.21.15.169:3300/0 conn(0x7ffb740cd960 0x7ffb74070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.833+0000 7ffb7899c700 1 --2- 172.21.15.16:0/2996021861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb740b2b00 0x7ffb7415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.833+0000 7ffb72ffd700 1 -- 172.21.15.16:0/2996021861 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162454444 0 0) 0x7ffb7406ca80 con 0x7ffb740ce990 2023-06-08T04:01:53.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.833+0000 7ffb72ffd700 1 -- 172.21.15.16:0/2996021861 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c0035b0 con 0x7ffb740ce990 2023-06-08T04:01:53.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.833+0000 7ffb73fff700 1 -- 172.21.15.16:0/2996021861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb740b2b00 msgr2=0x7ffb7415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:53.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.833+0000 7ffb73fff700 1 --2- 172.21.15.16:0/2996021861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb740b2b00 0x7ffb7415c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.833+0000 7ffb73fff700 1 -- 172.21.15.16:0/2996021861 >> v1:172.21.15.16:6789/0 conn(0x7ffb740ce990 legacy=0x7ffb740b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.833+0000 7ffb73fff700 1 -- 172.21.15.16:0/2996021861 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb741609b0 con 0x7ffb740cd960 2023-06-08T04:01:53.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.833+0000 7ffb7899c700 1 --2- 172.21.15.16:0/2996021861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb740b2b00 0x7ffb7415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:53.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.833+0000 7ffb73fff700 1 --2- 172.21.15.16:0/2996021861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb740cd960 0x7ffb74070b50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009840 tx=0x7ffb64009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8d201d143a533c5 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:53.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.834+0000 7ffb72ffd700 1 -- 172.21.15.16:0/2996021861 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64011830 con 0x7ffb740cd960 2023-06-08T04:01:53.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.834+0000 7ffb72ffd700 1 -- 172.21.15.16:0/2996021861 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb64011990 con 0x7ffb740cd960 2023-06-08T04:01:53.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.834+0000 7ffb72ffd700 1 -- 172.21.15.16:0/2996021861 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64011d00 con 0x7ffb740cd960 2023-06-08T04:01:53.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.834+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2996021861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb740cd960 msgr2=0x7ffb74070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.834+0000 7ffb7a3ff700 1 --2- 172.21.15.16:0/2996021861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb740cd960 0x7ffb74070b50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009840 tx=0x7ffb64009b50 comp rx=0 tx=0).stop 2023-06-08T04:01:53.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.834+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2996021861 shutdown_connections 2023-06-08T04:01:53.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.834+0000 7ffb7a3ff700 1 --2- 172.21.15.16:0/2996021861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb740b2b00 0x7ffb7415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.834+0000 7ffb7a3ff700 1 --2- 172.21.15.16:0/2996021861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb740cd960 0x7ffb74070b50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.834+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2996021861 >> 172.21.15.16:0/2996021861 conn(0x7ffb7406e4d0 msgr2=0x7ffb7406e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:53.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.834+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2996021861 shutdown_connections 2023-06-08T04:01:53.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.834+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2996021861 wait complete. 2023-06-08T04:01:53.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.836+0000 7ffb7a3ff700 1 Processor -- start 2023-06-08T04:01:53.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.836+0000 7ffb7a3ff700 1 -- start start 2023-06-08T04:01:53.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.837+0000 7ffb7a3ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb740b2b00 0x7ffb740c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.837+0000 7ffb7a3ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb740cd960 0x7ffb741503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.837+0000 7ffb7a3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb740ce990 0x7ffb740b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.837+0000 7ffb7a3ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb74151320 con 0x7ffb740b2b00 2023-06-08T04:01:53.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.837+0000 7ffb7a3ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740c60a0 con 0x7ffb740cd960 2023-06-08T04:01:53.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.837+0000 7ffb7a3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740c5490 con 0x7ffb740ce990 2023-06-08T04:01:53.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.837+0000 7ffb73fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb740b2b00 0x7ffb740c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.837+0000 7ffb73fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb740b2b00 0x7ffb740c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37740/0 (socket says 172.21.15.16:37740) 2023-06-08T04:01:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.837+0000 7ffb73fff700 1 -- 172.21.15.16:0/2781057478 learned_addr learned my addr 172.21.15.16:0/2781057478 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.837+0000 7ffb737fe700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb740cd960 0x7ffb741503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb7899c700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb740ce990 0x7ffb740b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb73fff700 1 -- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb740ce990 msgr2=0x7ffb740b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb73fff700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb740ce990 0x7ffb740b6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb73fff700 1 -- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb740cd960 msgr2=0x7ffb741503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:53.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb73fff700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb740cd960 0x7ffb741503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:53.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb73fff700 1 -- 172.21.15.16:0/2781057478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c009a70 con 0x7ffb740b2b00 2023-06-08T04:01:53.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb737fe700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb740cd960 0x7ffb741503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:53.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb73fff700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb740b2b00 0x7ffb740c4e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffb64000c00 tx=0x7ffb64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:53.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb70ff9700 1 -- 172.21.15.16:0/2781057478 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64004550 con 0x7ffb740b2b00 2023-06-08T04:01:53.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb70ff9700 1 -- 172.21.15.16:0/2781057478 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6401f070 con 0x7ffb740b2b00 2023-06-08T04:01:53.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2781057478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb640094a0 con 0x7ffb740b2b00 2023-06-08T04:01:53.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.838+0000 7ffb70ff9700 1 -- 172.21.15.16:0/2781057478 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb640038c0 con 0x7ffb740b2b00 2023-06-08T04:01:53.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.839+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2781057478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb740c5a50 con 0x7ffb740b2b00 2023-06-08T04:01:53.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.840+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2781057478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb740740e0 con 0x7ffb740b2b00 2023-06-08T04:01:53.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.840+0000 7ffb70ff9700 1 -- 172.21.15.16:0/2781057478 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb64003a20 con 0x7ffb740b2b00 2023-06-08T04:01:53.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.841+0000 7ffb70ff9700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffb6006ace0 0x7ffb6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:53.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.841+0000 7ffb70ff9700 1 -- 172.21.15.16:0/2781057478 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffb64021070 con 0x7ffb740b2b00 2023-06-08T04:01:53.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.842+0000 7ffb737fe700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffb6006ace0 0x7ffb6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:53.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.842+0000 7ffb737fe700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffb6006ace0 0x7ffb6006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffb741548a0 tx=0x7ffb68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:53.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:53.846+0000 7ffb70ff9700 1 -- 172.21.15.16:0/2781057478 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffb64055d10 con 0x7ffb740b2b00 2023-06-08T04:01:54.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.050+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2781057478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb740d02c0 con 0x7ffb740b2b00 2023-06-08T04:01:54.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.050+0000 7ffb70ff9700 1 -- 172.21.15.16:0/2781057478 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb740d02c0 con 0x7ffb740b2b00 2023-06-08T04:01:54.055 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:01:54.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffb6006ace0 msgr2=0x7ffb6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffb6006ace0 0x7ffb6006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffb741548a0 tx=0x7ffb68009040 comp rx=0 tx=0).stop 2023-06-08T04:01:54.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2781057478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb740b2b00 msgr2=0x7ffb740c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb740b2b00 0x7ffb740c4e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffb64000c00 tx=0x7ffb64004750 comp rx=0 tx=0).stop 2023-06-08T04:01:54.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2781057478 shutdown_connections 2023-06-08T04:01:54.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffb6006ace0 0x7ffb6006d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffb740ce990 0x7ffb740b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb740b2b00 0x7ffb740c4e60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 --2- 172.21.15.16:0/2781057478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffb740cd960 0x7ffb741503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2781057478 >> 172.21.15.16:0/2781057478 conn(0x7ffb7406e4d0 msgr2=0x7ffb7415c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:54.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2781057478 shutdown_connections 2023-06-08T04:01:54.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.053+0000 7ffb7a3ff700 1 -- 172.21.15.16:0/2781057478 wait complete. 2023-06-08T04:01:54.075 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-08T04:01:54.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.271+0000 7f7c6bdff700 1 Processor -- start 2023-06-08T04:01:54.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.271+0000 7f7c6bdff700 1 -- start start 2023-06-08T04:01:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.272+0000 7f7c6bdff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7c640b4d20 0x7f7c64167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.272+0000 7f7c6bdff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c640d0800 con 0x7f7c64160a60 2023-06-08T04:01:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.272+0000 7f7c6bdff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c640cd1e0 con 0x7f7c640b83f0 2023-06-08T04:01:54.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.272+0000 7f7c6bdff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c64160ed0 con 0x7f7c640b4d20 2023-06-08T04:01:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.272+0000 7f7c6939a700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7c64160a60 0x7f7c640b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42196/0 (socket says 172.21.15.16:42196) 2023-06-08T04:01:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.272+0000 7f7c6939a700 1 -- 172.21.15.16:0/4250833718 learned_addr learned my addr 172.21.15.16:0/4250833718 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:01:54.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.272+0000 7f7c6a39c700 1 --2- 172.21.15.16:0/4250833718 >> v2:172.21.15.16:3300/0 conn(0x7f7c640b4d20 0x7f7c64167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.273+0000 7f7c68b99700 1 -- 172.21.15.16:0/4250833718 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256931691 0 0) 0x7f7c640d0800 con 0x7f7c64160a60 2023-06-08T04:01:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.273+0000 7f7c6a39c700 1 -- 172.21.15.16:0/4250833718 >> v1:172.21.15.169:6789/0 conn(0x7f7c640b83f0 legacy=0x7f7c640ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.273+0000 7f7c6a39c700 1 -- 172.21.15.16:0/4250833718 >> v1:172.21.15.16:6789/0 conn(0x7f7c64160a60 legacy=0x7f7c640b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.273+0000 7f7c6a39c700 1 -- 172.21.15.16:0/4250833718 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c640cd4c0 con 0x7f7c640b4d20 2023-06-08T04:01:54.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.273+0000 7f7c6a39c700 1 --2- 172.21.15.16:0/4250833718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c640b4d20 0x7f7c64167260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009d90 tx=0x7f7c5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8eae394e679228 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:54.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.273+0000 7f7c68b99700 1 -- 172.21.15.16:0/4250833718 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00e070 con 0x7f7c640b4d20 2023-06-08T04:01:54.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.273+0000 7f7c68b99700 1 -- 172.21.15.16:0/4250833718 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c00bbd0 con 0x7f7c640b4d20 2023-06-08T04:01:54.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.273+0000 7f7c68b99700 1 -- 172.21.15.16:0/4250833718 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c012430 con 0x7f7c640b4d20 2023-06-08T04:01:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.274+0000 7f7c6bdff700 1 -- 172.21.15.16:0/4250833718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c640b4d20 msgr2=0x7f7c64167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.274+0000 7f7c6bdff700 1 --2- 172.21.15.16:0/4250833718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c640b4d20 0x7f7c64167260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009d90 tx=0x7f7c5c00b330 comp rx=0 tx=0).stop 2023-06-08T04:01:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.274+0000 7f7c6bdff700 1 -- 172.21.15.16:0/4250833718 shutdown_connections 2023-06-08T04:01:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.274+0000 7f7c6bdff700 1 --2- 172.21.15.16:0/4250833718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c640b4d20 0x7f7c64167260 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.274+0000 7f7c6bdff700 1 -- 172.21.15.16:0/4250833718 >> 172.21.15.16:0/4250833718 conn(0x7f7c640cf610 msgr2=0x7f7c640cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.274+0000 7f7c6bdff700 1 -- 172.21.15.16:0/4250833718 shutdown_connections 2023-06-08T04:01:54.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.274+0000 7f7c6bdff700 1 -- 172.21.15.16:0/4250833718 wait complete. 2023-06-08T04:01:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.276+0000 7f7c6bdff700 1 Processor -- start 2023-06-08T04:01:54.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.276+0000 7f7c6bdff700 1 -- start start 2023-06-08T04:01:54.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6bdff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c640b4d20 0x7f7c640b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:54.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6bdff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c640b83f0 0x7f7c64152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:54.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6bdff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c64160a60 0x7f7c640d1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:54.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6bdff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640b31d0 con 0x7f7c64160a60 2023-06-08T04:01:54.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6bdff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640b43e0 con 0x7f7c640b4d20 2023-06-08T04:01:54.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6bdff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640b37d0 con 0x7f7c640b83f0 2023-06-08T04:01:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6a39c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c64160a60 0x7f7c640d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6a39c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c64160a60 0x7f7c640d1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37750/0 (socket says 172.21.15.16:37750) 2023-06-08T04:01:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6a39c700 1 -- 172.21.15.16:0/1761119242 learned_addr learned my addr 172.21.15.16:0/1761119242 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c69b9b700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c640b4d20 0x7f7c640b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6939a700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c640b83f0 0x7f7c64152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6a39c700 1 -- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c640b83f0 msgr2=0x7f7c64152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6a39c700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c640b83f0 0x7f7c64152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6a39c700 1 -- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c640b4d20 msgr2=0x7f7c640b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6a39c700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c640b4d20 0x7f7c640b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6a39c700 1 -- 172.21.15.16:0/1761119242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c009a70 con 0x7f7c64160a60 2023-06-08T04:01:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.277+0000 7f7c6939a700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c640b83f0 0x7f7c64152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:01:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.278+0000 7f7c6a39c700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c64160a60 0x7f7c640d1860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009d60 tx=0x7f7c5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.278+0000 7f7c5a7fc700 1 -- 172.21.15.16:0/1761119242 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c01b8d0 con 0x7f7c64160a60 2023-06-08T04:01:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.278+0000 7f7c5a7fc700 1 -- 172.21.15.16:0/1761119242 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c020070 con 0x7f7c64160a60 2023-06-08T04:01:54.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.278+0000 7f7c6bdff700 1 -- 172.21.15.16:0/1761119242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c640b3ab0 con 0x7f7c64160a60 2023-06-08T04:01:54.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.278+0000 7f7c5a7fc700 1 -- 172.21.15.16:0/1761119242 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c01bc90 con 0x7f7c64160a60 2023-06-08T04:01:54.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.278+0000 7f7c6bdff700 1 -- 172.21.15.16:0/1761119242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c640b4070 con 0x7f7c64160a60 2023-06-08T04:01:54.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.279+0000 7f7c6bdff700 1 -- 172.21.15.16:0/1761119242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c641e5d30 con 0x7f7c64160a60 2023-06-08T04:01:54.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.280+0000 7f7c5a7fc700 1 -- 172.21.15.16:0/1761119242 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c5c027480 con 0x7f7c64160a60 2023-06-08T04:01:54.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.281+0000 7f7c5a7fc700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c4806ace0 0x7f7c4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:54.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.281+0000 7f7c5a7fc700 1 -- 172.21.15.16:0/1761119242 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7c5c022070 con 0x7f7c64160a60 2023-06-08T04:01:54.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.281+0000 7f7c69b9b700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c4806ace0 0x7f7c4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:54.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.282+0000 7f7c69b9b700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c4806ace0 0x7f7c4806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c60007fd0 tx=0x7f7c60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:54.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.285+0000 7f7c5a7fc700 1 -- 172.21.15.16:0/1761119242 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7c641e5d30 con 0x7f7c64160a60 2023-06-08T04:01:54.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.492+0000 7f7c6bdff700 1 -- 172.21.15.16:0/1761119242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7c641e5d30 con 0x7f7c64160a60 2023-06-08T04:01:54.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.492+0000 7f7c5a7fc700 1 -- 172.21.15.16:0/1761119242 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7c5c02c090 con 0x7f7c64160a60 2023-06-08T04:01:54.497 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:54.497 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2023-06-08T04:01:54.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:01:54.497 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2023-06-08T04:01:54.497 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": "rbd" 2023-06-08T04:01:54.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:01:54.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:01:54.498 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 2, 2023-06-08T04:01:54.498 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2023-06-08T04:01:54.498 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:01:54.498 INFO:teuthology.orchestra.run.smithi016.stdout:] 2023-06-08T04:01:54.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.494+0000 7f7c6bdff700 1 -- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c4806ace0 msgr2=0x7f7c4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.494+0000 7f7c6bdff700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c4806ace0 0x7f7c4806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c60007fd0 tx=0x7f7c60009040 comp rx=0 tx=0).stop 2023-06-08T04:01:54.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.494+0000 7f7c6bdff700 1 -- 172.21.15.16:0/1761119242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c64160a60 msgr2=0x7f7c640d1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.494+0000 7f7c6bdff700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c64160a60 0x7f7c640d1860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009d60 tx=0x7f7c5c004ad0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.495+0000 7f7c6bdff700 1 -- 172.21.15.16:0/1761119242 shutdown_connections 2023-06-08T04:01:54.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.495+0000 7f7c6bdff700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c4806ace0 0x7f7c4806d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.495+0000 7f7c6bdff700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c64160a60 0x7f7c640d1860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.495+0000 7f7c6bdff700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c640b4d20 0x7f7c640b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.495+0000 7f7c6bdff700 1 --2- 172.21.15.16:0/1761119242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c640b83f0 0x7f7c64152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.495+0000 7f7c6bdff700 1 -- 172.21.15.16:0/1761119242 >> 172.21.15.16:0/1761119242 conn(0x7f7c640cf610 msgr2=0x7f7c640ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:54.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.495+0000 7f7c6bdff700 1 -- 172.21.15.16:0/1761119242 shutdown_connections 2023-06-08T04:01:54.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.495+0000 7f7c6bdff700 1 -- 172.21.15.16:0/1761119242 wait complete. 2023-06-08T04:01:54.516 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-08T04:01:54.516 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-08T04:01:54.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.716+0000 7fa2123ff700 1 Processor -- start 2023-06-08T04:01:54.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.716+0000 7fa2123ff700 1 -- start start 2023-06-08T04:01:54.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.718+0000 7fa2123ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa20c0b4d20 0x7fa20c167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:54.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.718+0000 7fa2123ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20c0d0800 con 0x7fa20c160a60 2023-06-08T04:01:54.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.718+0000 7fa2123ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20c0cd1e0 con 0x7fa20c0b83f0 2023-06-08T04:01:54.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.718+0000 7fa2123ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20c160ed0 con 0x7fa20c0b4d20 2023-06-08T04:01:54.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.718+0000 7fa21099c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa20c0b4d20 0x7fa20c167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:54.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.718+0000 7fa20b7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa20c160a60 0x7fa20c0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42202/0 (socket says 172.21.15.16:42202) 2023-06-08T04:01:54.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.718+0000 7fa20b7fe700 1 -- 172.21.15.16:0/1454794924 learned_addr learned my addr 172.21.15.16:0/1454794924 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:01:54.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.718+0000 7fa21099c700 1 -- 172.21.15.16:0/1454794924 >> v1:172.21.15.169:6789/0 conn(0x7fa20c0b83f0 legacy=0x7fa20c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.718+0000 7fa21099c700 1 -- 172.21.15.16:0/1454794924 >> v1:172.21.15.16:6789/0 conn(0x7fa20c160a60 legacy=0x7fa20c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.718+0000 7fa21099c700 1 -- 172.21.15.16:0/1454794924 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c0cd4c0 con 0x7fa20c0b4d20 2023-06-08T04:01:54.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.718+0000 7fa20affd700 1 -- 172.21.15.16:0/1454794924 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613816655 0 0) 0x7fa20c0d0800 con 0x7fa20c160a60 2023-06-08T04:01:54.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.719+0000 7fa21099c700 1 --2- 172.21.15.16:0/1454794924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c0b4d20 0x7fa20c167260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa204009d90 tx=0x7fa20400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957ba5097b33f61f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:54.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.719+0000 7fa20affd700 1 -- 172.21.15.16:0/1454794924 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20400e070 con 0x7fa20c0b4d20 2023-06-08T04:01:54.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.719+0000 7fa20affd700 1 -- 172.21.15.16:0/1454794924 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20400bbd0 con 0x7fa20c0b4d20 2023-06-08T04:01:54.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.719+0000 7fa20affd700 1 -- 172.21.15.16:0/1454794924 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204012430 con 0x7fa20c0b4d20 2023-06-08T04:01:54.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.719+0000 7fa2123ff700 1 -- 172.21.15.16:0/1454794924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c0b4d20 msgr2=0x7fa20c167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.719+0000 7fa2123ff700 1 --2- 172.21.15.16:0/1454794924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c0b4d20 0x7fa20c167260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa204009d90 tx=0x7fa20400b330 comp rx=0 tx=0).stop 2023-06-08T04:01:54.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.719+0000 7fa2123ff700 1 -- 172.21.15.16:0/1454794924 shutdown_connections 2023-06-08T04:01:54.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.719+0000 7fa2123ff700 1 --2- 172.21.15.16:0/1454794924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c0b4d20 0x7fa20c167260 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.719+0000 7fa2123ff700 1 -- 172.21.15.16:0/1454794924 >> 172.21.15.16:0/1454794924 conn(0x7fa20c0cf610 msgr2=0x7fa20c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:54.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.720+0000 7fa2123ff700 1 -- 172.21.15.16:0/1454794924 shutdown_connections 2023-06-08T04:01:54.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.720+0000 7fa2123ff700 1 -- 172.21.15.16:0/1454794924 wait complete. 2023-06-08T04:01:54.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.721+0000 7fa2123ff700 1 Processor -- start 2023-06-08T04:01:54.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.721+0000 7fa2123ff700 1 -- start start 2023-06-08T04:01:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.722+0000 7fa2123ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa20c0b4d20 0x7fa20c1f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.722+0000 7fa2123ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa20c0b83f0 0x7fa20c157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.722+0000 7fa2123ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c160a60 0x7fa20c15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.722+0000 7fa2123ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c15da80 con 0x7fa20c160a60 2023-06-08T04:01:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.722+0000 7fa2123ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c158490 con 0x7fa20c0b83f0 2023-06-08T04:01:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.722+0000 7fa2123ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c15cf40 con 0x7fa20c0b4d20 2023-06-08T04:01:54.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.723+0000 7fa21099c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c160a60 0x7fa20c15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.723+0000 7fa21099c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c160a60 0x7fa20c15ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37760/0 (socket says 172.21.15.16:37760) 2023-06-08T04:01:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.723+0000 7fa21099c700 1 -- 172.21.15.16:0/3695101372 learned_addr learned my addr 172.21.15.16:0/3695101372 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.723+0000 7fa20bfff700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa20c0b4d20 0x7fa20c1f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.723+0000 7fa20b7fe700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa20c0b83f0 0x7fa20c157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.723+0000 7fa21099c700 1 -- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa20c0b4d20 msgr2=0x7fa20c1f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.723+0000 7fa21099c700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa20c0b4d20 0x7fa20c1f2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.723+0000 7fa21099c700 1 -- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa20c0b83f0 msgr2=0x7fa20c157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:54.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.723+0000 7fa21099c700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa20c0b83f0 0x7fa20c157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:54.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.723+0000 7fa21099c700 1 -- 172.21.15.16:0/3695101372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa204009a70 con 0x7fa20c160a60 2023-06-08T04:01:54.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.723+0000 7fa21099c700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c160a60 0x7fa20c15ca00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa204009d60 tx=0x7fa204004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:54.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.724+0000 7fa208ff9700 1 -- 172.21.15.16:0/3695101372 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20401b810 con 0x7fa20c160a60 2023-06-08T04:01:54.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.724+0000 7fa208ff9700 1 -- 172.21.15.16:0/3695101372 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa204020070 con 0x7fa20c160a60 2023-06-08T04:01:54.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.724+0000 7fa2123ff700 1 -- 172.21.15.16:0/3695101372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20c15d1e0 con 0x7fa20c160a60 2023-06-08T04:01:54.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.724+0000 7fa208ff9700 1 -- 172.21.15.16:0/3695101372 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20401bbf0 con 0x7fa20c160a60 2023-06-08T04:01:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.724+0000 7fa2123ff700 1 -- 172.21.15.16:0/3695101372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20c15d7a0 con 0x7fa20c160a60 2023-06-08T04:01:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.725+0000 7fa2123ff700 1 -- 172.21.15.16:0/3695101372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20c0740e0 con 0x7fa20c160a60 2023-06-08T04:01:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.726+0000 7fa208ff9700 1 -- 172.21.15.16:0/3695101372 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa20401bd50 con 0x7fa20c160a60 2023-06-08T04:01:54.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.727+0000 7fa208ff9700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa1f806ace0 0x7fa1f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:54.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.727+0000 7fa208ff9700 1 -- 172.21.15.16:0/3695101372 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa204022070 con 0x7fa20c160a60 2023-06-08T04:01:54.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.728+0000 7fa20bfff700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa1f806ace0 0x7fa1f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:54.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.728+0000 7fa20bfff700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa1f806ace0 0x7fa1f806d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0b4cf0 tx=0x7fa1fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:54.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.732+0000 7fa208ff9700 1 -- 172.21.15.16:0/3695101372 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa204056ce0 con 0x7fa20c160a60 2023-06-08T04:01:54.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:54.939+0000 7fa2123ff700 1 -- 172.21.15.16:0/3695101372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa20c15c480 con 0x7fa20c160a60 2023-06-08T04:01:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.756+0000 7fa208ff9700 1 -- 172.21.15.16:0/3695101372 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa20405a300 con 0x7fa20c160a60 2023-06-08T04:01:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.760+0000 7fa2123ff700 1 -- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa1f806ace0 msgr2=0x7fa1f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.760+0000 7fa2123ff700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa1f806ace0 0x7fa1f806d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0b4cf0 tx=0x7fa1fc009040 comp rx=0 tx=0).stop 2023-06-08T04:01:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.760+0000 7fa2123ff700 1 -- 172.21.15.16:0/3695101372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c160a60 msgr2=0x7fa20c15ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.760+0000 7fa2123ff700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c160a60 0x7fa20c15ca00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa204009d60 tx=0x7fa204004ad0 comp rx=0 tx=0).stop 2023-06-08T04:01:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.760+0000 7fa2123ff700 1 -- 172.21.15.16:0/3695101372 shutdown_connections 2023-06-08T04:01:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.760+0000 7fa2123ff700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa1f806ace0 0x7fa1f806d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.760+0000 7fa2123ff700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c160a60 0x7fa20c15ca00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.760+0000 7fa2123ff700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa20c0b4d20 0x7fa20c1f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.760+0000 7fa2123ff700 1 --2- 172.21.15.16:0/3695101372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa20c0b83f0 0x7fa20c157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.760+0000 7fa2123ff700 1 -- 172.21.15.16:0/3695101372 >> 172.21.15.16:0/3695101372 conn(0x7fa20c0cf610 msgr2=0x7fa20c0b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.761+0000 7fa2123ff700 1 -- 172.21.15.16:0/3695101372 shutdown_connections 2023-06-08T04:01:55.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.761+0000 7fa2123ff700 1 -- 172.21.15.16:0/3695101372 wait complete. 2023-06-08T04:01:55.772 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2023-06-08T04:01:55.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-08T04:01:56.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.999+0000 7fdfcb3ff700 1 Processor -- start 2023-06-08T04:01:56.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:55.999+0000 7fdfcb3ff700 1 -- start start 2023-06-08T04:01:56.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.000+0000 7fdfcb3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 0x7fdfc40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:56.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.000+0000 7fdfcb3ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc40d0800 con 0x7fdfc40b83f0 2023-06-08T04:01:56.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfcb3ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc40cd1e0 con 0x7fdfc40b4b50 2023-06-08T04:01:56.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfcb3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4160ed0 con 0x7fdfc4160a60 2023-06-08T04:01:56.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfc919b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdfc40b83f0 0x7fdfc40ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42204/0 (socket says 172.21.15.16:42204) 2023-06-08T04:01:56.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfc919b700 1 -- 172.21.15.16:0/1805848693 learned_addr learned my addr 172.21.15.16:0/1805848693 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:01:56.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfc899a700 1 --2- 172.21.15.16:0/1805848693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 0x7fdfc40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:56.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfbbfff700 1 -- 172.21.15.16:0/1805848693 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663714059 0 0) 0x7fdfc40d0800 con 0x7fdfc40b83f0 2023-06-08T04:01:56.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfbbfff700 1 -- 172.21.15.16:0/1805848693 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb00035b0 con 0x7fdfc40b83f0 2023-06-08T04:01:56.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfbbfff700 1 -- 172.21.15.16:0/1805848693 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060209828 0 0) 0x7fdfc40cd1e0 con 0x7fdfc40b4b50 2023-06-08T04:01:56.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfbbfff700 1 -- 172.21.15.16:0/1805848693 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc40d0800 con 0x7fdfc40b4b50 2023-06-08T04:01:56.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfbbfff700 1 -- 172.21.15.16:0/1805848693 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1900909981 0 0) 0x7fdfb00035b0 con 0x7fdfc40b83f0 2023-06-08T04:01:56.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfc899a700 1 -- 172.21.15.16:0/1805848693 >> v1:172.21.15.169:6789/0 conn(0x7fdfc40b4b50 legacy=0x7fdfc40d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:56.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfc899a700 1 -- 172.21.15.16:0/1805848693 >> v1:172.21.15.16:6789/0 conn(0x7fdfc40b83f0 legacy=0x7fdfc40ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:56.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.001+0000 7fdfc899a700 1 -- 172.21.15.16:0/1805848693 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc40cd4c0 con 0x7fdfc4160a60 2023-06-08T04:01:56.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.002+0000 7fdfc899a700 1 --2- 172.21.15.16:0/1805848693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 0x7fdfc40b4610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009870 tx=0x7fdfb4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88cdcd18db732a73 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:56.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.002+0000 7fdfbbfff700 1 -- 172.21.15.16:0/1805848693 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0001670 con 0x7fdfc4160a60 2023-06-08T04:01:56.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.002+0000 7fdfbbfff700 1 -- 172.21.15.16:0/1805848693 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4004030 con 0x7fdfc4160a60 2023-06-08T04:01:56.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.002+0000 7fdfbbfff700 1 -- 172.21.15.16:0/1805848693 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40043c0 con 0x7fdfc4160a60 2023-06-08T04:01:56.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.003+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1805848693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 msgr2=0x7fdfc40b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:56.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.003+0000 7fdfcb3ff700 1 --2- 172.21.15.16:0/1805848693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 0x7fdfc40b4610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009870 tx=0x7fdfb4009b80 comp rx=0 tx=0).stop 2023-06-08T04:01:56.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.003+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1805848693 shutdown_connections 2023-06-08T04:01:56.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.003+0000 7fdfcb3ff700 1 --2- 172.21.15.16:0/1805848693 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 0x7fdfc40b4610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:56.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.003+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1805848693 >> 172.21.15.16:0/1805848693 conn(0x7fdfc40cf610 msgr2=0x7fdfc40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:56.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.003+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1805848693 shutdown_connections 2023-06-08T04:01:56.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.003+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1805848693 wait complete. 2023-06-08T04:01:56.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.004+0000 7fdfcb3ff700 1 Processor -- start 2023-06-08T04:01:56.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.005+0000 7fdfcb3ff700 1 -- start start 2023-06-08T04:01:56.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfcb3ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc40b4b50 0x7fdfc40cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:56.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfcb3ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc40b83f0 0x7fdfc40cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:56.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfcb3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 0x7fdfc40b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:56.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfcb3ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41e6400 con 0x7fdfc40b4b50 2023-06-08T04:01:56.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfcb3ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41e5e40 con 0x7fdfc40b83f0 2023-06-08T04:01:56.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfcb3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41e6120 con 0x7fdfc4160a60 2023-06-08T04:01:56.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc919b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc40b4b50 0x7fdfc40cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:56.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc919b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc40b4b50 0x7fdfc40cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37768/0 (socket says 172.21.15.16:37768) 2023-06-08T04:01:56.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc919b700 1 -- 172.21.15.16:0/1999887398 learned_addr learned my addr 172.21.15.16:0/1999887398 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:56.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc899a700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc40b83f0 0x7fdfc40cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:56.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc999c700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 0x7fdfc40b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:56.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc919b700 1 -- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 msgr2=0x7fdfc40b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:56.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc919b700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 0x7fdfc40b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:56.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc919b700 1 -- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc40b83f0 msgr2=0x7fdfc40cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:56.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc919b700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc40b83f0 0x7fdfc40cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:56.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc919b700 1 -- 172.21.15.16:0/1999887398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40094a0 con 0x7fdfc40b4b50 2023-06-08T04:01:56.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc999c700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 0x7fdfc40b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:01:56.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.006+0000 7fdfc919b700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc40b4b50 0x7fdfc40cc450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000c730 tx=0x7fdfc000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:56.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.007+0000 7fdfb9ffb700 1 -- 172.21.15.16:0/1999887398 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0004c80 con 0x7fdfc40b4b50 2023-06-08T04:01:56.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.007+0000 7fdfb9ffb700 1 -- 172.21.15.16:0/1999887398 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc0004e00 con 0x7fdfc40b4b50 2023-06-08T04:01:56.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.007+0000 7fdfb9ffb700 1 -- 172.21.15.16:0/1999887398 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0007310 con 0x7fdfc40b4b50 2023-06-08T04:01:56.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.007+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1999887398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc40caa00 con 0x7fdfc40b4b50 2023-06-08T04:01:56.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.007+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1999887398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc40cc990 con 0x7fdfc40b4b50 2023-06-08T04:01:56.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.008+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1999887398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc40cb050 con 0x7fdfc40b4b50 2023-06-08T04:01:56.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.009+0000 7fdfb9ffb700 1 -- 172.21.15.16:0/1999887398 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfc0007470 con 0x7fdfc40b4b50 2023-06-08T04:01:56.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.010+0000 7fdfb9ffb700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdfa806ad10 0x7fdfa806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:56.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.010+0000 7fdfb9ffb700 1 -- 172.21.15.16:0/1999887398 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fdfc0089170 con 0x7fdfc40b4b50 2023-06-08T04:01:56.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.011+0000 7fdfc899a700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdfa806ad10 0x7fdfa806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:56.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.011+0000 7fdfc899a700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdfa806ad10 0x7fdfa806d1c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40097c0 tx=0x7fdfb4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:56.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.015+0000 7fdfb9ffb700 1 -- 172.21.15.16:0/1999887398 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdfc00543f0 con 0x7fdfc40b4b50 2023-06-08T04:01:56.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.223+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1999887398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdfc40ca860 con 0x7fdfc40b4b50 2023-06-08T04:01:56.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.764+0000 7fdfb9ffb700 1 -- 172.21.15.16:0/1999887398 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdfc40ca860 con 0x7fdfc40b4b50 2023-06-08T04:01:56.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.771+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdfa806ad10 msgr2=0x7fdfa806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:56.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.771+0000 7fdfcb3ff700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdfa806ad10 0x7fdfa806d1c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40097c0 tx=0x7fdfb4008030 comp rx=0 tx=0).stop 2023-06-08T04:01:56.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.771+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1999887398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc40b4b50 msgr2=0x7fdfc40cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:56.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.771+0000 7fdfcb3ff700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc40b4b50 0x7fdfc40cc450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000c730 tx=0x7fdfc000caf0 comp rx=0 tx=0).stop 2023-06-08T04:01:56.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.775+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1999887398 shutdown_connections 2023-06-08T04:01:56.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.775+0000 7fdfcb3ff700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdfa806ad10 0x7fdfa806d1c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:56.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.775+0000 7fdfcb3ff700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfc4160a60 0x7fdfc40b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:56.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.775+0000 7fdfcb3ff700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdfc40b4b50 0x7fdfc40cc450 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:56.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.775+0000 7fdfcb3ff700 1 --2- 172.21.15.16:0/1999887398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc40b83f0 0x7fdfc40cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:56.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.775+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1999887398 >> 172.21.15.16:0/1999887398 conn(0x7fdfc40cf610 msgr2=0x7fdfc406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:56.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.782+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1999887398 shutdown_connections 2023-06-08T04:01:56.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:56.782+0000 7fdfcb3ff700 1 -- 172.21.15.16:0/1999887398 wait complete. 2023-06-08T04:01:56.792 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2023-06-08T04:01:56.812 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-08T04:01:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.013+0000 7f62779ff700 1 Processor -- start 2023-06-08T04:01:57.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.013+0000 7f62779ff700 1 -- start start 2023-06-08T04:01:57.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.014+0000 7f62779ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f62700b83f0 0x7f6270160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.014+0000 7f62779ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b4d20 0x7f62700d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.014+0000 7f62779ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700d0800 con 0x7f62700ced40 2023-06-08T04:01:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.014+0000 7f62779ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700cd1e0 con 0x7f62700b83f0 2023-06-08T04:01:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.014+0000 7f62779ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62700cd4c0 con 0x7f62700b4d20 2023-06-08T04:01:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.015+0000 7f6275f9c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b4d20 0x7f62700d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.015+0000 7f627579b700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f62700b83f0 0x7f6270160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.015+0000 7f6275f9c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b4d20 0x7f62700d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:34584/0 (socket says 172.21.15.16:34584) 2023-06-08T04:01:57.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.015+0000 7f6275f9c700 1 -- 172.21.15.16:0/2371401777 learned_addr learned my addr 172.21.15.16:0/2371401777 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:57.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.015+0000 7f6274f9a700 1 --1- 172.21.15.16:0/2371401777 >> v1:172.21.15.169:6789/0 conn(0x7f62700ced40 0x7f62700b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:50024/0 (socket says 172.21.15.16:50024) 2023-06-08T04:01:57.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.015+0000 7f6267fff700 1 -- 172.21.15.16:0/2371401777 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138098278 0 0) 0x7f62700d0800 con 0x7f62700ced40 2023-06-08T04:01:57.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.015+0000 7f6275f9c700 1 -- 172.21.15.16:0/2371401777 >> v2:172.21.15.169:3300/0 conn(0x7f62700b83f0 msgr2=0x7f6270160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:57.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.015+0000 7f6275f9c700 1 --2- 172.21.15.16:0/2371401777 >> v2:172.21.15.169:3300/0 conn(0x7f62700b83f0 0x7f6270160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.015+0000 7f6275f9c700 1 -- 172.21.15.16:0/2371401777 >> v1:172.21.15.169:6789/0 conn(0x7f62700ced40 legacy=0x7f62700b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.015+0000 7f6275f9c700 1 -- 172.21.15.16:0/2371401777 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700d0aa0 con 0x7f62700b4d20 2023-06-08T04:01:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.015+0000 7f6275f9c700 1 --2- 172.21.15.16:0/2371401777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b4d20 0x7f62700d0fc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6268009e50 tx=0x7f626800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c79860d02b99c959 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.016+0000 7f6267fff700 1 -- 172.21.15.16:0/2371401777 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800e070 con 0x7f62700b4d20 2023-06-08T04:01:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.016+0000 7f6267fff700 1 -- 172.21.15.16:0/2371401777 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626800b910 con 0x7f62700b4d20 2023-06-08T04:01:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.016+0000 7f6267fff700 1 -- 172.21.15.16:0/2371401777 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800bcc0 con 0x7f62700b4d20 2023-06-08T04:01:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.016+0000 7f62779ff700 1 -- 172.21.15.16:0/2371401777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b4d20 msgr2=0x7f62700d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.016+0000 7f62779ff700 1 --2- 172.21.15.16:0/2371401777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b4d20 0x7f62700d0fc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6268009e50 tx=0x7f626800b330 comp rx=0 tx=0).stop 2023-06-08T04:01:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.016+0000 7f62779ff700 1 -- 172.21.15.16:0/2371401777 shutdown_connections 2023-06-08T04:01:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.016+0000 7f62779ff700 1 --2- 172.21.15.16:0/2371401777 >> v2:172.21.15.169:3300/0 conn(0x7f62700b83f0 0x7f6270160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.016+0000 7f62779ff700 1 --2- 172.21.15.16:0/2371401777 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b4d20 0x7f62700d0fc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.016+0000 7f62779ff700 1 -- 172.21.15.16:0/2371401777 >> 172.21.15.16:0/2371401777 conn(0x7f62700cf610 msgr2=0x7f62700cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.016+0000 7f62779ff700 1 -- 172.21.15.16:0/2371401777 shutdown_connections 2023-06-08T04:01:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.016+0000 7f62779ff700 1 -- 172.21.15.16:0/2371401777 wait complete. 2023-06-08T04:01:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.019+0000 7f62779ff700 1 Processor -- start 2023-06-08T04:01:57.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.019+0000 7f62779ff700 1 -- start start 2023-06-08T04:01:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.020+0000 7f62779ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62700b4d20 0x7f62701e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.020+0000 7f62779ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b83f0 0x7f627015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.020+0000 7f62779ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62700ced40 0x7f62701f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.020+0000 7f62779ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62701e6540 con 0x7f62700b4d20 2023-06-08T04:01:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.020+0000 7f62779ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62701e6820 con 0x7f62700ced40 2023-06-08T04:01:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.020+0000 7f62779ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62701e6b00 con 0x7f62700b83f0 2023-06-08T04:01:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.020+0000 7f627579b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62700b4d20 0x7f62701e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f627579b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62700b4d20 0x7f62701e5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37782/0 (socket says 172.21.15.16:37782) 2023-06-08T04:01:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f627579b700 1 -- 172.21.15.16:0/2593958641 learned_addr learned my addr 172.21.15.16:0/2593958641 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f6274f9a700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b83f0 0x7f627015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f6275f9c700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62700ced40 0x7f62701f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f627579b700 1 -- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b83f0 msgr2=0x7f627015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f627579b700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b83f0 0x7f627015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f627579b700 1 -- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62700ced40 msgr2=0x7f62701f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f627579b700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62700ced40 0x7f62701f0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f627579b700 1 -- 172.21.15.16:0/2593958641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268009b30 con 0x7f62700b4d20 2023-06-08T04:01:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f627579b700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62700b4d20 0x7f62701e5d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f626c00e9b0 tx=0x7f626c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f6265ffb700 1 -- 172.21.15.16:0/2593958641 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c009710 con 0x7f62700b4d20 2023-06-08T04:01:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f6265ffb700 1 -- 172.21.15.16:0/2593958641 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00ee50 con 0x7f62700b4d20 2023-06-08T04:01:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f62779ff700 1 -- 172.21.15.16:0/2593958641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62701e6de0 con 0x7f62700b4d20 2023-06-08T04:01:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.021+0000 7f6265ffb700 1 -- 172.21.15.16:0/2593958641 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00ca50 con 0x7f62700b4d20 2023-06-08T04:01:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.022+0000 7f62779ff700 1 -- 172.21.15.16:0/2593958641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62701e6250 con 0x7f62700b4d20 2023-06-08T04:01:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.023+0000 7f62779ff700 1 -- 172.21.15.16:0/2593958641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62700740e0 con 0x7f62700b4d20 2023-06-08T04:01:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.024+0000 7f6265ffb700 1 -- 172.21.15.16:0/2593958641 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f626c00cbb0 con 0x7f62700b4d20 2023-06-08T04:01:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.025+0000 7f6265ffb700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f625406ace0 0x7f625406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.025+0000 7f6265ffb700 1 -- 172.21.15.16:0/2593958641 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f626c089520 con 0x7f62700b4d20 2023-06-08T04:01:57.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.025+0000 7f6274f9a700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f625406ace0 0x7f625406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.026+0000 7f6274f9a700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f625406ace0 0x7f625406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f62701f50b0 tx=0x7f6260007e70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:57.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.030+0000 7f6265ffb700 1 -- 172.21.15.16:0/2593958641 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f626c057fa0 con 0x7f62700b4d20 2023-06-08T04:01:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.283+0000 7f62779ff700 1 -- 172.21.15.16:0/2593958641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6270160400 con 0x7f62700b4d20 2023-06-08T04:01:57.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.288+0000 7f6265ffb700 1 -- 172.21.15.16:0/2593958641 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f626c00ce60 con 0x7f62700b4d20 2023-06-08T04:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.293+0000 7f62779ff700 1 -- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f625406ace0 msgr2=0x7f625406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.293+0000 7f62779ff700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f625406ace0 0x7f625406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f62701f50b0 tx=0x7f6260007e70 comp rx=0 tx=0).stop 2023-06-08T04:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.293+0000 7f62779ff700 1 -- 172.21.15.16:0/2593958641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62700b4d20 msgr2=0x7f62701e5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.293+0000 7f62779ff700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62700b4d20 0x7f62701e5d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f626c00e9b0 tx=0x7f626c00ecc0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.295+0000 7f62779ff700 1 -- 172.21.15.16:0/2593958641 shutdown_connections 2023-06-08T04:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.295+0000 7f62779ff700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f625406ace0 0x7f625406d190 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f62701f50b0 tx=0x7f6260007e70 comp rx=0 tx=0).stop 2023-06-08T04:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.295+0000 7f62779ff700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62700ced40 0x7f62701f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.295+0000 7f62779ff700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62700b4d20 0x7f62701e5d10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.295+0000 7f62779ff700 1 --2- 172.21.15.16:0/2593958641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62700b83f0 0x7f627015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.295+0000 7f62779ff700 1 -- 172.21.15.16:0/2593958641 >> 172.21.15.16:0/2593958641 conn(0x7f62700cf610 msgr2=0x7f62700cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.306+0000 7f62779ff700 1 -- 172.21.15.16:0/2593958641 shutdown_connections 2023-06-08T04:01:57.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.313+0000 7f62779ff700 1 -- 172.21.15.16:0/2593958641 wait complete. 2023-06-08T04:01:57.321 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 3 and data pool 4 2023-06-08T04:01:57.339 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:01:57.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.536+0000 7fa37a5ff700 1 Processor -- start 2023-06-08T04:01:57.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.536+0000 7fa37a5ff700 1 -- start start 2023-06-08T04:01:57.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.537+0000 7fa37a5ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa3740b83f0 0x7fa374160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.537+0000 7fa37a5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3740ced40 0x7fa3740b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.537+0000 7fa37a5ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3740d0800 con 0x7fa3740b4b50 2023-06-08T04:01:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.537+0000 7fa37a5ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3740b4fd0 con 0x7fa3740b83f0 2023-06-08T04:01:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.537+0000 7fa37a5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740cd1e0 con 0x7fa3740ced40 2023-06-08T04:01:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.538+0000 7fa373fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa3740b83f0 0x7fa374160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.538+0000 7fa378b9c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa3740b4b50 0x7fa37406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42216/0 (socket says 172.21.15.16:42216) 2023-06-08T04:01:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.538+0000 7fa378b9c700 1 -- 172.21.15.16:0/1038408862 learned_addr learned my addr 172.21.15.16:0/1038408862 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:01:57.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.538+0000 7fa3737fe700 1 --2- 172.21.15.16:0/1038408862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3740ced40 0x7fa3740b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.538+0000 7fa373fff700 1 -- 172.21.15.16:0/1038408862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3740ced40 msgr2=0x7fa3740b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:57.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.538+0000 7fa373fff700 1 --2- 172.21.15.16:0/1038408862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3740ced40 0x7fa3740b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.538+0000 7fa373fff700 1 -- 172.21.15.16:0/1038408862 >> v1:172.21.15.16:6789/0 conn(0x7fa3740b4b50 legacy=0x7fa37406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.538+0000 7fa373fff700 1 -- 172.21.15.16:0/1038408862 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3740cd4c0 con 0x7fa3740b83f0 2023-06-08T04:01:57.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.538+0000 7fa372ffd700 1 -- 172.21.15.16:0/1038408862 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30243965 0 0) 0x7fa3740d0800 con 0x7fa3740b4b50 2023-06-08T04:01:57.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.538+0000 7fa373fff700 1 --2- 172.21.15.16:0/1038408862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3740b83f0 0x7fa374160a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa364009840 tx=0x7fa364009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfd44f4d17ffe3e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:57.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.538+0000 7fa372ffd700 1 -- 172.21.15.16:0/1038408862 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364011830 con 0x7fa3740b83f0 2023-06-08T04:01:57.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.539+0000 7fa372ffd700 1 -- 172.21.15.16:0/1038408862 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa364011990 con 0x7fa3740b83f0 2023-06-08T04:01:57.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.539+0000 7fa372ffd700 1 -- 172.21.15.16:0/1038408862 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa364011d20 con 0x7fa3740b83f0 2023-06-08T04:01:57.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.539+0000 7fa37a5ff700 1 -- 172.21.15.16:0/1038408862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3740b83f0 msgr2=0x7fa374160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.539+0000 7fa37a5ff700 1 --2- 172.21.15.16:0/1038408862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3740b83f0 0x7fa374160a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa364009840 tx=0x7fa364009b50 comp rx=0 tx=0).stop 2023-06-08T04:01:57.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.539+0000 7fa37a5ff700 1 -- 172.21.15.16:0/1038408862 shutdown_connections 2023-06-08T04:01:57.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.539+0000 7fa37a5ff700 1 --2- 172.21.15.16:0/1038408862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3740b83f0 0x7fa374160a60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.539+0000 7fa37a5ff700 1 --2- 172.21.15.16:0/1038408862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3740ced40 0x7fa3740b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.539+0000 7fa37a5ff700 1 -- 172.21.15.16:0/1038408862 >> 172.21.15.16:0/1038408862 conn(0x7fa3740cf610 msgr2=0x7fa3740cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:57.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.539+0000 7fa37a5ff700 1 -- 172.21.15.16:0/1038408862 shutdown_connections 2023-06-08T04:01:57.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.539+0000 7fa37a5ff700 1 -- 172.21.15.16:0/1038408862 wait complete. 2023-06-08T04:01:57.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.541+0000 7fa37a5ff700 1 Processor -- start 2023-06-08T04:01:57.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.541+0000 7fa37a5ff700 1 -- start start 2023-06-08T04:01:57.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.542+0000 7fa37a5ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3740b4b50 0x7fa3741541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.542+0000 7fa37a5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3740b83f0 0x7fa37415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.542+0000 7fa37a5ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3740ced40 0x7fa3740b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.542+0000 7fa37a5ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37415df20 con 0x7fa3740ced40 2023-06-08T04:01:57.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.542+0000 7fa37a5ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37415d420 con 0x7fa3740b4b50 2023-06-08T04:01:57.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.542+0000 7fa37a5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37415d700 con 0x7fa3740b83f0 2023-06-08T04:01:57.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.542+0000 7fa378b9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3740ced40 0x7fa3740b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.542+0000 7fa378b9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3740ced40 0x7fa3740b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37808/0 (socket says 172.21.15.16:37808) 2023-06-08T04:01:57.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.542+0000 7fa378b9c700 1 -- 172.21.15.16:0/3167263150 learned_addr learned my addr 172.21.15.16:0/3167263150 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:57.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.542+0000 7fa3737fe700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3740b83f0 0x7fa37415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa373fff700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3740b4b50 0x7fa3741541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa378b9c700 1 -- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3740b83f0 msgr2=0x7fa37415c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa378b9c700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3740b83f0 0x7fa37415c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa378b9c700 1 -- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3740b4b50 msgr2=0x7fa3741541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa378b9c700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3740b4b50 0x7fa3741541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa378b9c700 1 -- 172.21.15.16:0/3167263150 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3640094a0 con 0x7fa3740ced40 2023-06-08T04:01:57.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa373fff700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3740b4b50 0x7fa3741541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:01:57.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa378b9c700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3740ced40 0x7fa3740b3640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa36c002230 tx=0x7fa36c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:57.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa370ff9700 1 -- 172.21.15.16:0/3167263150 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00ac20 con 0x7fa3740ced40 2023-06-08T04:01:57.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa370ff9700 1 -- 172.21.15.16:0/3167263150 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c00ada0 con 0x7fa3740ced40 2023-06-08T04:01:57.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa37a5ff700 1 -- 172.21.15.16:0/3167263150 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37415e170 con 0x7fa3740ced40 2023-06-08T04:01:57.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa370ff9700 1 -- 172.21.15.16:0/3167263150 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c007310 con 0x7fa3740ced40 2023-06-08T04:01:57.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.543+0000 7fa37a5ff700 1 -- 172.21.15.16:0/3167263150 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3741546f0 con 0x7fa3740ced40 2023-06-08T04:01:57.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.544+0000 7fa37a5ff700 1 -- 172.21.15.16:0/3167263150 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37415d8d0 con 0x7fa3740ced40 2023-06-08T04:01:57.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.545+0000 7fa370ff9700 1 -- 172.21.15.16:0/3167263150 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa36c007470 con 0x7fa3740ced40 2023-06-08T04:01:57.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.547+0000 7fa370ff9700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa36006ace0 0x7fa36006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.547+0000 7fa370ff9700 1 -- 172.21.15.16:0/3167263150 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa36c089410 con 0x7fa3740ced40 2023-06-08T04:01:57.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.547+0000 7fa373fff700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa36006ace0 0x7fa36006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.548+0000 7fa373fff700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa36006ace0 0x7fa36006d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa364000c00 tx=0x7fa364008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:57.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.551+0000 7fa370ff9700 1 -- 172.21.15.16:0/3167263150 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa36c0544b0 con 0x7fa3740ced40 2023-06-08T04:01:57.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.759+0000 7fa37a5ff700 1 -- 172.21.15.16:0/3167263150 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3740740e0 con 0x7fa3740ced40 2023-06-08T04:01:57.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.761+0000 7fa370ff9700 1 -- 172.21.15.16:0/3167263150 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18210 (secure 0 0 0) 0x7fa36c057ad0 con 0x7fa3740ced40 2023-06-08T04:01:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:57.765 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:57.284370+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:01:57.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.763+0000 7fa37a5ff700 1 -- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa36006ace0 msgr2=0x7fa36006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.763+0000 7fa37a5ff700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa36006ace0 0x7fa36006d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa364000c00 tx=0x7fa364008030 comp rx=0 tx=0).stop 2023-06-08T04:01:57.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.763+0000 7fa37a5ff700 1 -- 172.21.15.16:0/3167263150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3740ced40 msgr2=0x7fa3740b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.763+0000 7fa37a5ff700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3740ced40 0x7fa3740b3640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa36c002230 tx=0x7fa36c00a060 comp rx=0 tx=0).stop 2023-06-08T04:01:57.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.764+0000 7fa37a5ff700 1 -- 172.21.15.16:0/3167263150 shutdown_connections 2023-06-08T04:01:57.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.764+0000 7fa37a5ff700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa36006ace0 0x7fa36006d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.764+0000 7fa37a5ff700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3740ced40 0x7fa3740b3640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.764+0000 7fa37a5ff700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3740b4b50 0x7fa3741541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.764+0000 7fa37a5ff700 1 --2- 172.21.15.16:0/3167263150 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3740b83f0 0x7fa37415c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.764+0000 7fa37a5ff700 1 -- 172.21.15.16:0/3167263150 >> 172.21.15.16:0/3167263150 conn(0x7fa3740cf610 msgr2=0x7fa37415c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.764+0000 7fa37a5ff700 1 -- 172.21.15.16:0/3167263150 shutdown_connections 2023-06-08T04:01:57.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.764+0000 7fa37a5ff700 1 -- 172.21.15.16:0/3167263150 wait complete. 2023-06-08T04:01:57.786 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:01:57.982 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:01:57.986 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:01:57.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.982+0000 7f793f1ff700 1 Processor -- start 2023-06-08T04:01:57.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.982+0000 7f793f1ff700 1 -- start start 2023-06-08T04:01:57.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.983+0000 7f793f1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 0x7f7938160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793f1ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f79380b4d20 0x7f79380d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793f1ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79380d0800 con 0x7f79380ced40 2023-06-08T04:01:57.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793f1ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79380cd1e0 con 0x7f79380b4d20 2023-06-08T04:01:57.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793f1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79380cd4c0 con 0x7f79380b83f0 2023-06-08T04:01:57.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793d79c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f79380b4d20 0x7f79380d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793cf9b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 0x7f7938160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793cf9b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 0x7f7938160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:34604/0 (socket says 172.21.15.16:34604) 2023-06-08T04:01:57.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793cf9b700 1 -- 172.21.15.16:0/2300123060 learned_addr learned my addr 172.21.15.16:0/2300123060 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:57.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793cf9b700 1 -- 172.21.15.16:0/2300123060 >> v2:172.21.15.169:3300/0 conn(0x7f79380b4d20 msgr2=0x7f79380d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:57.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793cf9b700 1 --2- 172.21.15.16:0/2300123060 >> v2:172.21.15.169:3300/0 conn(0x7f79380b4d20 0x7f79380d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793cf9b700 1 -- 172.21.15.16:0/2300123060 >> v1:172.21.15.169:6789/0 conn(0x7f79380ced40 legacy=0x7f79380b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793cf9b700 1 -- 172.21.15.16:0/2300123060 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79380d0aa0 con 0x7f79380b83f0 2023-06-08T04:01:57.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.984+0000 7f793d79c700 1 --2- 172.21.15.16:0/2300123060 >> v2:172.21.15.169:3300/0 conn(0x7f79380b4d20 0x7f79380d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:01:57.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.985+0000 7f793cf9b700 1 --2- 172.21.15.16:0/2300123060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 0x7f7938160a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f792c0098f0 tx=0x7f792c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdceccfab0ae8171 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:57.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.985+0000 7f79377fe700 1 -- 172.21.15.16:0/2300123060 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c011830 con 0x7f79380b83f0 2023-06-08T04:01:57.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.985+0000 7f79377fe700 1 -- 172.21.15.16:0/2300123060 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c011990 con 0x7f79380b83f0 2023-06-08T04:01:57.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.985+0000 7f79377fe700 1 -- 172.21.15.16:0/2300123060 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c011d20 con 0x7f79380b83f0 2023-06-08T04:01:57.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.986+0000 7f793f1ff700 1 -- 172.21.15.16:0/2300123060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 msgr2=0x7f7938160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.986+0000 7f793f1ff700 1 --2- 172.21.15.16:0/2300123060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 0x7f7938160a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f792c0098f0 tx=0x7f792c009c00 comp rx=0 tx=0).stop 2023-06-08T04:01:57.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.986+0000 7f793f1ff700 1 -- 172.21.15.16:0/2300123060 shutdown_connections 2023-06-08T04:01:57.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.986+0000 7f793f1ff700 1 --2- 172.21.15.16:0/2300123060 >> v2:172.21.15.169:3300/0 conn(0x7f79380b4d20 0x7f79380d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.986+0000 7f793f1ff700 1 --2- 172.21.15.16:0/2300123060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 0x7f7938160a60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.986+0000 7f793f1ff700 1 -- 172.21.15.16:0/2300123060 >> 172.21.15.16:0/2300123060 conn(0x7f79380cf610 msgr2=0x7f79380cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:57.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.986+0000 7f793f1ff700 1 -- 172.21.15.16:0/2300123060 shutdown_connections 2023-06-08T04:01:57.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.986+0000 7f793f1ff700 1 -- 172.21.15.16:0/2300123060 wait complete. 2023-06-08T04:01:57.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.987+0000 7f793f1ff700 1 Processor -- start 2023-06-08T04:01:57.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.988+0000 7f793f1ff700 1 -- start start 2023-06-08T04:01:57.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793f1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79380b4d20 0x7f7938151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793f1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 0x7f79380c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793f1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79380ced40 0x7f79380c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793f1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79380c6b00 con 0x7f79380b4d20 2023-06-08T04:01:57.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793f1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793815f860 con 0x7f79380ced40 2023-06-08T04:01:57.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793f1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79380c6760 con 0x7f79380b83f0 2023-06-08T04:01:57.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793cf9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79380b4d20 0x7f7938151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793cf9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79380b4d20 0x7f7938151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37824/0 (socket says 172.21.15.16:37824) 2023-06-08T04:01:57.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793cf9b700 1 -- 172.21.15.16:0/1687757734 learned_addr learned my addr 172.21.15.16:0/1687757734 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:57.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793d79c700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79380ced40 0x7f79380c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f7937fff700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 0x7f79380c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793cf9b700 1 -- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 msgr2=0x7f79380c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793cf9b700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 0x7f79380c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793cf9b700 1 -- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79380ced40 msgr2=0x7f79380c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:57.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793cf9b700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79380ced40 0x7f79380c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:57.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.989+0000 7f793cf9b700 1 -- 172.21.15.16:0/1687757734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7930009a70 con 0x7f79380b4d20 2023-06-08T04:01:57.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.990+0000 7f793cf9b700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79380b4d20 0x7f7938151060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f792c009c40 tx=0x7f792c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:57.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.990+0000 7f79357fa700 1 -- 172.21.15.16:0/1687757734 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c004470 con 0x7f79380b4d20 2023-06-08T04:01:57.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.990+0000 7f79357fa700 1 -- 172.21.15.16:0/1687757734 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c01f070 con 0x7f79380b4d20 2023-06-08T04:01:57.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.990+0000 7f79357fa700 1 -- 172.21.15.16:0/1687757734 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c0038c0 con 0x7f79380b4d20 2023-06-08T04:01:57.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.990+0000 7f793f1ff700 1 -- 172.21.15.16:0/1687757734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c009550 con 0x7f79380b4d20 2023-06-08T04:01:57.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.990+0000 7f793f1ff700 1 -- 172.21.15.16:0/1687757734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79380c8e80 con 0x7f79380b4d20 2023-06-08T04:01:57.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.991+0000 7f793f1ff700 1 -- 172.21.15.16:0/1687757734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79380740e0 con 0x7f79380b4d20 2023-06-08T04:01:57.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.992+0000 7f79357fa700 1 -- 172.21.15.16:0/1687757734 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f792c021030 con 0x7f79380b4d20 2023-06-08T04:01:57.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.994+0000 7f79357fa700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f791c06ace0 0x7f791c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:57.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.994+0000 7f79357fa700 1 -- 172.21.15.16:0/1687757734 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f792c08aba0 con 0x7f79380b4d20 2023-06-08T04:01:57.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.994+0000 7f7937fff700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f791c06ace0 0x7f791c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:57.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.995+0000 7f7937fff700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f791c06ace0 0x7f791c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f793815cc50 tx=0x7f7924009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:58.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:57.997+0000 7f79357fa700 1 -- 172.21.15.16:0/1687757734 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f792c055dc0 con 0x7f79380b4d20 2023-06-08T04:01:58.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.205+0000 7f793f1ff700 1 -- 172.21.15.16:0/1687757734 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7938071e00 con 0x7f79380b4d20 2023-06-08T04:01:58.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.206+0000 7f79357fa700 1 -- 172.21.15.16:0/1687757734 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18210 (secure 0 0 0) 0x7f792c015090 con 0x7f79380b4d20 2023-06-08T04:01:58.210 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:01:58.211 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:57.284370+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:01:58.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.208+0000 7f793f1ff700 1 -- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f791c06ace0 msgr2=0x7f791c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:58.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.208+0000 7f793f1ff700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f791c06ace0 0x7f791c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f793815cc50 tx=0x7f7924009040 comp rx=0 tx=0).stop 2023-06-08T04:01:58.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.208+0000 7f793f1ff700 1 -- 172.21.15.16:0/1687757734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79380b4d20 msgr2=0x7f7938151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:58.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.208+0000 7f793f1ff700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79380b4d20 0x7f7938151060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f792c009c40 tx=0x7f792c004750 comp rx=0 tx=0).stop 2023-06-08T04:01:58.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.209+0000 7f793f1ff700 1 -- 172.21.15.16:0/1687757734 shutdown_connections 2023-06-08T04:01:58.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.209+0000 7f793f1ff700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f791c06ace0 0x7f791c06d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:58.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.209+0000 7f793f1ff700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79380ced40 0x7f79380c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:58.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.209+0000 7f793f1ff700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79380b4d20 0x7f7938151060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:58.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.209+0000 7f793f1ff700 1 --2- 172.21.15.16:0/1687757734 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f79380b83f0 0x7f79380c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:58.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.209+0000 7f793f1ff700 1 -- 172.21.15.16:0/1687757734 >> 172.21.15.16:0/1687757734 conn(0x7f79380cf610 msgr2=0x7f793806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:58.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.209+0000 7f793f1ff700 1 -- 172.21.15.16:0/1687757734 shutdown_connections 2023-06-08T04:01:58.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.209+0000 7f793f1ff700 1 -- 172.21.15.16:0/1687757734 wait complete. 2023-06-08T04:01:58.231 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-08T04:01:58.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.433+0000 7ff4799ff700 1 Processor -- start 2023-06-08T04:01:58.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.433+0000 7ff4799ff700 1 -- start start 2023-06-08T04:01:58.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.434+0000 7ff4799ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff4740b83f0 0x7ff474160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:58.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.434+0000 7ff4799ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff4740ced40 0x7ff4740b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:58.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.434+0000 7ff4799ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff4740b4b50 0x7ff47406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:58.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.434+0000 7ff4799ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4740b4fd0 con 0x7ff4740b4b50 2023-06-08T04:01:58.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.434+0000 7ff4799ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4740d0800 con 0x7ff4740b83f0 2023-06-08T04:01:58.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.434+0000 7ff4799ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740cd1e0 con 0x7ff4740ced40 2023-06-08T04:01:58.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.434+0000 7ff4737fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff4740b4b50 0x7ff47406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:58.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.434+0000 7ff4737fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff4740b4b50 0x7ff47406b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37826/0 (socket says 172.21.15.16:37826) 2023-06-08T04:01:58.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.434+0000 7ff4737fe700 1 -- 172.21.15.16:0/1810329939 learned_addr learned my addr 172.21.15.16:0/1810329939 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:58.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.434+0000 7ff472ffd700 1 --2- 172.21.15.16:0/1810329939 >> v2:172.21.15.169:3300/0 conn(0x7ff4740b83f0 0x7ff474160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:58.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.434+0000 7ff46bfff700 1 --2- 172.21.15.16:0/1810329939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff4740ced40 0x7ff4740b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:58.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.435+0000 7ff4737fe700 1 -- 172.21.15.16:0/1810329939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff4740ced40 msgr2=0x7ff4740b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:58.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.435+0000 7ff4737fe700 1 --2- 172.21.15.16:0/1810329939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff4740ced40 0x7ff4740b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:58.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.435+0000 7ff4737fe700 1 -- 172.21.15.16:0/1810329939 >> v2:172.21.15.169:3300/0 conn(0x7ff4740b83f0 msgr2=0x7ff474160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:58.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.435+0000 7ff4737fe700 1 --2- 172.21.15.16:0/1810329939 >> v2:172.21.15.169:3300/0 conn(0x7ff4740b83f0 0x7ff474160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:58.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.435+0000 7ff4737fe700 1 -- 172.21.15.16:0/1810329939 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740cd4c0 con 0x7ff4740b4b50 2023-06-08T04:01:58.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.435+0000 7ff4737fe700 1 --2- 172.21.15.16:0/1810329939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4740b4b50 0x7ff47406b1e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff47406ca80 tx=0x7ff46c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2370c31ff2726ee7 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:58.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.435+0000 7ff4727fc700 1 -- 172.21.15.16:0/1810329939 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00e070 con 0x7ff4740b4b50 2023-06-08T04:01:58.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.435+0000 7ff4727fc700 1 -- 172.21.15.16:0/1810329939 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c00b910 con 0x7ff4740b4b50 2023-06-08T04:01:58.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.435+0000 7ff4727fc700 1 -- 172.21.15.16:0/1810329939 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00bcc0 con 0x7ff4740b4b50 2023-06-08T04:01:58.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.436+0000 7ff4799ff700 1 -- 172.21.15.16:0/1810329939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4740b4b50 msgr2=0x7ff47406b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:58.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.436+0000 7ff4799ff700 1 --2- 172.21.15.16:0/1810329939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4740b4b50 0x7ff47406b1e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff47406ca80 tx=0x7ff46c00b330 comp rx=0 tx=0).stop 2023-06-08T04:01:58.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.436+0000 7ff4799ff700 1 -- 172.21.15.16:0/1810329939 shutdown_connections 2023-06-08T04:01:58.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.436+0000 7ff4799ff700 1 --2- 172.21.15.16:0/1810329939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4740b4b50 0x7ff47406b1e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:58.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.436+0000 7ff4799ff700 1 --2- 172.21.15.16:0/1810329939 >> v2:172.21.15.169:3300/0 conn(0x7ff4740b83f0 0x7ff474160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:58.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.436+0000 7ff4799ff700 1 --2- 172.21.15.16:0/1810329939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff4740ced40 0x7ff4740b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:58.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.436+0000 7ff4799ff700 1 -- 172.21.15.16:0/1810329939 >> 172.21.15.16:0/1810329939 conn(0x7ff4740cf610 msgr2=0x7ff4740cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:58.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.436+0000 7ff4799ff700 1 -- 172.21.15.16:0/1810329939 shutdown_connections 2023-06-08T04:01:58.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.436+0000 7ff4799ff700 1 -- 172.21.15.16:0/1810329939 wait complete. 2023-06-08T04:01:58.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.438+0000 7ff4799ff700 1 Processor -- start 2023-06-08T04:01:58.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.438+0000 7ff4799ff700 1 -- start start 2023-06-08T04:01:58.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.439+0000 7ff4799ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4740b4b50 0x7ff4741e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:58.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.439+0000 7ff4799ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff4740b83f0 0x7ff4741e8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:58.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.439+0000 7ff4799ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4740ced40 0x7ff4740cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:58.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.439+0000 7ff4799ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47415dac0 con 0x7ff4740ced40 2023-06-08T04:01:58.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.439+0000 7ff4799ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47415cf40 con 0x7ff4740b4b50 2023-06-08T04:01:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.439+0000 7ff4799ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47415d220 con 0x7ff4740b83f0 2023-06-08T04:01:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.439+0000 7ff4737fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4740ced40 0x7ff4740cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.439+0000 7ff4737fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4740ced40 0x7ff4740cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37840/0 (socket says 172.21.15.16:37840) 2023-06-08T04:01:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.439+0000 7ff4737fe700 1 -- 172.21.15.16:0/652358114 learned_addr learned my addr 172.21.15.16:0/652358114 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.439+0000 7ff472ffd700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4740b4b50 0x7ff4741e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.439+0000 7ff46bfff700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff4740b83f0 0x7ff4741e8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.440+0000 7ff4737fe700 1 -- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff4740b83f0 msgr2=0x7ff4741e8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:58.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.440+0000 7ff4737fe700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff4740b83f0 0x7ff4741e8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:58.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.440+0000 7ff4737fe700 1 -- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4740b4b50 msgr2=0x7ff4741e7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:58.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.440+0000 7ff4737fe700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4740b4b50 0x7ff4741e7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:58.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.440+0000 7ff4737fe700 1 -- 172.21.15.16:0/652358114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c009b30 con 0x7ff4740ced40 2023-06-08T04:01:58.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.440+0000 7ff46bfff700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff4740b83f0 0x7ff4741e8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:01:58.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.440+0000 7ff4737fe700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4740ced40 0x7ff4740cbf60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff47406aca0 tx=0x7ff46c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:58.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.440+0000 7ff470ff9700 1 -- 172.21.15.16:0/652358114 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0099b0 con 0x7ff4740ced40 2023-06-08T04:01:58.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.440+0000 7ff470ff9700 1 -- 172.21.15.16:0/652358114 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c00ce80 con 0x7ff4740ced40 2023-06-08T04:01:58.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.440+0000 7ff470ff9700 1 -- 172.21.15.16:0/652358114 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c004490 con 0x7ff4740ced40 2023-06-08T04:01:58.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.440+0000 7ff4799ff700 1 -- 172.21.15.16:0/652358114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47415d500 con 0x7ff4740ced40 2023-06-08T04:01:58.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.441+0000 7ff4799ff700 1 -- 172.21.15.16:0/652358114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47415a1e0 con 0x7ff4740ced40 2023-06-08T04:01:58.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.441+0000 7ff4799ff700 1 -- 172.21.15.16:0/652358114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4740740e0 con 0x7ff4740ced40 2023-06-08T04:01:58.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.443+0000 7ff470ff9700 1 -- 172.21.15.16:0/652358114 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff46c0045f0 con 0x7ff4740ced40 2023-06-08T04:01:58.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.444+0000 7ff470ff9700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff45406ace0 0x7ff45406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:58.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.444+0000 7ff470ff9700 1 -- 172.21.15.16:0/652358114 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff46c08ac20 con 0x7ff4740ced40 2023-06-08T04:01:58.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.444+0000 7ff472ffd700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff45406ace0 0x7ff45406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:58.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.445+0000 7ff472ffd700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff45406ace0 0x7ff45406d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff4740d2450 tx=0x7ff464009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:58.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.447+0000 7ff470ff9700 1 -- 172.21.15.16:0/652358114 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff46c08ae60 con 0x7ff4740ced40 2023-06-08T04:01:58.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:58.699+0000 7ff4799ff700 1 -- 172.21.15.16:0/652358114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff4740b4930 con 0x7ff4740ced40 2023-06-08T04:01:59.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.295+0000 7ff470ff9700 1 -- 172.21.15.16:0/652358114 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff46c0597d0 con 0x7ff4740ced40 2023-06-08T04:01:59.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 -- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff45406ace0 msgr2=0x7ff45406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:59.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff45406ace0 0x7ff45406d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff4740d2450 tx=0x7ff464009210 comp rx=0 tx=0).stop 2023-06-08T04:01:59.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 -- 172.21.15.16:0/652358114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4740ced40 msgr2=0x7ff4740cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:59.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4740ced40 0x7ff4740cbf60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff47406aca0 tx=0x7ff46c004ad0 comp rx=0 tx=0).stop 2023-06-08T04:01:59.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 -- 172.21.15.16:0/652358114 shutdown_connections 2023-06-08T04:01:59.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff45406ace0 0x7ff45406d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:59.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4740ced40 0x7ff4740cbf60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:59.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4740b4b50 0x7ff4741e7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:59.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 --2- 172.21.15.16:0/652358114 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff4740b83f0 0x7ff4741e8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:59.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 -- 172.21.15.16:0/652358114 >> 172.21.15.16:0/652358114 conn(0x7ff4740cf610 msgr2=0x7ff47415fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:59.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 -- 172.21.15.16:0/652358114 shutdown_connections 2023-06-08T04:01:59.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.299+0000 7ff4799ff700 1 -- 172.21.15.16:0/652358114 wait complete. 2023-06-08T04:01:59.324 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-08T04:01:59.325 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-08T04:01:59.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.532+0000 7f6bda1ff700 1 Processor -- start 2023-06-08T04:01:59.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.532+0000 7f6bda1ff700 1 -- start start 2023-06-08T04:01:59.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.533+0000 7f6bda1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bd40b83f0 0x7f6bd4160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:59.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.533+0000 7f6bda1ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6bd40b4d20 0x7f6bd40d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:59.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.533+0000 7f6bda1ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd40d0800 con 0x7f6bd40ced40 2023-06-08T04:01:59.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.533+0000 7f6bda1ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd40cd1e0 con 0x7f6bd40b4d20 2023-06-08T04:01:59.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.533+0000 7f6bda1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40cd4c0 con 0x7f6bd40b83f0 2023-06-08T04:01:59.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.533+0000 7f6bd3fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6bd40b4d20 0x7f6bd40d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:59.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.533+0000 7f6bcbfff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6bd40ced40 0x7f6bd40b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42230/0 (socket says 172.21.15.16:42230) 2023-06-08T04:01:59.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.533+0000 7f6bcbfff700 1 -- 172.21.15.16:0/845022813 learned_addr learned my addr 172.21.15.16:0/845022813 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:01:59.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.533+0000 7f6bd37fe700 1 --2- 172.21.15.16:0/845022813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bd40b83f0 0x7f6bd4160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:59.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.534+0000 7f6bd3fff700 1 -- 172.21.15.16:0/845022813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bd40b83f0 msgr2=0x7f6bd4160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:01:59.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.534+0000 7f6bd3fff700 1 --2- 172.21.15.16:0/845022813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bd40b83f0 0x7f6bd4160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:59.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.534+0000 7f6bd3fff700 1 -- 172.21.15.16:0/845022813 >> v1:172.21.15.16:6789/0 conn(0x7f6bd40ced40 legacy=0x7f6bd40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:59.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.534+0000 7f6bd3fff700 1 -- 172.21.15.16:0/845022813 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd40d0aa0 con 0x7f6bd40b4d20 2023-06-08T04:01:59.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.534+0000 7f6bd3fff700 1 --2- 172.21.15.16:0/845022813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd40b4d20 0x7f6bd40d0fc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009d90 tx=0x7f6bcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b055312810ca6fa0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:59.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.534+0000 7f6bd2ffd700 1 -- 172.21.15.16:0/845022813 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00e070 con 0x7f6bd40b4d20 2023-06-08T04:01:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.534+0000 7f6bd2ffd700 1 -- 172.21.15.16:0/845022813 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc00bbd0 con 0x7f6bd40b4d20 2023-06-08T04:01:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.534+0000 7f6bd2ffd700 1 -- 172.21.15.16:0/845022813 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc012430 con 0x7f6bd40b4d20 2023-06-08T04:01:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.535+0000 7f6bda1ff700 1 -- 172.21.15.16:0/845022813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd40b4d20 msgr2=0x7f6bd40d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.535+0000 7f6bda1ff700 1 --2- 172.21.15.16:0/845022813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd40b4d20 0x7f6bd40d0fc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009d90 tx=0x7f6bcc00b330 comp rx=0 tx=0).stop 2023-06-08T04:01:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.535+0000 7f6bda1ff700 1 -- 172.21.15.16:0/845022813 shutdown_connections 2023-06-08T04:01:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.535+0000 7f6bda1ff700 1 --2- 172.21.15.16:0/845022813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd40b4d20 0x7f6bd40d0fc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.535+0000 7f6bda1ff700 1 --2- 172.21.15.16:0/845022813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bd40b83f0 0x7f6bd4160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:59.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.535+0000 7f6bda1ff700 1 -- 172.21.15.16:0/845022813 >> 172.21.15.16:0/845022813 conn(0x7f6bd40cf610 msgr2=0x7f6bd40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:01:59.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.535+0000 7f6bda1ff700 1 -- 172.21.15.16:0/845022813 shutdown_connections 2023-06-08T04:01:59.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.535+0000 7f6bda1ff700 1 -- 172.21.15.16:0/845022813 wait complete. 2023-06-08T04:01:59.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.537+0000 7f6bda1ff700 1 Processor -- start 2023-06-08T04:01:59.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.537+0000 7f6bda1ff700 1 -- start start 2023-06-08T04:01:59.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bda1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd40b4d20 0x7f6bd415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:59.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bda1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bd40b83f0 0x7f6bd41f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:59.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bda1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bd40ced40 0x7f6bd40d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:59.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bda1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd41f31e0 con 0x7f6bd40b4d20 2023-06-08T04:01:59.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bda1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd41f3a80 con 0x7f6bd40b83f0 2023-06-08T04:01:59.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bda1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40cca60 con 0x7f6bd40ced40 2023-06-08T04:01:59.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bd37fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd40b4d20 0x7f6bd415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:59.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bd37fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd40b4d20 0x7f6bd415a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37864/0 (socket says 172.21.15.16:37864) 2023-06-08T04:01:59.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bd37fe700 1 -- 172.21.15.16:0/1170246486 learned_addr learned my addr 172.21.15.16:0/1170246486 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:01:59.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bcbfff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bd40b83f0 0x7f6bd41f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:59.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bd3fff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bd40ced40 0x7f6bd40d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:59.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bd37fe700 1 -- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bd40ced40 msgr2=0x7f6bd40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:59.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bd37fe700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bd40ced40 0x7f6bd40d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:59.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bd37fe700 1 -- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bd40b83f0 msgr2=0x7f6bd41f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:01:59.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bd37fe700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bd40b83f0 0x7f6bd41f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:01:59.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bd37fe700 1 -- 172.21.15.16:0/1170246486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc009a70 con 0x7f6bd40b4d20 2023-06-08T04:01:59.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bcbfff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bd40b83f0 0x7f6bd41f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:01:59.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.538+0000 7f6bd3fff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bd40ced40 0x7f6bd40d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:01:59.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.539+0000 7f6bd37fe700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd40b4d20 0x7f6bd415a0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400e810 tx=0x7f6bc400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:59.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.539+0000 7f6bd0ff9700 1 -- 172.21.15.16:0/1170246486 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4013610 con 0x7f6bd40b4d20 2023-06-08T04:01:59.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.539+0000 7f6bd0ff9700 1 -- 172.21.15.16:0/1170246486 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc4013770 con 0x7f6bd40b4d20 2023-06-08T04:01:59.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.539+0000 7f6bd0ff9700 1 -- 172.21.15.16:0/1170246486 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4013b20 con 0x7f6bd40b4d20 2023-06-08T04:01:59.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.539+0000 7f6bda1ff700 1 -- 172.21.15.16:0/1170246486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd415a5e0 con 0x7f6bd40b4d20 2023-06-08T04:01:59.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.539+0000 7f6bda1ff700 1 -- 172.21.15.16:0/1170246486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd40aa310 con 0x7f6bd40b4d20 2023-06-08T04:01:59.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.540+0000 7f6bda1ff700 1 -- 172.21.15.16:0/1170246486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd40740e0 con 0x7f6bd40b4d20 2023-06-08T04:01:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.541+0000 7f6bd0ff9700 1 -- 172.21.15.16:0/1170246486 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6bc4013c80 con 0x7f6bd40b4d20 2023-06-08T04:01:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.542+0000 7f6bd0ff9700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6bb406ace0 0x7f6bb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:01:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.542+0000 7f6bd0ff9700 1 -- 172.21.15.16:0/1170246486 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6bc4089250 con 0x7f6bd40b4d20 2023-06-08T04:01:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.542+0000 7f6bcbfff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6bb406ace0 0x7f6bb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:01:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.543+0000 7f6bcbfff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6bb406ace0 0x7f6bb406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4160990 tx=0x7f6bbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:01:59.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.546+0000 7f6bd0ff9700 1 -- 172.21.15.16:0/1170246486 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6bc4054270 con 0x7f6bd40b4d20 2023-06-08T04:01:59.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:01:59.796+0000 7f6bda1ff700 1 -- 172.21.15.16:0/1170246486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6bd40b8870 con 0x7f6bd40b4d20 2023-06-08T04:02:00.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.779+0000 7f6bd0ff9700 1 -- 172.21.15.16:0/1170246486 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6bc4057890 con 0x7f6bd40b4d20 2023-06-08T04:02:00.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 -- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6bb406ace0 msgr2=0x7f6bb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:00.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6bb406ace0 0x7f6bb406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4160990 tx=0x7f6bbc009040 comp rx=0 tx=0).stop 2023-06-08T04:02:00.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 -- 172.21.15.16:0/1170246486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd40b4d20 msgr2=0x7f6bd415a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:00.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd40b4d20 0x7f6bd415a0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6bc400e810 tx=0x7f6bc400ebd0 comp rx=0 tx=0).stop 2023-06-08T04:02:00.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 -- 172.21.15.16:0/1170246486 shutdown_connections 2023-06-08T04:02:00.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6bb406ace0 0x7f6bb406d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:00.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6bd40ced40 0x7f6bd40d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:00.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd40b4d20 0x7f6bd415a0a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:00.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 --2- 172.21.15.16:0/1170246486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6bd40b83f0 0x7f6bd41f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:00.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 -- 172.21.15.16:0/1170246486 >> 172.21.15.16:0/1170246486 conn(0x7f6bd40cf610 msgr2=0x7f6bd40b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:00.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 -- 172.21.15.16:0/1170246486 shutdown_connections 2023-06-08T04:02:00.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:00.782+0000 7f6bda1ff700 1 -- 172.21.15.16:0/1170246486 wait complete. 2023-06-08T04:02:00.807 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-08T04:02:00.807 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T04:02:01.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.009+0000 7f8f8d3ff700 1 Processor -- start 2023-06-08T04:02:01.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.009+0000 7f8f8d3ff700 1 -- start start 2023-06-08T04:02:01.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.010+0000 7f8f8d3ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8f880b83f0 0x7f8f88160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.010+0000 7f8f8d3ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8f880b4d20 0x7f8f880d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.010+0000 7f8f8d3ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f880d0800 con 0x7f8f880ced40 2023-06-08T04:02:01.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.010+0000 7f8f8d3ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f880cd1e0 con 0x7f8f880b4d20 2023-06-08T04:02:01.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.010+0000 7f8f8d3ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f880cd4c0 con 0x7f8f880b83f0 2023-06-08T04:02:01.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.010+0000 7f8f877fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8f880b4d20 0x7f8f880d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.011+0000 7f8f877fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8f880b4d20 0x7f8f880d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37872/0 (socket says 172.21.15.16:37872) 2023-06-08T04:02:01.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.011+0000 7f8f877fe700 1 -- 172.21.15.16:0/141772877 learned_addr learned my addr 172.21.15.16:0/141772877 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:01.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.011+0000 7f8f86ffd700 1 --2- 172.21.15.16:0/141772877 >> v2:172.21.15.169:3300/0 conn(0x7f8f880b83f0 0x7f8f88160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.011+0000 7f8f877fe700 1 -- 172.21.15.16:0/141772877 >> v2:172.21.15.169:3300/0 conn(0x7f8f880b83f0 msgr2=0x7f8f88160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:01.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.011+0000 7f8f877fe700 1 --2- 172.21.15.16:0/141772877 >> v2:172.21.15.169:3300/0 conn(0x7f8f880b83f0 0x7f8f88160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.011+0000 7f8f877fe700 1 -- 172.21.15.16:0/141772877 >> v1:172.21.15.169:6789/0 conn(0x7f8f880ced40 legacy=0x7f8f880b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:01.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.011+0000 7f8f877fe700 1 -- 172.21.15.16:0/141772877 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f880d0aa0 con 0x7f8f880b4d20 2023-06-08T04:02:01.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.011+0000 7f8f877fe700 1 --2- 172.21.15.16:0/141772877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f880b4d20 0x7f8f880d0fc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f8806ca80 tx=0x7f8f8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29adc841f9eb2ac server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:01.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.011+0000 7f8f85ffb700 1 -- 172.21.15.16:0/141772877 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000e070 con 0x7f8f880b4d20 2023-06-08T04:02:01.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.011+0000 7f8f85ffb700 1 -- 172.21.15.16:0/141772877 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8000b9c0 con 0x7f8f880b4d20 2023-06-08T04:02:01.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.011+0000 7f8f85ffb700 1 -- 172.21.15.16:0/141772877 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000bd70 con 0x7f8f880b4d20 2023-06-08T04:02:01.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.012+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/141772877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f880b4d20 msgr2=0x7f8f880d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.012+0000 7f8f8d3ff700 1 --2- 172.21.15.16:0/141772877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f880b4d20 0x7f8f880d0fc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f8806ca80 tx=0x7f8f8000b330 comp rx=0 tx=0).stop 2023-06-08T04:02:01.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.012+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/141772877 shutdown_connections 2023-06-08T04:02:01.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.012+0000 7f8f8d3ff700 1 --2- 172.21.15.16:0/141772877 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f880b4d20 0x7f8f880d0fc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.012+0000 7f8f8d3ff700 1 --2- 172.21.15.16:0/141772877 >> v2:172.21.15.169:3300/0 conn(0x7f8f880b83f0 0x7f8f88160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.012+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/141772877 >> 172.21.15.16:0/141772877 conn(0x7f8f880cf610 msgr2=0x7f8f880cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:01.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.012+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/141772877 shutdown_connections 2023-06-08T04:02:01.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.012+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/141772877 wait complete. 2023-06-08T04:02:01.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.014+0000 7f8f8d3ff700 1 Processor -- start 2023-06-08T04:02:01.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.014+0000 7f8f8d3ff700 1 -- start start 2023-06-08T04:02:01.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.015+0000 7f8f8d3ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f880b4d20 0x7f8f881f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.015+0000 7f8f8d3ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f880b83f0 0x7f8f881e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.015+0000 7f8f8d3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f880ced40 0x7f8f881e6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.015+0000 7f8f8d3ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f881f2d90 con 0x7f8f880b4d20 2023-06-08T04:02:01.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.015+0000 7f8f8d3ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880cbba0 con 0x7f8f880b83f0 2023-06-08T04:02:01.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.015+0000 7f8f8d3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880cbe80 con 0x7f8f880ced40 2023-06-08T04:02:01.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.016+0000 7f8f86ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f880b4d20 0x7f8f881f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.016+0000 7f8f86ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f880b4d20 0x7f8f881f25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37882/0 (socket says 172.21.15.16:37882) 2023-06-08T04:02:01.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.016+0000 7f8f86ffd700 1 -- 172.21.15.16:0/1917469196 learned_addr learned my addr 172.21.15.16:0/1917469196 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:01.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.016+0000 7f8f86ffd700 1 -- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f880ced40 msgr2=0x7f8f881e6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.016+0000 7f8f867fc700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f880b83f0 0x7f8f881e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.016+0000 7f8f86ffd700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f880ced40 0x7f8f881e6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.016+0000 7f8f86ffd700 1 -- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f880b83f0 msgr2=0x7f8f881e5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.016+0000 7f8f86ffd700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f880b83f0 0x7f8f881e5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.016+0000 7f8f86ffd700 1 -- 172.21.15.16:0/1917469196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f80009b30 con 0x7f8f880b4d20 2023-06-08T04:02:01.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.016+0000 7f8f867fc700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f880b83f0 0x7f8f881e5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:01.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.016+0000 7f8f86ffd700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f880b4d20 0x7f8f881f25f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800e810 tx=0x7f8f7800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:01.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.017+0000 7f8f6f7fe700 1 -- 172.21.15.16:0/1917469196 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78013610 con 0x7f8f880b4d20 2023-06-08T04:02:01.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.017+0000 7f8f6f7fe700 1 -- 172.21.15.16:0/1917469196 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f78013770 con 0x7f8f880b4d20 2023-06-08T04:02:01.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.017+0000 7f8f6f7fe700 1 -- 172.21.15.16:0/1917469196 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78013b20 con 0x7f8f880b4d20 2023-06-08T04:02:01.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.017+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/1917469196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f880cc160 con 0x7f8f880b4d20 2023-06-08T04:02:01.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.017+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/1917469196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f881f2b30 con 0x7f8f880b4d20 2023-06-08T04:02:01.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.018+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/1917469196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f880cc680 con 0x7f8f880b4d20 2023-06-08T04:02:01.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.019+0000 7f8f6f7fe700 1 -- 172.21.15.16:0/1917469196 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8f78013c80 con 0x7f8f880b4d20 2023-06-08T04:02:01.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.020+0000 7f8f6f7fe700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8f7406ace0 0x7f8f7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.020+0000 7f8f6f7fe700 1 -- 172.21.15.16:0/1917469196 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f78089150 con 0x7f8f880b4d20 2023-06-08T04:02:01.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.020+0000 7f8f867fc700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8f7406ace0 0x7f8f7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.021+0000 7f8f867fc700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8f7406ace0 0x7f8f7406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8f881604e0 tx=0x7f8f7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:01.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.024+0000 7f8f6f7fe700 1 -- 172.21.15.16:0/1917469196 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8f78054210 con 0x7f8f880b4d20 2023-06-08T04:02:01.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.275+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/1917469196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f880740e0 con 0x7f8f880b4d20 2023-06-08T04:02:01.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.276+0000 7f8f6f7fe700 1 -- 172.21.15.16:0/1917469196 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f8f78057830 con 0x7f8f880b4d20 2023-06-08T04:02:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:01.280 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3633702519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3633702519},{"type":"v1","addr":"172.21.15.16:6834","nonce":3633702519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/711045362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":711045362},{"type":"v1","addr":"172.21.15.169:6837","nonce":711045362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1926912680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1926912680},{"type":"v1","addr":"172.21.15.16:6835","nonce":1926912680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T04:01:57.284697+0000","modified":"2023-06-08T04:02:00.771168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6836/1286012043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1286012043},{"type":"v1","addr":"172.21.15.169:6836","nonce":1286012043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T04:02:01.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8f7406ace0 msgr2=0x7f8f7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8f7406ace0 0x7f8f7406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8f881604e0 tx=0x7f8f7c009040 comp rx=0 tx=0).stop 2023-06-08T04:02:01.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/1917469196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f880b4d20 msgr2=0x7f8f881f25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f880b4d20 0x7f8f881f25f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800e810 tx=0x7f8f7800ebd0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/1917469196 shutdown_connections 2023-06-08T04:02:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8f7406ace0 0x7f8f7406d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f880ced40 0x7f8f881e6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f880b4d20 0x7f8f881f25f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 --2- 172.21.15.16:0/1917469196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f880b83f0 0x7f8f881e5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/1917469196 >> 172.21.15.16:0/1917469196 conn(0x7f8f880cf610 msgr2=0x7f8f8806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/1917469196 shutdown_connections 2023-06-08T04:02:01.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.278+0000 7f8f8d3ff700 1 -- 172.21.15.16:0/1917469196 wait complete. 2023-06-08T04:02:01.284 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-06-08T04:02:01.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:01.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.498+0000 7f63af5ff700 1 Processor -- start 2023-06-08T04:02:01.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.498+0000 7f63af5ff700 1 -- start start 2023-06-08T04:02:01.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.499+0000 7f63af5ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63a80b4d20 0x7f63a8167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.499+0000 7f63af5ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a80d0800 con 0x7f63a80b83f0 2023-06-08T04:02:01.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.499+0000 7f63af5ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a80cd1e0 con 0x7f63a8160a60 2023-06-08T04:02:01.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.499+0000 7f63af5ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a8160ed0 con 0x7f63a80b4d20 2023-06-08T04:02:01.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.499+0000 7f63ad39b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f63a80b83f0 0x7f63a80ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42238/0 (socket says 172.21.15.16:42238) 2023-06-08T04:02:01.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.499+0000 7f63ad39b700 1 -- 172.21.15.16:0/2673443806 learned_addr learned my addr 172.21.15.16:0/2673443806 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:01.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.499+0000 7f63adb9c700 1 --2- 172.21.15.16:0/2673443806 >> v2:172.21.15.16:3300/0 conn(0x7f63a80b4d20 0x7f63a8167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.500+0000 7f639ffff700 1 -- 172.21.15.16:0/2673443806 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677569680 0 0) 0x7f63a80d0800 con 0x7f63a80b83f0 2023-06-08T04:02:01.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.500+0000 7f639ffff700 1 -- 172.21.15.16:0/2673443806 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63940035b0 con 0x7f63a80b83f0 2023-06-08T04:02:01.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.500+0000 7f63adb9c700 1 -- 172.21.15.16:0/2673443806 >> v1:172.21.15.169:6789/0 conn(0x7f63a8160a60 legacy=0x7f63a80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.500+0000 7f63adb9c700 1 -- 172.21.15.16:0/2673443806 >> v1:172.21.15.16:6789/0 conn(0x7f63a80b83f0 legacy=0x7f63a80ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.500+0000 7f63adb9c700 1 -- 172.21.15.16:0/2673443806 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a80cd4c0 con 0x7f63a80b4d20 2023-06-08T04:02:01.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.500+0000 7f63adb9c700 1 --2- 172.21.15.16:0/2673443806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a80b4d20 0x7f63a8167260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009d90 tx=0x7f63a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cbf9f579e23acb server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:01.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.500+0000 7f639ffff700 1 -- 172.21.15.16:0/2673443806 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a000e070 con 0x7f63a80b4d20 2023-06-08T04:02:01.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.500+0000 7f639ffff700 1 -- 172.21.15.16:0/2673443806 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a000bb20 con 0x7f63a80b4d20 2023-06-08T04:02:01.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.500+0000 7f639ffff700 1 -- 172.21.15.16:0/2673443806 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0012430 con 0x7f63a80b4d20 2023-06-08T04:02:01.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.501+0000 7f63af5ff700 1 -- 172.21.15.16:0/2673443806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a80b4d20 msgr2=0x7f63a8167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.501+0000 7f63af5ff700 1 --2- 172.21.15.16:0/2673443806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a80b4d20 0x7f63a8167260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009d90 tx=0x7f63a000b330 comp rx=0 tx=0).stop 2023-06-08T04:02:01.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.501+0000 7f63af5ff700 1 -- 172.21.15.16:0/2673443806 shutdown_connections 2023-06-08T04:02:01.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.501+0000 7f63af5ff700 1 --2- 172.21.15.16:0/2673443806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a80b4d20 0x7f63a8167260 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.501+0000 7f63af5ff700 1 -- 172.21.15.16:0/2673443806 >> 172.21.15.16:0/2673443806 conn(0x7f63a80cf610 msgr2=0x7f63a80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:01.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.501+0000 7f63af5ff700 1 -- 172.21.15.16:0/2673443806 shutdown_connections 2023-06-08T04:02:01.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.501+0000 7f63af5ff700 1 -- 172.21.15.16:0/2673443806 wait complete. 2023-06-08T04:02:01.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.503+0000 7f63af5ff700 1 Processor -- start 2023-06-08T04:02:01.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.503+0000 7f63af5ff700 1 -- start start 2023-06-08T04:02:01.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.504+0000 7f63af5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a80b4d20 0x7f63a815db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.504+0000 7f63af5ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63a80b83f0 0x7f63a814d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.504+0000 7f63af5ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a8160a60 0x7f63a81595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.504+0000 7f63af5ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a81e5d30 con 0x7f63a8160a60 2023-06-08T04:02:01.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.504+0000 7f63af5ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a81f5280 con 0x7f63a80b83f0 2023-06-08T04:02:01.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.504+0000 7f63af5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a81f5520 con 0x7f63a80b4d20 2023-06-08T04:02:01.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.504+0000 7f63adb9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a8160a60 0x7f63a81595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.504+0000 7f63adb9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a8160a60 0x7f63a81595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37894/0 (socket says 172.21.15.16:37894) 2023-06-08T04:02:01.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.504+0000 7f63adb9c700 1 -- 172.21.15.16:0/196038117 learned_addr learned my addr 172.21.15.16:0/196038117 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:01.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.504+0000 7f63acb9a700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63a80b83f0 0x7f63a814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.504+0000 7f63ad39b700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a80b4d20 0x7f63a815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.505+0000 7f63adb9c700 1 -- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a80b4d20 msgr2=0x7f63a815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.505+0000 7f63adb9c700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a80b4d20 0x7f63a815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.505+0000 7f63adb9c700 1 -- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63a80b83f0 msgr2=0x7f63a814d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.505+0000 7f63adb9c700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63a80b83f0 0x7f63a814d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.505+0000 7f63adb9c700 1 -- 172.21.15.16:0/196038117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009a70 con 0x7f63a8160a60 2023-06-08T04:02:01.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.505+0000 7f63adb9c700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a8160a60 0x7f63a81595a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63a0014040 tx=0x7f63a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:01.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.505+0000 7f639dffb700 1 -- 172.21.15.16:0/196038117 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0012430 con 0x7f63a8160a60 2023-06-08T04:02:01.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.505+0000 7f639dffb700 1 -- 172.21.15.16:0/196038117 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a0020070 con 0x7f63a8160a60 2023-06-08T04:02:01.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.505+0000 7f63af5ff700 1 -- 172.21.15.16:0/196038117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a81f5800 con 0x7f63a8160a60 2023-06-08T04:02:01.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.505+0000 7f639dffb700 1 -- 172.21.15.16:0/196038117 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0004280 con 0x7f63a8160a60 2023-06-08T04:02:01.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.505+0000 7f63af5ff700 1 -- 172.21.15.16:0/196038117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a81f5dc0 con 0x7f63a8160a60 2023-06-08T04:02:01.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.507+0000 7f63af5ff700 1 -- 172.21.15.16:0/196038117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a81f5f50 con 0x7f63a8160a60 2023-06-08T04:02:01.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.507+0000 7f639dffb700 1 -- 172.21.15.16:0/196038117 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f63a00043e0 con 0x7f63a8160a60 2023-06-08T04:02:01.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.508+0000 7f639dffb700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f638c06ace0 0x7f638c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.508+0000 7f639dffb700 1 -- 172.21.15.16:0/196038117 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63a0022070 con 0x7f63a8160a60 2023-06-08T04:02:01.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.509+0000 7f63ad39b700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f638c06ace0 0x7f638c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.509+0000 7f63ad39b700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f638c06ace0 0x7f638c06d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63a4007fd0 tx=0x7f63a4007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:01.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.513+0000 7f639dffb700 1 -- 172.21.15.16:0/196038117 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63a008e030 con 0x7f63a8160a60 2023-06-08T04:02:01.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.719+0000 7f63af5ff700 1 -- 172.21.15.16:0/196038117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63a80740e0 con 0x7f63a8160a60 2023-06-08T04:02:01.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.720+0000 7f639dffb700 1 -- 172.21.15.16:0/196038117 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7f63a0056070 con 0x7f63a8160a60 2023-06-08T04:02:01.724 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:01.724 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:01.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.722+0000 7f63af5ff700 1 -- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f638c06ace0 msgr2=0x7f638c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.722+0000 7f63af5ff700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f638c06ace0 0x7f638c06d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63a4007fd0 tx=0x7f63a4007dc0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.722+0000 7f63af5ff700 1 -- 172.21.15.16:0/196038117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a8160a60 msgr2=0x7f63a81595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.722+0000 7f63af5ff700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a8160a60 0x7f63a81595a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63a0014040 tx=0x7f63a0004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.722+0000 7f63af5ff700 1 -- 172.21.15.16:0/196038117 shutdown_connections 2023-06-08T04:02:01.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.722+0000 7f63af5ff700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f638c06ace0 0x7f638c06d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.722+0000 7f63af5ff700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63a8160a60 0x7f63a81595a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.722+0000 7f63af5ff700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a80b4d20 0x7f63a815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.722+0000 7f63af5ff700 1 --2- 172.21.15.16:0/196038117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63a80b83f0 0x7f63a814d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.722+0000 7f63af5ff700 1 -- 172.21.15.16:0/196038117 >> 172.21.15.16:0/196038117 conn(0x7f63a80cf610 msgr2=0x7f63a80ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:01.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.722+0000 7f63af5ff700 1 -- 172.21.15.16:0/196038117 shutdown_connections 2023-06-08T04:02:01.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.723+0000 7f63af5ff700 1 -- 172.21.15.16:0/196038117 wait complete. 2023-06-08T04:02:01.745 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-08T04:02:01.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T04:02:01.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.942+0000 7fd2c35ff700 1 Processor -- start 2023-06-08T04:02:01.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.942+0000 7fd2c35ff700 1 -- start start 2023-06-08T04:02:01.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.943+0000 7fd2c35ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 0x7fd2bc160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.943+0000 7fd2c35ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd2bc0b4d20 0x7fd2bc0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.943+0000 7fd2c35ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc0d0800 con 0x7fd2bc0ced40 2023-06-08T04:02:01.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.943+0000 7fd2c35ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc0cd1e0 con 0x7fd2bc0b4d20 2023-06-08T04:02:01.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.943+0000 7fd2c35ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0cd4c0 con 0x7fd2bc0b83f0 2023-06-08T04:02:01.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.944+0000 7fd2c139b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 0x7fd2bc160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.944+0000 7fd2c1b9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd2bc0b4d20 0x7fd2bc0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.944+0000 7fd2c0b9a700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd2bc0ced40 0x7fd2bc0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:50064/0 (socket says 172.21.15.16:50064) 2023-06-08T04:02:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.944+0000 7fd2c0b9a700 1 -- 172.21.15.16:0/435220251 learned_addr learned my addr 172.21.15.16:0/435220251 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.944+0000 7fd2c1b9c700 1 -- 172.21.15.16:0/435220251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 msgr2=0x7fd2bc160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.944+0000 7fd2c1b9c700 1 --2- 172.21.15.16:0/435220251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 0x7fd2bc160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.944+0000 7fd2c1b9c700 1 -- 172.21.15.16:0/435220251 >> v1:172.21.15.169:6789/0 conn(0x7fd2bc0ced40 legacy=0x7fd2bc0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.944+0000 7fd2c1b9c700 1 -- 172.21.15.16:0/435220251 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0d0aa0 con 0x7fd2bc0b4d20 2023-06-08T04:02:01.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.944+0000 7fd2c139b700 1 --2- 172.21.15.16:0/435220251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 0x7fd2bc160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:02:01.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.945+0000 7fd2c1b9c700 1 --2- 172.21.15.16:0/435220251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b4d20 0x7fd2bc0d0fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009d90 tx=0x7fd2b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1878d0d4e5fc3c2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:01.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.945+0000 7fd2b3fff700 1 -- 172.21.15.16:0/435220251 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400e070 con 0x7fd2bc0b4d20 2023-06-08T04:02:01.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.945+0000 7fd2b3fff700 1 -- 172.21.15.16:0/435220251 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b400bb20 con 0x7fd2bc0b4d20 2023-06-08T04:02:01.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.945+0000 7fd2b3fff700 1 -- 172.21.15.16:0/435220251 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4012430 con 0x7fd2bc0b4d20 2023-06-08T04:02:01.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.945+0000 7fd2c35ff700 1 -- 172.21.15.16:0/435220251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b4d20 msgr2=0x7fd2bc0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.945+0000 7fd2c35ff700 1 --2- 172.21.15.16:0/435220251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b4d20 0x7fd2bc0d0fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009d90 tx=0x7fd2b400b330 comp rx=0 tx=0).stop 2023-06-08T04:02:01.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.946+0000 7fd2c35ff700 1 -- 172.21.15.16:0/435220251 shutdown_connections 2023-06-08T04:02:01.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.946+0000 7fd2c35ff700 1 --2- 172.21.15.16:0/435220251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b4d20 0x7fd2bc0d0fc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.946+0000 7fd2c35ff700 1 --2- 172.21.15.16:0/435220251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 0x7fd2bc160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.946+0000 7fd2c35ff700 1 -- 172.21.15.16:0/435220251 >> 172.21.15.16:0/435220251 conn(0x7fd2bc0cf610 msgr2=0x7fd2bc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:01.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.946+0000 7fd2c35ff700 1 -- 172.21.15.16:0/435220251 shutdown_connections 2023-06-08T04:02:01.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.946+0000 7fd2c35ff700 1 -- 172.21.15.16:0/435220251 wait complete. 2023-06-08T04:02:01.952 INFO:tasks.ceph.mds.d.smithi169.stderr:2023-06-08T04:02:01.948+0000 7fc47e3f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-08T04:02:01.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.948+0000 7fd2c35ff700 1 Processor -- start 2023-06-08T04:02:01.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.948+0000 7fd2c35ff700 1 -- start start 2023-06-08T04:02:01.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.949+0000 7fd2c35ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b4d20 0x7fd2bc153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.949+0000 7fd2c35ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b83f0 0x7fd2bc1e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.949+0000 7fd2c35ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c35ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc1f1eb0 con 0x7fd2bc0ced40 2023-06-08T04:02:01.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c35ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0caea0 con 0x7fd2bc0b83f0 2023-06-08T04:02:01.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c35ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0cb180 con 0x7fd2bc0b4d20 2023-06-08T04:02:01.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c1b9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c1b9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37902/0 (socket says 172.21.15.16:37902) 2023-06-08T04:02:01.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c1b9c700 1 -- 172.21.15.16:0/4005329302 learned_addr learned my addr 172.21.15.16:0/4005329302 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:01.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c139b700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b4d20 0x7fd2bc153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c0b9a700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b83f0 0x7fd2bc1e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c1b9c700 1 -- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b4d20 msgr2=0x7fd2bc153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c1b9c700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b4d20 0x7fd2bc153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c1b9c700 1 -- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b83f0 msgr2=0x7fd2bc1e5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:01.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c1b9c700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b83f0 0x7fd2bc1e5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:01.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c1b9c700 1 -- 172.21.15.16:0/4005329302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b80094a0 con 0x7fd2bc0ced40 2023-06-08T04:02:01.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c0b9a700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b83f0 0x7fd2bc1e5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:01.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.950+0000 7fd2c1b9c700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b3640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4014040 tx=0x7fd2b4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:01.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.951+0000 7fd2b1ffb700 1 -- 172.21.15.16:0/4005329302 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4012430 con 0x7fd2bc0ced40 2023-06-08T04:02:01.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.951+0000 7fd2b1ffb700 1 -- 172.21.15.16:0/4005329302 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b4020070 con 0x7fd2bc0ced40 2023-06-08T04:02:01.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.951+0000 7fd2c35ff700 1 -- 172.21.15.16:0/4005329302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b4009a70 con 0x7fd2bc0ced40 2023-06-08T04:02:01.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.951+0000 7fd2b1ffb700 1 -- 172.21.15.16:0/4005329302 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4003ea0 con 0x7fd2bc0ced40 2023-06-08T04:02:01.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.951+0000 7fd2c35ff700 1 -- 172.21.15.16:0/4005329302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc0cb740 con 0x7fd2bc0ced40 2023-06-08T04:02:01.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.952+0000 7fd2c35ff700 1 -- 172.21.15.16:0/4005329302 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc0740e0 con 0x7fd2bc0ced40 2023-06-08T04:02:01.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.953+0000 7fd2b1ffb700 1 -- 172.21.15.16:0/4005329302 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd2b4004280 con 0x7fd2bc0ced40 2023-06-08T04:02:01.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.954+0000 7fd2b1ffb700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd2a006ace0 0x7fd2a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:01.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.955+0000 7fd2b1ffb700 1 -- 172.21.15.16:0/4005329302 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2b4022070 con 0x7fd2bc0ced40 2023-06-08T04:02:01.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.955+0000 7fd2c139b700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd2a006ace0 0x7fd2a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:01.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.955+0000 7fd2c139b700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd2a006ace0 0x7fd2a006d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009d70 tx=0x7fd2b8009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:01.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:01.959+0000 7fd2b1ffb700 1 -- 172.21.15.16:0/4005329302 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd2b4056630 con 0x7fd2bc0ced40 2023-06-08T04:02:02.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.161+0000 7fd2c35ff700 1 -- 172.21.15.16:0/4005329302 --> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2bc0cf1b0 con 0x7fd2a006ace0 2023-06-08T04:02:02.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.172+0000 7fd2b1ffb700 1 -- 172.21.15.16:0/4005329302 <== mgr.4103 v2:172.21.15.169:6832/2339348297 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286987 (secure 0 0 0) 0x7fd2b80099c0 con 0x7fd2a006ace0 2023-06-08T04:02:02.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:02.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 -- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd2a006ace0 msgr2=0x7fd2a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd2a006ace0 0x7fd2a006d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009d70 tx=0x7fd2b8009210 comp rx=0 tx=0).stop 2023-06-08T04:02:02.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 -- 172.21.15.16:0/4005329302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 msgr2=0x7fd2bc0b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b3640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4014040 tx=0x7fd2b4004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 -- 172.21.15.16:0/4005329302 shutdown_connections 2023-06-08T04:02:02.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd2a006ace0 0x7fd2a006d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b3640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b4d20 0x7fd2bc153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 --2- 172.21.15.16:0/4005329302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b83f0 0x7fd2bc1e5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 -- 172.21.15.16:0/4005329302 >> 172.21.15.16:0/4005329302 conn(0x7fd2bc0cf610 msgr2=0x7fd2bc0d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:02.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 -- 172.21.15.16:0/4005329302 shutdown_connections 2023-06-08T04:02:02.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.176+0000 7fd2c35ff700 1 -- 172.21.15.16:0/4005329302 wait complete. 2023-06-08T04:02:02.183 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-06-08T04:02:02.198 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-06-08T04:02:00.184893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218496,"kb_used_data":2880,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756224,"statfs":{"total":773094113280,"available":772870373376,"internally_reserved":0,"allocated":2949120,"data_stored":1800195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.428108"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294976+0000","last_change":"2023-06-08T04:01:57.299413+0000","last_active":"2023-06-08T04:01:58.294976+0000","last_peered":"2023-06-08T04:01:58.294976+0000","last_clean":"2023-06-08T04:01:58.294976+0000","last_became_active":"2023-06-08T04:01:57.299094+0000","last_became_peered":"2023-06-08T04:01:57.299094+0000","last_unstale":"2023-06-08T04:01:58.294976+0000","last_undegraded":"2023-06-08T04:01:58.294976+0000","last_fullsized":"2023-06-08T04:01:58.294976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:10:14.491590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298272+0000","last_change":"2023-06-08T04:01:57.311826+0000","last_active":"2023-06-08T04:01:58.298272+0000","last_peered":"2023-06-08T04:01:58.298272+0000","last_clean":"2023-06-08T04:01:58.298272+0000","last_became_active":"2023-06-08T04:01:57.311286+0000","last_became_peered":"2023-06-08T04:01:57.311286+0000","last_unstale":"2023-06-08T04:01:58.298272+0000","last_undegraded":"2023-06-08T04:01:58.298272+0000","last_fullsized":"2023-06-08T04:01:58.298272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:17.091490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679534+0000","last_change":"2023-06-08T04:01:57.320078+0000","last_active":"2023-06-08T04:01:58.679534+0000","last_peered":"2023-06-08T04:01:58.679534+0000","last_clean":"2023-06-08T04:01:58.679534+0000","last_became_active":"2023-06-08T04:01:57.319745+0000","last_became_peered":"2023-06-08T04:01:57.319745+0000","last_unstale":"2023-06-08T04:01:58.679534+0000","last_undegraded":"2023-06-08T04:01:58.679534+0000","last_fullsized":"2023-06-08T04:01:58.679534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:13.980384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679647+0000","last_change":"2023-06-08T04:01:57.319387+0000","last_active":"2023-06-08T04:01:58.679647+0000","last_peered":"2023-06-08T04:01:58.679647+0000","last_clean":"2023-06-08T04:01:58.679647+0000","last_became_active":"2023-06-08T04:01:57.319108+0000","last_became_peered":"2023-06-08T04:01:57.319108+0000","last_unstale":"2023-06-08T04:01:58.679647+0000","last_undegraded":"2023-06-08T04:01:58.679647+0000","last_fullsized":"2023-06-08T04:01:58.679647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679228+0000","last_change":"2023-06-08T04:01:57.309338+0000","last_active":"2023-06-08T04:01:58.679228+0000","last_peered":"2023-06-08T04:01:58.679228+0000","last_clean":"2023-06-08T04:01:58.679228+0000","last_became_active":"2023-06-08T04:01:57.308408+0000","last_became_peered":"2023-06-08T04:01:57.308408+0000","last_unstale":"2023-06-08T04:01:58.679228+0000","last_undegraded":"2023-06-08T04:01:58.679228+0000","last_fullsized":"2023-06-08T04:01:58.679228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680027+0000","last_change":"2023-06-08T04:01:57.322730+0000","last_active":"2023-06-08T04:01:58.680027+0000","last_peered":"2023-06-08T04:01:58.680027+0000","last_clean":"2023-06-08T04:01:58.680027+0000","last_became_active":"2023-06-08T04:01:57.322349+0000","last_became_peered":"2023-06-08T04:01:57.322349+0000","last_unstale":"2023-06-08T04:01:58.680027+0000","last_undegraded":"2023-06-08T04:01:58.680027+0000","last_fullsized":"2023-06-08T04:01:58.680027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:51:05.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297855+0000","last_change":"2023-06-08T04:01:57.316863+0000","last_active":"2023-06-08T04:01:58.297855+0000","last_peered":"2023-06-08T04:01:58.297855+0000","last_clean":"2023-06-08T04:01:58.297855+0000","last_became_active":"2023-06-08T04:01:57.315117+0000","last_became_peered":"2023-06-08T04:01:57.315117+0000","last_unstale":"2023-06-08T04:01:58.297855+0000","last_undegraded":"2023-06-08T04:01:58.297855+0000","last_fullsized":"2023-06-08T04:01:58.297855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298377+0000","last_change":"2023-06-08T04:01:57.323352+0000","last_active":"2023-06-08T04:01:58.298377+0000","last_peered":"2023-06-08T04:01:58.298377+0000","last_clean":"2023-06-08T04:01:58.298377+0000","last_became_active":"2023-06-08T04:01:57.323064+0000","last_became_peered":"2023-06-08T04:01:57.323064+0000","last_unstale":"2023-06-08T04:01:58.298377+0000","last_undegraded":"2023-06-08T04:01:58.298377+0000","last_fullsized":"2023-06-08T04:01:58.298377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680108+0000","last_change":"2023-06-08T04:01:57.306101+0000","last_active":"2023-06-08T04:01:58.680108+0000","last_peered":"2023-06-08T04:01:58.680108+0000","last_clean":"2023-06-08T04:01:58.680108+0000","last_became_active":"2023-06-08T04:01:57.305817+0000","last_became_peered":"2023-06-08T04:01:57.305817+0000","last_unstale":"2023-06-08T04:01:58.680108+0000","last_undegraded":"2023-06-08T04:01:58.680108+0000","last_fullsized":"2023-06-08T04:01:58.680108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298566+0000","last_change":"2023-06-08T04:01:57.309420+0000","last_active":"2023-06-08T04:01:58.298566+0000","last_peered":"2023-06-08T04:01:58.298566+0000","last_clean":"2023-06-08T04:01:58.298566+0000","last_became_active":"2023-06-08T04:01:57.309076+0000","last_became_peered":"2023-06-08T04:01:57.309076+0000","last_unstale":"2023-06-08T04:01:58.298566+0000","last_undegraded":"2023-06-08T04:01:58.298566+0000","last_fullsized":"2023-06-08T04:01:58.298566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679683+0000","last_change":"2023-06-08T04:01:57.324575+0000","last_active":"2023-06-08T04:01:58.679683+0000","last_peered":"2023-06-08T04:01:58.679683+0000","last_clean":"2023-06-08T04:01:58.679683+0000","last_became_active":"2023-06-08T04:01:57.323557+0000","last_became_peered":"2023-06-08T04:01:57.323557+0000","last_unstale":"2023-06-08T04:01:58.679683+0000","last_undegraded":"2023-06-08T04:01:58.679683+0000","last_fullsized":"2023-06-08T04:01:58.679683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:47.350874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294799+0000","last_change":"2023-06-08T04:01:57.324310+0000","last_active":"2023-06-08T04:01:58.294799+0000","last_peered":"2023-06-08T04:01:58.294799+0000","last_clean":"2023-06-08T04:01:58.294799+0000","last_became_active":"2023-06-08T04:01:57.324044+0000","last_became_peered":"2023-06-08T04:01:57.324044+0000","last_unstale":"2023-06-08T04:01:58.294799+0000","last_undegraded":"2023-06-08T04:01:58.294799+0000","last_fullsized":"2023-06-08T04:01:58.294799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:15:47.285133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294647+0000","last_change":"2023-06-08T04:01:57.300242+0000","last_active":"2023-06-08T04:01:58.294647+0000","last_peered":"2023-06-08T04:01:58.294647+0000","last_clean":"2023-06-08T04:01:58.294647+0000","last_became_active":"2023-06-08T04:01:57.299927+0000","last_became_peered":"2023-06-08T04:01:57.299927+0000","last_unstale":"2023-06-08T04:01:58.294647+0000","last_undegraded":"2023-06-08T04:01:58.294647+0000","last_fullsized":"2023-06-08T04:01:58.294647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:03:23.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298679+0000","last_change":"2023-06-08T04:01:57.309428+0000","last_active":"2023-06-08T04:01:58.298679+0000","last_peered":"2023-06-08T04:01:58.298679+0000","last_clean":"2023-06-08T04:01:58.298679+0000","last_became_active":"2023-06-08T04:01:57.309107+0000","last_became_peered":"2023-06-08T04:01:57.309107+0000","last_unstale":"2023-06-08T04:01:58.298679+0000","last_undegraded":"2023-06-08T04:01:58.298679+0000","last_fullsized":"2023-06-08T04:01:58.298679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298112+0000","last_change":"2023-06-08T04:01:57.317232+0000","last_active":"2023-06-08T04:01:58.298112+0000","last_peered":"2023-06-08T04:01:58.298112+0000","last_clean":"2023-06-08T04:01:58.298112+0000","last_became_active":"2023-06-08T04:01:57.316821+0000","last_became_peered":"2023-06-08T04:01:57.316821+0000","last_unstale":"2023-06-08T04:01:58.298112+0000","last_undegraded":"2023-06-08T04:01:58.298112+0000","last_fullsized":"2023-06-08T04:01:58.298112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:18.694789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678985+0000","last_change":"2023-06-08T04:01:57.314928+0000","last_active":"2023-06-08T04:01:58.678985+0000","last_peered":"2023-06-08T04:01:58.678985+0000","last_clean":"2023-06-08T04:01:58.678985+0000","last_became_active":"2023-06-08T04:01:57.314630+0000","last_became_peered":"2023-06-08T04:01:57.314630+0000","last_unstale":"2023-06-08T04:01:58.678985+0000","last_undegraded":"2023-06-08T04:01:58.678985+0000","last_fullsized":"2023-06-08T04:01:58.678985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:50.348618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680237+0000","last_change":"2023-06-08T04:01:57.304277+0000","last_active":"2023-06-08T04:01:58.680237+0000","last_peered":"2023-06-08T04:01:58.680237+0000","last_clean":"2023-06-08T04:01:58.680237+0000","last_became_active":"2023-06-08T04:01:57.303959+0000","last_became_peered":"2023-06-08T04:01:57.303959+0000","last_unstale":"2023-06-08T04:01:58.680237+0000","last_undegraded":"2023-06-08T04:01:58.680237+0000","last_fullsized":"2023-06-08T04:01:58.680237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679694+0000","last_change":"2023-06-08T04:01:57.316825+0000","last_active":"2023-06-08T04:01:58.679694+0000","last_peered":"2023-06-08T04:01:58.679694+0000","last_clean":"2023-06-08T04:01:58.679694+0000","last_became_active":"2023-06-08T04:01:57.315505+0000","last_became_peered":"2023-06-08T04:01:57.315505+0000","last_unstale":"2023-06-08T04:01:58.679694+0000","last_undegraded":"2023-06-08T04:01:58.679694+0000","last_fullsized":"2023-06-08T04:01:58.679694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294748+0000","last_change":"2023-06-08T04:01:57.317700+0000","last_active":"2023-06-08T04:01:58.294748+0000","last_peered":"2023-06-08T04:01:58.294748+0000","last_clean":"2023-06-08T04:01:58.294748+0000","last_became_active":"2023-06-08T04:01:57.317409+0000","last_became_peered":"2023-06-08T04:01:57.317409+0000","last_unstale":"2023-06-08T04:01:58.294748+0000","last_undegraded":"2023-06-08T04:01:58.294748+0000","last_fullsized":"2023-06-08T04:01:58.294748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:21:07.937389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680014+0000","last_change":"2023-06-08T04:01:57.327000+0000","last_active":"2023-06-08T04:01:58.680014+0000","last_peered":"2023-06-08T04:01:58.680014+0000","last_clean":"2023-06-08T04:01:58.680014+0000","last_became_active":"2023-06-08T04:01:57.326736+0000","last_became_peered":"2023-06-08T04:01:57.326736+0000","last_unstale":"2023-06-08T04:01:58.680014+0000","last_undegraded":"2023-06-08T04:01:58.680014+0000","last_fullsized":"2023-06-08T04:01:58.680014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:53:41.237371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298091+0000","last_change":"2023-06-08T04:01:57.320374+0000","last_active":"2023-06-08T04:01:58.298091+0000","last_peered":"2023-06-08T04:01:58.298091+0000","last_clean":"2023-06-08T04:01:58.298091+0000","last_became_active":"2023-06-08T04:01:57.320093+0000","last_became_peered":"2023-06-08T04:01:57.320093+0000","last_unstale":"2023-06-08T04:01:58.298091+0000","last_undegraded":"2023-06-08T04:01:58.298091+0000","last_fullsized":"2023-06-08T04:01:58.298091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678990+0000","last_change":"2023-06-08T04:01:57.307041+0000","last_active":"2023-06-08T04:01:58.678990+0000","last_peered":"2023-06-08T04:01:58.678990+0000","last_clean":"2023-06-08T04:01:58.678990+0000","last_became_active":"2023-06-08T04:01:57.306750+0000","last_became_peered":"2023-06-08T04:01:57.306750+0000","last_unstale":"2023-06-08T04:01:58.678990+0000","last_undegraded":"2023-06-08T04:01:58.678990+0000","last_fullsized":"2023-06-08T04:01:58.678990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:20.141121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679647+0000","last_change":"2023-06-08T04:01:57.305284+0000","last_active":"2023-06-08T04:01:58.679647+0000","last_peered":"2023-06-08T04:01:58.679647+0000","last_clean":"2023-06-08T04:01:58.679647+0000","last_became_active":"2023-06-08T04:01:57.304750+0000","last_became_peered":"2023-06-08T04:01:57.304750+0000","last_unstale":"2023-06-08T04:01:58.679647+0000","last_undegraded":"2023-06-08T04:01:58.679647+0000","last_fullsized":"2023-06-08T04:01:58.679647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:21.118831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297864+0000","last_change":"2023-06-08T04:01:57.319635+0000","last_active":"2023-06-08T04:01:58.297864+0000","last_peered":"2023-06-08T04:01:58.297864+0000","last_clean":"2023-06-08T04:01:58.297864+0000","last_became_active":"2023-06-08T04:01:57.319342+0000","last_became_peered":"2023-06-08T04:01:57.319342+0000","last_unstale":"2023-06-08T04:01:58.297864+0000","last_undegraded":"2023-06-08T04:01:58.297864+0000","last_fullsized":"2023-06-08T04:01:58.297864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:54.420632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679843+0000","last_change":"2023-06-08T04:01:57.313530+0000","last_active":"2023-06-08T04:01:58.679843+0000","last_peered":"2023-06-08T04:01:58.679843+0000","last_clean":"2023-06-08T04:01:58.679843+0000","last_became_active":"2023-06-08T04:01:57.313216+0000","last_became_peered":"2023-06-08T04:01:57.313216+0000","last_unstale":"2023-06-08T04:01:58.679843+0000","last_undegraded":"2023-06-08T04:01:58.679843+0000","last_fullsized":"2023-06-08T04:01:58.679843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680049+0000","last_change":"2023-06-08T04:01:57.312444+0000","last_active":"2023-06-08T04:01:58.680049+0000","last_peered":"2023-06-08T04:01:58.680049+0000","last_clean":"2023-06-08T04:01:58.680049+0000","last_became_active":"2023-06-08T04:01:57.312127+0000","last_became_peered":"2023-06-08T04:01:57.312127+0000","last_unstale":"2023-06-08T04:01:58.680049+0000","last_undegraded":"2023-06-08T04:01:58.680049+0000","last_fullsized":"2023-06-08T04:01:58.680049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298912+0000","last_change":"2023-06-08T04:01:57.311749+0000","last_active":"2023-06-08T04:01:58.298912+0000","last_peered":"2023-06-08T04:01:58.298912+0000","last_clean":"2023-06-08T04:01:58.298912+0000","last_became_active":"2023-06-08T04:01:57.311478+0000","last_became_peered":"2023-06-08T04:01:57.311478+0000","last_unstale":"2023-06-08T04:01:58.298912+0000","last_undegraded":"2023-06-08T04:01:58.298912+0000","last_fullsized":"2023-06-08T04:01:58.298912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680117+0000","last_change":"2023-06-08T04:01:56.788030+0000","last_active":"2023-06-08T04:01:58.680117+0000","last_peered":"2023-06-08T04:01:58.680117+0000","last_clean":"2023-06-08T04:01:58.680117+0000","last_became_active":"2023-06-08T04:01:56.787625+0000","last_became_peered":"2023-06-08T04:01:56.787625+0000","last_unstale":"2023-06-08T04:01:58.680117+0000","last_undegraded":"2023-06-08T04:01:58.680117+0000","last_fullsized":"2023-06-08T04:01:58.680117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:19.055855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679624+0000","last_change":"2023-06-08T04:01:57.308473+0000","last_active":"2023-06-08T04:01:58.679624+0000","last_peered":"2023-06-08T04:01:58.679624+0000","last_clean":"2023-06-08T04:01:58.679624+0000","last_became_active":"2023-06-08T04:01:57.307707+0000","last_became_peered":"2023-06-08T04:01:57.307707+0000","last_unstale":"2023-06-08T04:01:58.679624+0000","last_undegraded":"2023-06-08T04:01:58.679624+0000","last_fullsized":"2023-06-08T04:01:58.679624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678826+0000","last_change":"2023-06-08T04:01:56.782915+0000","last_active":"2023-06-08T04:01:58.678826+0000","last_peered":"2023-06-08T04:01:58.678826+0000","last_clean":"2023-06-08T04:01:58.678826+0000","last_became_active":"2023-06-08T04:01:56.782574+0000","last_became_peered":"2023-06-08T04:01:56.782574+0000","last_unstale":"2023-06-08T04:01:58.678826+0000","last_undegraded":"2023-06-08T04:01:58.678826+0000","last_fullsized":"2023-06-08T04:01:58.678826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:19.133778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680505+0000","last_change":"2023-06-08T04:01:57.310946+0000","last_active":"2023-06-08T04:01:58.680505+0000","last_peered":"2023-06-08T04:01:58.680505+0000","last_clean":"2023-06-08T04:01:58.680505+0000","last_became_active":"2023-06-08T04:01:57.310665+0000","last_became_peered":"2023-06-08T04:01:57.310665+0000","last_unstale":"2023-06-08T04:01:58.680505+0000","last_undegraded":"2023-06-08T04:01:58.680505+0000","last_fullsized":"2023-06-08T04:01:58.680505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:54.420632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679960+0000","last_change":"2023-06-08T04:01:56.781278+0000","last_active":"2023-06-08T04:01:58.679960+0000","last_peered":"2023-06-08T04:01:58.679960+0000","last_clean":"2023-06-08T04:01:58.679960+0000","last_became_active":"2023-06-08T04:01:56.780953+0000","last_became_peered":"2023-06-08T04:01:56.780953+0000","last_unstale":"2023-06-08T04:01:58.679960+0000","last_undegraded":"2023-06-08T04:01:58.679960+0000","last_fullsized":"2023-06-08T04:01:58.679960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:12.973041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679890+0000","last_change":"2023-06-08T04:01:57.313256+0000","last_active":"2023-06-08T04:01:58.679890+0000","last_peered":"2023-06-08T04:01:58.679890+0000","last_clean":"2023-06-08T04:01:58.679890+0000","last_became_active":"2023-06-08T04:01:57.312990+0000","last_became_peered":"2023-06-08T04:01:57.312990+0000","last_unstale":"2023-06-08T04:01:58.679890+0000","last_undegraded":"2023-06-08T04:01:58.679890+0000","last_fullsized":"2023-06-08T04:01:58.679890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680347+0000","last_change":"2023-06-08T04:01:56.773826+0000","last_active":"2023-06-08T04:01:58.680347+0000","last_peered":"2023-06-08T04:01:58.680347+0000","last_clean":"2023-06-08T04:01:58.680347+0000","last_became_active":"2023-06-08T04:01:56.773459+0000","last_became_peered":"2023-06-08T04:01:56.773459+0000","last_unstale":"2023-06-08T04:01:58.680347+0000","last_undegraded":"2023-06-08T04:01:58.680347+0000","last_fullsized":"2023-06-08T04:01:58.680347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:24.507881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679843+0000","last_change":"2023-06-08T04:01:57.304560+0000","last_active":"2023-06-08T04:01:58.679843+0000","last_peered":"2023-06-08T04:01:58.679843+0000","last_clean":"2023-06-08T04:01:58.679843+0000","last_became_active":"2023-06-08T04:01:57.304311+0000","last_became_peered":"2023-06-08T04:01:57.304311+0000","last_unstale":"2023-06-08T04:01:58.679843+0000","last_undegraded":"2023-06-08T04:01:58.679843+0000","last_fullsized":"2023-06-08T04:01:58.679843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:12:00.959096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298423+0000","last_change":"2023-06-08T04:01:56.783994+0000","last_active":"2023-06-08T04:01:58.298423+0000","last_peered":"2023-06-08T04:01:58.298423+0000","last_clean":"2023-06-08T04:01:58.298423+0000","last_became_active":"2023-06-08T04:01:56.783344+0000","last_became_peered":"2023-06-08T04:01:56.783344+0000","last_unstale":"2023-06-08T04:01:58.298423+0000","last_undegraded":"2023-06-08T04:01:58.298423+0000","last_fullsized":"2023-06-08T04:01:58.298423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:42.712772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680687+0000","last_change":"2023-06-08T04:01:57.313756+0000","last_active":"2023-06-08T04:01:58.680687+0000","last_peered":"2023-06-08T04:01:58.680687+0000","last_clean":"2023-06-08T04:01:58.680687+0000","last_became_active":"2023-06-08T04:01:57.313436+0000","last_became_peered":"2023-06-08T04:01:57.313436+0000","last_unstale":"2023-06-08T04:01:58.680687+0000","last_undegraded":"2023-06-08T04:01:58.680687+0000","last_fullsized":"2023-06-08T04:01:58.680687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:19:05.998159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299112+0000","last_change":"2023-06-08T04:01:56.788377+0000","last_active":"2023-06-08T04:01:58.299112+0000","last_peered":"2023-06-08T04:01:58.299112+0000","last_clean":"2023-06-08T04:01:58.299112+0000","last_became_active":"2023-06-08T04:01:56.788107+0000","last_became_peered":"2023-06-08T04:01:56.788107+0000","last_unstale":"2023-06-08T04:01:58.299112+0000","last_undegraded":"2023-06-08T04:01:58.299112+0000","last_fullsized":"2023-06-08T04:01:58.299112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:11.801004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679085+0000","last_change":"2023-06-08T04:01:57.313322+0000","last_active":"2023-06-08T04:01:58.679085+0000","last_peered":"2023-06-08T04:01:58.679085+0000","last_clean":"2023-06-08T04:01:58.679085+0000","last_became_active":"2023-06-08T04:01:57.312901+0000","last_became_peered":"2023-06-08T04:01:57.312901+0000","last_unstale":"2023-06-08T04:01:58.679085+0000","last_undegraded":"2023-06-08T04:01:58.679085+0000","last_fullsized":"2023-06-08T04:01:58.679085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679636+0000","last_change":"2023-06-08T04:01:56.787707+0000","last_active":"2023-06-08T04:01:58.679636+0000","last_peered":"2023-06-08T04:01:58.679636+0000","last_clean":"2023-06-08T04:01:58.679636+0000","last_became_active":"2023-06-08T04:01:56.787416+0000","last_became_peered":"2023-06-08T04:01:56.787416+0000","last_unstale":"2023-06-08T04:01:58.679636+0000","last_undegraded":"2023-06-08T04:01:58.679636+0000","last_fullsized":"2023-06-08T04:01:58.679636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:17.687446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679084+0000","last_change":"2023-06-08T04:01:57.330479+0000","last_active":"2023-06-08T04:01:58.679084+0000","last_peered":"2023-06-08T04:01:58.679084+0000","last_clean":"2023-06-08T04:01:58.679084+0000","last_became_active":"2023-06-08T04:01:57.330160+0000","last_became_peered":"2023-06-08T04:01:57.330160+0000","last_unstale":"2023-06-08T04:01:58.679084+0000","last_undegraded":"2023-06-08T04:01:58.679084+0000","last_fullsized":"2023-06-08T04:01:58.679084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298027+0000","last_change":"2023-06-08T04:01:56.784611+0000","last_active":"2023-06-08T04:01:58.298027+0000","last_peered":"2023-06-08T04:01:58.298027+0000","last_clean":"2023-06-08T04:01:58.298027+0000","last_became_active":"2023-06-08T04:01:56.784281+0000","last_became_peered":"2023-06-08T04:01:56.784281+0000","last_unstale":"2023-06-08T04:01:58.298027+0000","last_undegraded":"2023-06-08T04:01:58.298027+0000","last_fullsized":"2023-06-08T04:01:58.298027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:12.973041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679123+0000","last_change":"2023-06-08T04:01:57.308023+0000","last_active":"2023-06-08T04:01:58.679123+0000","last_peered":"2023-06-08T04:01:58.679123+0000","last_clean":"2023-06-08T04:01:58.679123+0000","last_became_active":"2023-06-08T04:01:57.307736+0000","last_became_peered":"2023-06-08T04:01:57.307736+0000","last_unstale":"2023-06-08T04:01:58.679123+0000","last_undegraded":"2023-06-08T04:01:58.679123+0000","last_fullsized":"2023-06-08T04:01:58.679123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679194+0000","last_change":"2023-06-08T04:01:56.785032+0000","last_active":"2023-06-08T04:01:58.679194+0000","last_peered":"2023-06-08T04:01:58.679194+0000","last_clean":"2023-06-08T04:01:58.679194+0000","last_became_active":"2023-06-08T04:01:56.784737+0000","last_became_peered":"2023-06-08T04:01:56.784737+0000","last_unstale":"2023-06-08T04:01:58.679194+0000","last_undegraded":"2023-06-08T04:01:58.679194+0000","last_fullsized":"2023-06-08T04:01:58.679194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:16.084147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298926+0000","last_change":"2023-06-08T04:01:57.311452+0000","last_active":"2023-06-08T04:01:58.298926+0000","last_peered":"2023-06-08T04:01:58.298926+0000","last_clean":"2023-06-08T04:01:58.298926+0000","last_became_active":"2023-06-08T04:01:57.311216+0000","last_became_peered":"2023-06-08T04:01:57.311216+0000","last_unstale":"2023-06-08T04:01:58.298926+0000","last_undegraded":"2023-06-08T04:01:58.298926+0000","last_fullsized":"2023-06-08T04:01:58.298926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:25.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298001+0000","last_change":"2023-06-08T04:01:56.787492+0000","last_active":"2023-06-08T04:01:58.298001+0000","last_peered":"2023-06-08T04:01:58.298001+0000","last_clean":"2023-06-08T04:01:58.298001+0000","last_became_active":"2023-06-08T04:01:56.787212+0000","last_became_peered":"2023-06-08T04:01:56.787212+0000","last_unstale":"2023-06-08T04:01:58.298001+0000","last_undegraded":"2023-06-08T04:01:58.298001+0000","last_fullsized":"2023-06-08T04:01:58.298001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:11:59.951753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680188+0000","last_change":"2023-06-08T04:01:57.307696+0000","last_active":"2023-06-08T04:01:58.680188+0000","last_peered":"2023-06-08T04:01:58.680188+0000","last_clean":"2023-06-08T04:01:58.680188+0000","last_became_active":"2023-06-08T04:01:57.307394+0000","last_became_peered":"2023-06-08T04:01:57.307394+0000","last_unstale":"2023-06-08T04:01:58.680188+0000","last_undegraded":"2023-06-08T04:01:58.680188+0000","last_fullsized":"2023-06-08T04:01:58.680188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679211+0000","last_change":"2023-06-08T04:01:56.792893+0000","last_active":"2023-06-08T04:01:58.679211+0000","last_peered":"2023-06-08T04:01:58.679211+0000","last_clean":"2023-06-08T04:01:58.679211+0000","last_became_active":"2023-06-08T04:01:56.792583+0000","last_became_peered":"2023-06-08T04:01:56.792583+0000","last_unstale":"2023-06-08T04:01:58.679211+0000","last_undegraded":"2023-06-08T04:01:58.679211+0000","last_fullsized":"2023-06-08T04:01:58.679211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:51:11.572500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679629+0000","last_change":"2023-06-08T04:01:57.313638+0000","last_active":"2023-06-08T04:01:58.679629+0000","last_peered":"2023-06-08T04:01:58.679629+0000","last_clean":"2023-06-08T04:01:58.679629+0000","last_became_active":"2023-06-08T04:01:57.313084+0000","last_became_peered":"2023-06-08T04:01:57.313084+0000","last_unstale":"2023-06-08T04:01:58.679629+0000","last_undegraded":"2023-06-08T04:01:58.679629+0000","last_fullsized":"2023-06-08T04:01:58.679629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:23.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298175+0000","last_change":"2023-06-08T04:01:56.786135+0000","last_active":"2023-06-08T04:01:58.298175+0000","last_peered":"2023-06-08T04:01:58.298175+0000","last_clean":"2023-06-08T04:01:58.298175+0000","last_became_active":"2023-06-08T04:01:56.785831+0000","last_became_peered":"2023-06-08T04:01:56.785831+0000","last_unstale":"2023-06-08T04:01:58.298175+0000","last_undegraded":"2023-06-08T04:01:58.298175+0000","last_fullsized":"2023-06-08T04:01:58.298175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:46.343531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298483+0000","last_change":"2023-06-08T04:01:57.311375+0000","last_active":"2023-06-08T04:01:58.298483+0000","last_peered":"2023-06-08T04:01:58.298483+0000","last_clean":"2023-06-08T04:01:58.298483+0000","last_became_active":"2023-06-08T04:01:57.310796+0000","last_became_peered":"2023-06-08T04:01:57.310796+0000","last_unstale":"2023-06-08T04:01:58.298483+0000","last_undegraded":"2023-06-08T04:01:58.298483+0000","last_fullsized":"2023-06-08T04:01:58.298483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:41.897231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298396+0000","last_change":"2023-06-08T04:01:56.786840+0000","last_active":"2023-06-08T04:01:58.298396+0000","last_peered":"2023-06-08T04:01:58.298396+0000","last_clean":"2023-06-08T04:01:58.298396+0000","last_became_active":"2023-06-08T04:01:56.786481+0000","last_became_peered":"2023-06-08T04:01:56.786481+0000","last_unstale":"2023-06-08T04:01:58.298396+0000","last_undegraded":"2023-06-08T04:01:58.298396+0000","last_fullsized":"2023-06-08T04:01:58.298396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:19:04.990816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678894+0000","last_change":"2023-06-08T04:01:57.324051+0000","last_active":"2023-06-08T04:01:58.678894+0000","last_peered":"2023-06-08T04:01:58.678894+0000","last_clean":"2023-06-08T04:01:58.678894+0000","last_became_active":"2023-06-08T04:01:57.323207+0000","last_became_peered":"2023-06-08T04:01:57.323207+0000","last_unstale":"2023-06-08T04:01:58.678894+0000","last_undegraded":"2023-06-08T04:01:58.678894+0000","last_fullsized":"2023-06-08T04:01:58.678894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299059+0000","last_change":"2023-06-08T04:01:56.785385+0000","last_active":"2023-06-08T04:01:58.299059+0000","last_peered":"2023-06-08T04:01:58.299059+0000","last_clean":"2023-06-08T04:01:58.299059+0000","last_became_active":"2023-06-08T04:01:56.785079+0000","last_became_peered":"2023-06-08T04:01:56.785079+0000","last_unstale":"2023-06-08T04:01:58.299059+0000","last_undegraded":"2023-06-08T04:01:58.299059+0000","last_fullsized":"2023-06-08T04:01:58.299059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:56.785165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679791+0000","last_change":"2023-06-08T04:01:57.313448+0000","last_active":"2023-06-08T04:01:58.679791+0000","last_peered":"2023-06-08T04:01:58.679791+0000","last_clean":"2023-06-08T04:01:58.679791+0000","last_became_active":"2023-06-08T04:01:57.312734+0000","last_became_peered":"2023-06-08T04:01:57.312734+0000","last_unstale":"2023-06-08T04:01:58.679791+0000","last_undegraded":"2023-06-08T04:01:58.679791+0000","last_fullsized":"2023-06-08T04:01:58.679791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298787+0000","last_change":"2023-06-08T04:01:56.779903+0000","last_active":"2023-06-08T04:01:58.298787+0000","last_peered":"2023-06-08T04:01:58.298787+0000","last_clean":"2023-06-08T04:01:58.298787+0000","last_became_active":"2023-06-08T04:01:56.779569+0000","last_became_peered":"2023-06-08T04:01:56.779569+0000","last_unstale":"2023-06-08T04:01:58.298787+0000","last_undegraded":"2023-06-08T04:01:58.298787+0000","last_fullsized":"2023-06-08T04:01:58.298787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:52.080071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679025+0000","last_change":"2023-06-08T04:01:57.309781+0000","last_active":"2023-06-08T04:01:58.679025+0000","last_peered":"2023-06-08T04:01:58.679025+0000","last_clean":"2023-06-08T04:01:58.679025+0000","last_became_active":"2023-06-08T04:01:57.309383+0000","last_became_peered":"2023-06-08T04:01:57.309383+0000","last_unstale":"2023-06-08T04:01:58.679025+0000","last_undegraded":"2023-06-08T04:01:58.679025+0000","last_fullsized":"2023-06-08T04:01:58.679025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680127+0000","last_change":"2023-06-08T04:01:56.785855+0000","last_active":"2023-06-08T04:01:58.680127+0000","last_peered":"2023-06-08T04:01:58.680127+0000","last_clean":"2023-06-08T04:01:58.680127+0000","last_became_active":"2023-06-08T04:01:56.785233+0000","last_became_peered":"2023-06-08T04:01:56.785233+0000","last_unstale":"2023-06-08T04:01:58.680127+0000","last_undegraded":"2023-06-08T04:01:58.680127+0000","last_fullsized":"2023-06-08T04:01:58.680127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:17.687446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679452+0000","last_change":"2023-06-08T04:01:57.322184+0000","last_active":"2023-06-08T04:01:58.679452+0000","last_peered":"2023-06-08T04:01:58.679452+0000","last_clean":"2023-06-08T04:01:58.679452+0000","last_became_active":"2023-06-08T04:01:57.321644+0000","last_became_peered":"2023-06-08T04:01:57.321644+0000","last_unstale":"2023-06-08T04:01:58.679452+0000","last_undegraded":"2023-06-08T04:01:58.679452+0000","last_fullsized":"2023-06-08T04:01:58.679452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:12:00.959096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679629+0000","last_change":"2023-06-08T04:01:56.793021+0000","last_active":"2023-06-08T04:01:58.679629+0000","last_peered":"2023-06-08T04:01:58.679629+0000","last_clean":"2023-06-08T04:01:58.679629+0000","last_became_active":"2023-06-08T04:01:56.792695+0000","last_became_peered":"2023-06-08T04:01:56.792695+0000","last_unstale":"2023-06-08T04:01:58.679629+0000","last_undegraded":"2023-06-08T04:01:58.679629+0000","last_fullsized":"2023-06-08T04:01:58.679629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:16.084147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679919+0000","last_change":"2023-06-08T04:01:57.315172+0000","last_active":"2023-06-08T04:01:58.679919+0000","last_peered":"2023-06-08T04:01:58.679919+0000","last_clean":"2023-06-08T04:01:58.679919+0000","last_became_active":"2023-06-08T04:01:57.314816+0000","last_became_peered":"2023-06-08T04:01:57.314816+0000","last_unstale":"2023-06-08T04:01:58.679919+0000","last_undegraded":"2023-06-08T04:01:58.679919+0000","last_fullsized":"2023-06-08T04:01:58.679919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:12.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679033+0000","last_change":"2023-06-08T04:01:56.782841+0000","last_active":"2023-06-08T04:01:58.679033+0000","last_peered":"2023-06-08T04:01:58.679033+0000","last_clean":"2023-06-08T04:01:58.679033+0000","last_became_active":"2023-06-08T04:01:56.782518+0000","last_became_peered":"2023-06-08T04:01:56.782518+0000","last_unstale":"2023-06-08T04:01:58.679033+0000","last_undegraded":"2023-06-08T04:01:58.679033+0000","last_fullsized":"2023-06-08T04:01:58.679033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679866+0000","last_change":"2023-06-08T04:01:57.326388+0000","last_active":"2023-06-08T04:01:58.679866+0000","last_peered":"2023-06-08T04:01:58.679866+0000","last_clean":"2023-06-08T04:01:58.679866+0000","last_became_active":"2023-06-08T04:01:57.326127+0000","last_became_peered":"2023-06-08T04:01:57.326127+0000","last_unstale":"2023-06-08T04:01:58.679866+0000","last_undegraded":"2023-06-08T04:01:58.679866+0000","last_fullsized":"2023-06-08T04:01:58.679866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:57.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679592+0000","last_change":"2023-06-08T04:01:56.789026+0000","last_active":"2023-06-08T04:01:58.679592+0000","last_peered":"2023-06-08T04:01:58.679592+0000","last_clean":"2023-06-08T04:01:58.679592+0000","last_became_active":"2023-06-08T04:01:56.788477+0000","last_became_peered":"2023-06-08T04:01:56.788477+0000","last_unstale":"2023-06-08T04:01:58.679592+0000","last_undegraded":"2023-06-08T04:01:58.679592+0000","last_fullsized":"2023-06-08T04:01:58.679592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680114+0000","last_change":"2023-06-08T04:01:57.305826+0000","last_active":"2023-06-08T04:01:58.680114+0000","last_peered":"2023-06-08T04:01:58.680114+0000","last_clean":"2023-06-08T04:01:58.680114+0000","last_became_active":"2023-06-08T04:01:57.305443+0000","last_became_peered":"2023-06-08T04:01:57.305443+0000","last_unstale":"2023-06-08T04:01:58.680114+0000","last_undegraded":"2023-06-08T04:01:58.680114+0000","last_fullsized":"2023-06-08T04:01:58.680114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679382+0000","last_change":"2023-06-08T04:01:56.789943+0000","last_active":"2023-06-08T04:01:58.679382+0000","last_peered":"2023-06-08T04:01:58.679382+0000","last_clean":"2023-06-08T04:01:58.679382+0000","last_became_active":"2023-06-08T04:01:56.789641+0000","last_became_peered":"2023-06-08T04:01:56.789641+0000","last_unstale":"2023-06-08T04:01:58.679382+0000","last_undegraded":"2023-06-08T04:01:58.679382+0000","last_fullsized":"2023-06-08T04:01:58.679382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:24.507881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679700+0000","last_change":"2023-06-08T04:01:50.999784+0000","last_active":"2023-06-08T04:01:58.679700+0000","last_peered":"2023-06-08T04:01:58.679700+0000","last_clean":"2023-06-08T04:01:58.679700+0000","last_became_active":"2023-06-08T04:01:50.999446+0000","last_became_peered":"2023-06-08T04:01:50.999446+0000","last_unstale":"2023-06-08T04:01:58.679700+0000","last_undegraded":"2023-06-08T04:01:58.679700+0000","last_fullsized":"2023-06-08T04:01:58.679700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:18:58.957649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679453+0000","last_change":"2023-06-08T04:01:57.314412+0000","last_active":"2023-06-08T04:01:58.679453+0000","last_peered":"2023-06-08T04:01:58.679453+0000","last_clean":"2023-06-08T04:01:58.679453+0000","last_became_active":"2023-06-08T04:01:57.314079+0000","last_became_peered":"2023-06-08T04:01:57.314079+0000","last_unstale":"2023-06-08T04:01:58.679453+0000","last_undegraded":"2023-06-08T04:01:58.679453+0000","last_fullsized":"2023-06-08T04:01:58.679453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:50.348618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679209+0000","last_change":"2023-06-08T04:01:50.729188+0000","last_active":"2023-06-08T04:01:58.679209+0000","last_peered":"2023-06-08T04:01:58.679209+0000","last_clean":"2023-06-08T04:01:58.679209+0000","last_became_active":"2023-06-08T04:01:50.728711+0000","last_became_peered":"2023-06-08T04:01:50.728711+0000","last_unstale":"2023-06-08T04:01:58.679209+0000","last_undegraded":"2023-06-08T04:01:58.679209+0000","last_fullsized":"2023-06-08T04:01:58.679209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:46.046903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680628+0000","last_change":"2023-06-08T04:01:56.784336+0000","last_active":"2023-06-08T04:01:58.680628+0000","last_peered":"2023-06-08T04:01:58.680628+0000","last_clean":"2023-06-08T04:01:58.680628+0000","last_became_active":"2023-06-08T04:01:56.783906+0000","last_became_peered":"2023-06-08T04:01:56.783906+0000","last_unstale":"2023-06-08T04:01:58.680628+0000","last_undegraded":"2023-06-08T04:01:58.680628+0000","last_fullsized":"2023-06-08T04:01:58.680628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:48.770281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678949+0000","last_change":"2023-06-08T04:01:57.325405+0000","last_active":"2023-06-08T04:01:58.678949+0000","last_peered":"2023-06-08T04:01:58.678949+0000","last_clean":"2023-06-08T04:01:58.678949+0000","last_became_active":"2023-06-08T04:01:57.325123+0000","last_became_peered":"2023-06-08T04:01:57.325123+0000","last_unstale":"2023-06-08T04:01:58.678949+0000","last_undegraded":"2023-06-08T04:01:58.678949+0000","last_fullsized":"2023-06-08T04:01:58.678949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:25.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678720+0000","last_change":"2023-06-08T04:01:50.734710+0000","last_active":"2023-06-08T04:01:58.678720+0000","last_peered":"2023-06-08T04:01:58.678720+0000","last_clean":"2023-06-08T04:01:58.678720+0000","last_became_active":"2023-06-08T04:01:50.734287+0000","last_became_peered":"2023-06-08T04:01:50.734287+0000","last_unstale":"2023-06-08T04:01:58.678720+0000","last_undegraded":"2023-06-08T04:01:58.678720+0000","last_fullsized":"2023-06-08T04:01:58.678720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:51:05.539333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297919+0000","last_change":"2023-06-08T04:01:51.742803+0000","last_active":"2023-06-08T04:01:58.297919+0000","last_peered":"2023-06-08T04:01:58.297919+0000","last_clean":"2023-06-08T04:01:58.297919+0000","last_became_active":"2023-06-08T04:01:51.742466+0000","last_became_peered":"2023-06-08T04:01:51.742466+0000","last_unstale":"2023-06-08T04:01:58.297919+0000","last_undegraded":"2023-06-08T04:01:58.297919+0000","last_fullsized":"2023-06-08T04:01:58.297919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_clean_scrub_stamp":"2023-06-08T04:01:50.718021+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:17.413272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679950+0000","last_change":"2023-06-08T04:01:56.783919+0000","last_active":"2023-06-08T04:01:58.679950+0000","last_peered":"2023-06-08T04:01:58.679950+0000","last_clean":"2023-06-08T04:01:58.679950+0000","last_became_active":"2023-06-08T04:01:56.783607+0000","last_became_peered":"2023-06-08T04:01:56.783607+0000","last_unstale":"2023-06-08T04:01:58.679950+0000","last_undegraded":"2023-06-08T04:01:58.679950+0000","last_fullsized":"2023-06-08T04:01:58.679950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:27.687219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680318+0000","last_change":"2023-06-08T04:01:57.309149+0000","last_active":"2023-06-08T04:01:58.680318+0000","last_peered":"2023-06-08T04:01:58.680318+0000","last_clean":"2023-06-08T04:01:58.680318+0000","last_became_active":"2023-06-08T04:01:57.308445+0000","last_became_peered":"2023-06-08T04:01:57.308445+0000","last_unstale":"2023-06-08T04:01:58.680318+0000","last_undegraded":"2023-06-08T04:01:58.680318+0000","last_fullsized":"2023-06-08T04:01:58.680318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297951+0000","last_change":"2023-06-08T04:01:51.001331+0000","last_active":"2023-06-08T04:01:58.297951+0000","last_peered":"2023-06-08T04:01:58.297951+0000","last_clean":"2023-06-08T04:01:58.297951+0000","last_became_active":"2023-06-08T04:01:51.001009+0000","last_became_peered":"2023-06-08T04:01:51.001009+0000","last_unstale":"2023-06-08T04:01:58.297951+0000","last_undegraded":"2023-06-08T04:01:58.297951+0000","last_fullsized":"2023-06-08T04:01:58.297951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:14.078321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678533+0000","last_change":"2023-06-08T04:01:56.787400+0000","last_active":"2023-06-08T04:01:58.678533+0000","last_peered":"2023-06-08T04:01:58.678533+0000","last_clean":"2023-06-08T04:01:58.678533+0000","last_became_active":"2023-06-08T04:01:56.785569+0000","last_became_peered":"2023-06-08T04:01:56.785569+0000","last_unstale":"2023-06-08T04:01:58.678533+0000","last_undegraded":"2023-06-08T04:01:58.678533+0000","last_fullsized":"2023-06-08T04:01:58.678533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:44:53.499091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679987+0000","last_change":"2023-06-08T04:01:57.314750+0000","last_active":"2023-06-08T04:01:58.679987+0000","last_peered":"2023-06-08T04:01:58.679987+0000","last_clean":"2023-06-08T04:01:58.679987+0000","last_became_active":"2023-06-08T04:01:57.314472+0000","last_became_peered":"2023-06-08T04:01:57.314472+0000","last_unstale":"2023-06-08T04:01:58.679987+0000","last_undegraded":"2023-06-08T04:01:58.679987+0000","last_fullsized":"2023-06-08T04:01:58.679987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297740+0000","last_change":"2023-06-08T04:01:51.000319+0000","last_active":"2023-06-08T04:01:58.297740+0000","last_peered":"2023-06-08T04:01:58.297740+0000","last_clean":"2023-06-08T04:01:58.297740+0000","last_became_active":"2023-06-08T04:01:50.999943+0000","last_became_peered":"2023-06-08T04:01:50.999943+0000","last_unstale":"2023-06-08T04:01:58.297740+0000","last_undegraded":"2023-06-08T04:01:58.297740+0000","last_fullsized":"2023-06-08T04:01:58.297740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:43.308108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678945+0000","last_change":"2023-06-08T04:01:56.774312+0000","last_active":"2023-06-08T04:01:58.678945+0000","last_peered":"2023-06-08T04:01:58.678945+0000","last_clean":"2023-06-08T04:01:58.678945+0000","last_became_active":"2023-06-08T04:01:56.774005+0000","last_became_peered":"2023-06-08T04:01:56.774005+0000","last_unstale":"2023-06-08T04:01:58.678945+0000","last_undegraded":"2023-06-08T04:01:58.678945+0000","last_fullsized":"2023-06-08T04:01:58.678945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:30.163198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679484+0000","last_change":"2023-06-08T04:01:57.326639+0000","last_active":"2023-06-08T04:01:58.679484+0000","last_peered":"2023-06-08T04:01:58.679484+0000","last_clean":"2023-06-08T04:01:58.679484+0000","last_became_active":"2023-06-08T04:01:57.326373+0000","last_became_peered":"2023-06-08T04:01:57.326373+0000","last_unstale":"2023-06-08T04:01:58.679484+0000","last_undegraded":"2023-06-08T04:01:58.679484+0000","last_fullsized":"2023-06-08T04:01:58.679484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298044+0000","last_change":"2023-06-08T04:01:51.000090+0000","last_active":"2023-06-08T04:01:58.298044+0000","last_peered":"2023-06-08T04:01:58.298044+0000","last_clean":"2023-06-08T04:01:58.298044+0000","last_became_active":"2023-06-08T04:01:50.999789+0000","last_became_peered":"2023-06-08T04:01:50.999789+0000","last_unstale":"2023-06-08T04:01:58.298044+0000","last_undegraded":"2023-06-08T04:01:58.298044+0000","last_fullsized":"2023-06-08T04:01:58.298044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:11:58.206736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679223+0000","last_change":"2023-06-08T04:01:56.778178+0000","last_active":"2023-06-08T04:01:58.679223+0000","last_peered":"2023-06-08T04:01:58.679223+0000","last_clean":"2023-06-08T04:01:58.679223+0000","last_became_active":"2023-06-08T04:01:56.777877+0000","last_became_peered":"2023-06-08T04:01:56.777877+0000","last_unstale":"2023-06-08T04:01:58.679223+0000","last_undegraded":"2023-06-08T04:01:58.679223+0000","last_fullsized":"2023-06-08T04:01:58.679223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:22.443805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679364+0000","last_change":"2023-06-08T04:01:57.312009+0000","last_active":"2023-06-08T04:01:58.679364+0000","last_peered":"2023-06-08T04:01:58.679364+0000","last_clean":"2023-06-08T04:01:58.679364+0000","last_became_active":"2023-06-08T04:01:57.311651+0000","last_became_peered":"2023-06-08T04:01:57.311651+0000","last_unstale":"2023-06-08T04:01:58.679364+0000","last_undegraded":"2023-06-08T04:01:58.679364+0000","last_fullsized":"2023-06-08T04:01:58.679364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:41.897231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679250+0000","last_change":"2023-06-08T04:01:51.000507+0000","last_active":"2023-06-08T04:01:58.679250+0000","last_peered":"2023-06-08T04:01:58.679250+0000","last_clean":"2023-06-08T04:01:58.679250+0000","last_became_active":"2023-06-08T04:01:51.000175+0000","last_became_peered":"2023-06-08T04:01:51.000175+0000","last_unstale":"2023-06-08T04:01:58.679250+0000","last_undegraded":"2023-06-08T04:01:58.679250+0000","last_fullsized":"2023-06-08T04:01:58.679250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:13.100611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679229+0000","last_change":"2023-06-08T04:01:56.785424+0000","last_active":"2023-06-08T04:01:58.679229+0000","last_peered":"2023-06-08T04:01:58.679229+0000","last_clean":"2023-06-08T04:01:58.679229+0000","last_became_active":"2023-06-08T04:01:56.785198+0000","last_became_peered":"2023-06-08T04:01:56.785198+0000","last_unstale":"2023-06-08T04:01:58.679229+0000","last_undegraded":"2023-06-08T04:01:58.679229+0000","last_fullsized":"2023-06-08T04:01:58.679229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:47.851853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679359+0000","last_change":"2023-06-08T04:01:57.315582+0000","last_active":"2023-06-08T04:01:58.679359+0000","last_peered":"2023-06-08T04:01:58.679359+0000","last_clean":"2023-06-08T04:01:58.679359+0000","last_became_active":"2023-06-08T04:01:57.314479+0000","last_became_peered":"2023-06-08T04:01:57.314479+0000","last_unstale":"2023-06-08T04:01:58.679359+0000","last_undegraded":"2023-06-08T04:01:58.679359+0000","last_fullsized":"2023-06-08T04:01:58.679359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679828+0000","last_change":"2023-06-08T04:01:50.734174+0000","last_active":"2023-06-08T04:01:58.679828+0000","last_peered":"2023-06-08T04:01:58.679828+0000","last_clean":"2023-06-08T04:01:58.679828+0000","last_became_active":"2023-06-08T04:01:50.733832+0000","last_became_peered":"2023-06-08T04:01:50.733832+0000","last_unstale":"2023-06-08T04:01:58.679828+0000","last_undegraded":"2023-06-08T04:01:58.679828+0000","last_fullsized":"2023-06-08T04:01:58.679828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:34.856721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299103+0000","last_change":"2023-06-08T04:01:56.782230+0000","last_active":"2023-06-08T04:01:58.299103+0000","last_peered":"2023-06-08T04:01:58.299103+0000","last_clean":"2023-06-08T04:01:58.299103+0000","last_became_active":"2023-06-08T04:01:56.781942+0000","last_became_peered":"2023-06-08T04:01:56.781942+0000","last_unstale":"2023-06-08T04:01:58.299103+0000","last_undegraded":"2023-06-08T04:01:58.299103+0000","last_fullsized":"2023-06-08T04:01:58.299103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679365+0000","last_change":"2023-06-08T04:01:57.314750+0000","last_active":"2023-06-08T04:01:58.679365+0000","last_peered":"2023-06-08T04:01:58.679365+0000","last_clean":"2023-06-08T04:01:58.679365+0000","last_became_active":"2023-06-08T04:01:57.314515+0000","last_became_peered":"2023-06-08T04:01:57.314515+0000","last_unstale":"2023-06-08T04:01:58.679365+0000","last_undegraded":"2023-06-08T04:01:58.679365+0000","last_fullsized":"2023-06-08T04:01:58.679365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679505+0000","last_change":"2023-06-08T04:01:56.784632+0000","last_active":"2023-06-08T04:01:58.679505+0000","last_peered":"2023-06-08T04:01:58.679505+0000","last_clean":"2023-06-08T04:01:58.679505+0000","last_became_active":"2023-06-08T04:01:56.784077+0000","last_became_peered":"2023-06-08T04:01:56.784077+0000","last_unstale":"2023-06-08T04:01:58.679505+0000","last_undegraded":"2023-06-08T04:01:58.679505+0000","last_fullsized":"2023-06-08T04:01:58.679505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:40.889888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294761+0000","last_change":"2023-06-08T04:01:57.306546+0000","last_active":"2023-06-08T04:01:58.294761+0000","last_peered":"2023-06-08T04:01:58.294761+0000","last_clean":"2023-06-08T04:01:58.294761+0000","last_became_active":"2023-06-08T04:01:57.306284+0000","last_became_peered":"2023-06-08T04:01:57.306284+0000","last_unstale":"2023-06-08T04:01:58.294761+0000","last_undegraded":"2023-06-08T04:01:58.294761+0000","last_fullsized":"2023-06-08T04:01:58.294761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:27:15.918495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298675+0000","last_change":"2023-06-08T04:01:56.782619+0000","last_active":"2023-06-08T04:01:58.298675+0000","last_peered":"2023-06-08T04:01:58.298675+0000","last_clean":"2023-06-08T04:01:58.298675+0000","last_became_active":"2023-06-08T04:01:56.782330+0000","last_became_peered":"2023-06-08T04:01:56.782330+0000","last_unstale":"2023-06-08T04:01:58.298675+0000","last_undegraded":"2023-06-08T04:01:58.298675+0000","last_fullsized":"2023-06-08T04:01:58.298675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:30.163198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679246+0000","last_change":"2023-06-08T04:01:57.321947+0000","last_active":"2023-06-08T04:01:58.679246+0000","last_peered":"2023-06-08T04:01:58.679246+0000","last_clean":"2023-06-08T04:01:58.679246+0000","last_became_active":"2023-06-08T04:01:57.321553+0000","last_became_peered":"2023-06-08T04:01:57.321553+0000","last_unstale":"2023-06-08T04:01:58.679246+0000","last_undegraded":"2023-06-08T04:01:58.679246+0000","last_fullsized":"2023-06-08T04:01:58.679246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:21.118831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299053+0000","last_change":"2023-06-08T04:01:56.781610+0000","last_active":"2023-06-08T04:01:58.299053+0000","last_peered":"2023-06-08T04:01:58.299053+0000","last_clean":"2023-06-08T04:01:58.299053+0000","last_became_active":"2023-06-08T04:01:56.781235+0000","last_became_peered":"2023-06-08T04:01:56.781235+0000","last_unstale":"2023-06-08T04:01:58.299053+0000","last_undegraded":"2023-06-08T04:01:58.299053+0000","last_fullsized":"2023-06-08T04:01:58.299053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:49.341275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680212+0000","last_change":"2023-06-08T04:01:57.320898+0000","last_active":"2023-06-08T04:01:58.680212+0000","last_peered":"2023-06-08T04:01:58.680212+0000","last_clean":"2023-06-08T04:01:58.680212+0000","last_became_active":"2023-06-08T04:01:57.320681+0000","last_became_peered":"2023-06-08T04:01:57.320681+0000","last_unstale":"2023-06-08T04:01:58.680212+0000","last_undegraded":"2023-06-08T04:01:58.680212+0000","last_fullsized":"2023-06-08T04:01:58.680212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:34:03.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679303+0000","last_change":"2023-06-08T04:01:56.789740+0000","last_active":"2023-06-08T04:01:58.679303+0000","last_peered":"2023-06-08T04:01:58.679303+0000","last_clean":"2023-06-08T04:01:58.679303+0000","last_became_active":"2023-06-08T04:01:56.789322+0000","last_became_peered":"2023-06-08T04:01:56.789322+0000","last_unstale":"2023-06-08T04:01:58.679303+0000","last_undegraded":"2023-06-08T04:01:58.679303+0000","last_fullsized":"2023-06-08T04:01:58.679303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:49.253411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680786+0000","last_change":"2023-06-08T04:01:57.301738+0000","last_active":"2023-06-08T04:01:58.680786+0000","last_peered":"2023-06-08T04:01:58.680786+0000","last_clean":"2023-06-08T04:01:58.680786+0000","last_became_active":"2023-06-08T04:01:57.301468+0000","last_became_peered":"2023-06-08T04:01:57.301468+0000","last_unstale":"2023-06-08T04:01:58.680786+0000","last_undegraded":"2023-06-08T04:01:58.680786+0000","last_fullsized":"2023-06-08T04:01:58.680786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:57.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680472+0000","last_change":"2023-06-08T04:01:56.774643+0000","last_active":"2023-06-08T04:01:58.680472+0000","last_peered":"2023-06-08T04:01:58.680472+0000","last_clean":"2023-06-08T04:01:58.680472+0000","last_became_active":"2023-06-08T04:01:56.774331+0000","last_became_peered":"2023-06-08T04:01:56.774331+0000","last_unstale":"2023-06-08T04:01:58.680472+0000","last_undegraded":"2023-06-08T04:01:58.680472+0000","last_fullsized":"2023-06-08T04:01:58.680472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:49.341275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678854+0000","last_change":"2023-06-08T04:01:57.325733+0000","last_active":"2023-06-08T04:01:58.678854+0000","last_peered":"2023-06-08T04:01:58.678854+0000","last_clean":"2023-06-08T04:01:58.678854+0000","last_became_active":"2023-06-08T04:01:57.325478+0000","last_became_peered":"2023-06-08T04:01:57.325478+0000","last_unstale":"2023-06-08T04:01:58.678854+0000","last_undegraded":"2023-06-08T04:01:58.678854+0000","last_fullsized":"2023-06-08T04:01:58.678854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679936+0000","last_change":"2023-06-08T04:01:57.316607+0000","last_active":"2023-06-08T04:01:58.679936+0000","last_peered":"2023-06-08T04:01:58.679936+0000","last_clean":"2023-06-08T04:01:58.679936+0000","last_became_active":"2023-06-08T04:01:57.316279+0000","last_became_peered":"2023-06-08T04:01:57.316279+0000","last_unstale":"2023-06-08T04:01:58.679936+0000","last_undegraded":"2023-06-08T04:01:58.679936+0000","last_fullsized":"2023-06-08T04:01:58.679936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680685+0000","last_change":"2023-06-08T04:01:57.307400+0000","last_active":"2023-06-08T04:01:58.680685+0000","last_peered":"2023-06-08T04:01:58.680685+0000","last_clean":"2023-06-08T04:01:58.680685+0000","last_became_active":"2023-06-08T04:01:57.307110+0000","last_became_peered":"2023-06-08T04:01:57.307110+0000","last_unstale":"2023-06-08T04:01:58.680685+0000","last_undegraded":"2023-06-08T04:01:58.680685+0000","last_fullsized":"2023-06-08T04:01:58.680685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:47.350874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680097+0000","last_change":"2023-06-08T04:01:57.328380+0000","last_active":"2023-06-08T04:01:58.680097+0000","last_peered":"2023-06-08T04:01:58.680097+0000","last_clean":"2023-06-08T04:01:58.680097+0000","last_became_active":"2023-06-08T04:01:57.328134+0000","last_became_peered":"2023-06-08T04:01:57.328134+0000","last_unstale":"2023-06-08T04:01:58.680097+0000","last_undegraded":"2023-06-08T04:01:58.680097+0000","last_fullsized":"2023-06-08T04:01:58.680097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:25:34.644774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680126+0000","last_change":"2023-06-08T04:01:57.313801+0000","last_active":"2023-06-08T04:01:58.680126+0000","last_peered":"2023-06-08T04:01:58.680126+0000","last_clean":"2023-06-08T04:01:58.680126+0000","last_became_active":"2023-06-08T04:01:57.313059+0000","last_became_peered":"2023-06-08T04:01:57.313059+0000","last_unstale":"2023-06-08T04:01:58.680126+0000","last_undegraded":"2023-06-08T04:01:58.680126+0000","last_fullsized":"2023-06-08T04:01:58.680126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679109+0000","last_change":"2023-06-08T04:01:57.316784+0000","last_active":"2023-06-08T04:01:58.679109+0000","last_peered":"2023-06-08T04:01:58.679109+0000","last_clean":"2023-06-08T04:01:58.679109+0000","last_became_active":"2023-06-08T04:01:57.316329+0000","last_became_peered":"2023-06-08T04:01:57.316329+0000","last_unstale":"2023-06-08T04:01:58.679109+0000","last_undegraded":"2023-06-08T04:01:58.679109+0000","last_fullsized":"2023-06-08T04:01:58.679109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:17.091490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":671608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":669828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":72403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":72897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":74427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":80112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T04:02:02.206 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T04:02:02.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.433+0000 7f7f4b5ff700 1 Processor -- start 2023-06-08T04:02:02.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.434+0000 7f7f4b5ff700 1 -- start start 2023-06-08T04:02:02.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.435+0000 7f7f4b5ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7f440b4d20 0x7f7f44167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.435+0000 7f7f4b5ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440d0800 con 0x7f7f440b83f0 2023-06-08T04:02:02.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.435+0000 7f7f4b5ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440cd1e0 con 0x7f7f44160a60 2023-06-08T04:02:02.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.435+0000 7f7f4b5ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f44160ed0 con 0x7f7f440b4d20 2023-06-08T04:02:02.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.435+0000 7f7f4939b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7f440b83f0 0x7f7f440ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51526/0 (socket says 172.21.15.16:51526) 2023-06-08T04:02:02.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.435+0000 7f7f4939b700 1 -- 172.21.15.16:0/2033943216 learned_addr learned my addr 172.21.15.16:0/2033943216 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:02.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.435+0000 7f7f49b9c700 1 --2- 172.21.15.16:0/2033943216 >> v2:172.21.15.169:3300/0 conn(0x7f7f440b4d20 0x7f7f44167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.435+0000 7f7f3bfff700 1 -- 172.21.15.16:0/2033943216 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977569310 0 0) 0x7f7f440d0800 con 0x7f7f440b83f0 2023-06-08T04:02:02.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.436+0000 7f7f3bfff700 1 -- 172.21.15.16:0/2033943216 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f300035b0 con 0x7f7f440b83f0 2023-06-08T04:02:02.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.436+0000 7f7f3bfff700 1 -- 172.21.15.16:0/2033943216 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557452919 0 0) 0x7f7f440cd1e0 con 0x7f7f44160a60 2023-06-08T04:02:02.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.436+0000 7f7f3bfff700 1 -- 172.21.15.16:0/2033943216 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f440d0800 con 0x7f7f44160a60 2023-06-08T04:02:02.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.436+0000 7f7f3bfff700 1 -- 172.21.15.16:0/2033943216 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 571927769 0 0) 0x7f7f300035b0 con 0x7f7f440b83f0 2023-06-08T04:02:02.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.436+0000 7f7f49b9c700 1 -- 172.21.15.16:0/2033943216 >> v1:172.21.15.169:6789/0 conn(0x7f7f44160a60 legacy=0x7f7f440b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.436+0000 7f7f49b9c700 1 -- 172.21.15.16:0/2033943216 >> v1:172.21.15.16:6789/0 conn(0x7f7f440b83f0 legacy=0x7f7f440ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.436+0000 7f7f49b9c700 1 -- 172.21.15.16:0/2033943216 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f440cd4c0 con 0x7f7f440b4d20 2023-06-08T04:02:02.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.436+0000 7f7f49b9c700 1 --2- 172.21.15.16:0/2033943216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f440b4d20 0x7f7f44167260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009d90 tx=0x7f7f3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a7affa0985fb18b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:02.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.436+0000 7f7f3bfff700 1 -- 172.21.15.16:0/2033943216 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00e070 con 0x7f7f440b4d20 2023-06-08T04:02:02.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.436+0000 7f7f3bfff700 1 -- 172.21.15.16:0/2033943216 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c003a20 con 0x7f7f440b4d20 2023-06-08T04:02:02.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.437+0000 7f7f3bfff700 1 -- 172.21.15.16:0/2033943216 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40001670 con 0x7f7f440b4d20 2023-06-08T04:02:02.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.437+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/2033943216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f440b4d20 msgr2=0x7f7f44167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.437+0000 7f7f4b5ff700 1 --2- 172.21.15.16:0/2033943216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f440b4d20 0x7f7f44167260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009d90 tx=0x7f7f3c00b330 comp rx=0 tx=0).stop 2023-06-08T04:02:02.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.437+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/2033943216 shutdown_connections 2023-06-08T04:02:02.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.437+0000 7f7f4b5ff700 1 --2- 172.21.15.16:0/2033943216 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f440b4d20 0x7f7f44167260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.437+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/2033943216 >> 172.21.15.16:0/2033943216 conn(0x7f7f440cf610 msgr2=0x7f7f440cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:02.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.437+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/2033943216 shutdown_connections 2023-06-08T04:02:02.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.437+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/2033943216 wait complete. 2023-06-08T04:02:02.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.439+0000 7f7f4b5ff700 1 Processor -- start 2023-06-08T04:02:02.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.439+0000 7f7f4b5ff700 1 -- start start 2023-06-08T04:02:02.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.440+0000 7f7f4b5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f440b4d20 0x7f7f440c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.440+0000 7f7f4b5ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f440b83f0 0x7f7f44148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.440+0000 7f7f4b5ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f44160a60 0x7f7f4415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.440+0000 7f7f4b5ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f441e67c0 con 0x7f7f440b83f0 2023-06-08T04:02:02.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.440+0000 7f7f4b5ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f441e5eb0 con 0x7f7f44160a60 2023-06-08T04:02:02.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.440+0000 7f7f4b5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f441e6170 con 0x7f7f440b4d20 2023-06-08T04:02:02.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.440+0000 7f7f48b9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f440b83f0 0x7f7f44148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.440+0000 7f7f48b9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f440b83f0 0x7f7f44148af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41856/0 (socket says 172.21.15.16:41856) 2023-06-08T04:02:02.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.440+0000 7f7f48b9a700 1 -- 172.21.15.16:0/1113363173 learned_addr learned my addr 172.21.15.16:0/1113363173 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:02.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.440+0000 7f7f49b9c700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f44160a60 0x7f7f4415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.440+0000 7f7f4939b700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f440b4d20 0x7f7f440c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f48b9a700 1 -- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f440b4d20 msgr2=0x7f7f440c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f48b9a700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f440b4d20 0x7f7f440c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f48b9a700 1 -- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f44160a60 msgr2=0x7f7f4415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f48b9a700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f44160a60 0x7f7f4415e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f48b9a700 1 -- 172.21.15.16:0/1113363173 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c009a70 con 0x7f7f440b83f0 2023-06-08T04:02:02.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f49b9c700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f44160a60 0x7f7f4415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:02.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f4939b700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f440b4d20 0x7f7f440c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:02.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f48b9a700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f440b83f0 0x7f7f44148af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400c500 tx=0x7f7f3400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:02.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f39ffb700 1 -- 172.21.15.16:0/1113363173 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f340052d0 con 0x7f7f440b83f0 2023-06-08T04:02:02.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f39ffb700 1 -- 172.21.15.16:0/1113363173 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f34005430 con 0x7f7f440b83f0 2023-06-08T04:02:02.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f39ffb700 1 -- 172.21.15.16:0/1113363173 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f340038c0 con 0x7f7f440b83f0 2023-06-08T04:02:02.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/1113363173 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f441e6450 con 0x7f7f440b83f0 2023-06-08T04:02:02.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.441+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/1113363173 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4415eb10 con 0x7f7f440b83f0 2023-06-08T04:02:02.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.442+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/1113363173 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f440740e0 con 0x7f7f440b83f0 2023-06-08T04:02:02.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.443+0000 7f7f39ffb700 1 -- 172.21.15.16:0/1113363173 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f34003a20 con 0x7f7f440b83f0 2023-06-08T04:02:02.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.444+0000 7f7f39ffb700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7f2806ace0 0x7f7f2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.444+0000 7f7f39ffb700 1 -- 172.21.15.16:0/1113363173 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f340889a0 con 0x7f7f440b83f0 2023-06-08T04:02:02.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.445+0000 7f7f4939b700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7f2806ace0 0x7f7f2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.446+0000 7f7f4939b700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7f2806ace0 0x7f7f2806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7f40001860 tx=0x7f7f400016d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:02.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.449+0000 7f7f39ffb700 1 -- 172.21.15.16:0/1113363173 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7f34053a40 con 0x7f7f440b83f0 2023-06-08T04:02:02.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.654+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/1113363173 --> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f44149210 con 0x7f7f2806ace0 2023-06-08T04:02:02.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.663+0000 7f7f39ffb700 1 -- 172.21.15.16:0/1113363173 <== mgr.4103 v2:172.21.15.169:6832/2339348297 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286987 (secure 0 0 0) 0x7f7f44149210 con 0x7f7f2806ace0 2023-06-08T04:02:02.669 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:02.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7f2806ace0 msgr2=0x7f7f2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7f2806ace0 0x7f7f2806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7f40001860 tx=0x7f7f400016d0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/1113363173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f440b83f0 msgr2=0x7f7f44148af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f440b83f0 0x7f7f44148af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400c500 tx=0x7f7f3400c8c0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/1113363173 shutdown_connections 2023-06-08T04:02:02.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7f2806ace0 0x7f7f2806d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f44160a60 0x7f7f4415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7f440b4d20 0x7f7f440c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 --2- 172.21.15.16:0/1113363173 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f440b83f0 0x7f7f44148af0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/1113363173 >> 172.21.15.16:0/1113363173 conn(0x7f7f440cf610 msgr2=0x7f7f440b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:02.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/1113363173 shutdown_connections 2023-06-08T04:02:02.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.667+0000 7f7f4b5ff700 1 -- 172.21.15.16:0/1113363173 wait complete. 2023-06-08T04:02:02.673 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-06-08T04:02:02.689 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-06-08T04:02:02.185507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218496,"kb_used_data":2880,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756224,"statfs":{"total":773094113280,"available":772870373376,"internally_reserved":0,"allocated":2949120,"data_stored":1800195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001610"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294976+0000","last_change":"2023-06-08T04:01:57.299413+0000","last_active":"2023-06-08T04:01:58.294976+0000","last_peered":"2023-06-08T04:01:58.294976+0000","last_clean":"2023-06-08T04:01:58.294976+0000","last_became_active":"2023-06-08T04:01:57.299094+0000","last_became_peered":"2023-06-08T04:01:57.299094+0000","last_unstale":"2023-06-08T04:01:58.294976+0000","last_undegraded":"2023-06-08T04:01:58.294976+0000","last_fullsized":"2023-06-08T04:01:58.294976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:10:14.491590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298272+0000","last_change":"2023-06-08T04:01:57.311826+0000","last_active":"2023-06-08T04:01:58.298272+0000","last_peered":"2023-06-08T04:01:58.298272+0000","last_clean":"2023-06-08T04:01:58.298272+0000","last_became_active":"2023-06-08T04:01:57.311286+0000","last_became_peered":"2023-06-08T04:01:57.311286+0000","last_unstale":"2023-06-08T04:01:58.298272+0000","last_undegraded":"2023-06-08T04:01:58.298272+0000","last_fullsized":"2023-06-08T04:01:58.298272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:17.091490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679534+0000","last_change":"2023-06-08T04:01:57.320078+0000","last_active":"2023-06-08T04:01:58.679534+0000","last_peered":"2023-06-08T04:01:58.679534+0000","last_clean":"2023-06-08T04:01:58.679534+0000","last_became_active":"2023-06-08T04:01:57.319745+0000","last_became_peered":"2023-06-08T04:01:57.319745+0000","last_unstale":"2023-06-08T04:01:58.679534+0000","last_undegraded":"2023-06-08T04:01:58.679534+0000","last_fullsized":"2023-06-08T04:01:58.679534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:13.980384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679647+0000","last_change":"2023-06-08T04:01:57.319387+0000","last_active":"2023-06-08T04:01:58.679647+0000","last_peered":"2023-06-08T04:01:58.679647+0000","last_clean":"2023-06-08T04:01:58.679647+0000","last_became_active":"2023-06-08T04:01:57.319108+0000","last_became_peered":"2023-06-08T04:01:57.319108+0000","last_unstale":"2023-06-08T04:01:58.679647+0000","last_undegraded":"2023-06-08T04:01:58.679647+0000","last_fullsized":"2023-06-08T04:01:58.679647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679228+0000","last_change":"2023-06-08T04:01:57.309338+0000","last_active":"2023-06-08T04:01:58.679228+0000","last_peered":"2023-06-08T04:01:58.679228+0000","last_clean":"2023-06-08T04:01:58.679228+0000","last_became_active":"2023-06-08T04:01:57.308408+0000","last_became_peered":"2023-06-08T04:01:57.308408+0000","last_unstale":"2023-06-08T04:01:58.679228+0000","last_undegraded":"2023-06-08T04:01:58.679228+0000","last_fullsized":"2023-06-08T04:01:58.679228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680027+0000","last_change":"2023-06-08T04:01:57.322730+0000","last_active":"2023-06-08T04:01:58.680027+0000","last_peered":"2023-06-08T04:01:58.680027+0000","last_clean":"2023-06-08T04:01:58.680027+0000","last_became_active":"2023-06-08T04:01:57.322349+0000","last_became_peered":"2023-06-08T04:01:57.322349+0000","last_unstale":"2023-06-08T04:01:58.680027+0000","last_undegraded":"2023-06-08T04:01:58.680027+0000","last_fullsized":"2023-06-08T04:01:58.680027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:51:05.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297855+0000","last_change":"2023-06-08T04:01:57.316863+0000","last_active":"2023-06-08T04:01:58.297855+0000","last_peered":"2023-06-08T04:01:58.297855+0000","last_clean":"2023-06-08T04:01:58.297855+0000","last_became_active":"2023-06-08T04:01:57.315117+0000","last_became_peered":"2023-06-08T04:01:57.315117+0000","last_unstale":"2023-06-08T04:01:58.297855+0000","last_undegraded":"2023-06-08T04:01:58.297855+0000","last_fullsized":"2023-06-08T04:01:58.297855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298377+0000","last_change":"2023-06-08T04:01:57.323352+0000","last_active":"2023-06-08T04:01:58.298377+0000","last_peered":"2023-06-08T04:01:58.298377+0000","last_clean":"2023-06-08T04:01:58.298377+0000","last_became_active":"2023-06-08T04:01:57.323064+0000","last_became_peered":"2023-06-08T04:01:57.323064+0000","last_unstale":"2023-06-08T04:01:58.298377+0000","last_undegraded":"2023-06-08T04:01:58.298377+0000","last_fullsized":"2023-06-08T04:01:58.298377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680108+0000","last_change":"2023-06-08T04:01:57.306101+0000","last_active":"2023-06-08T04:01:58.680108+0000","last_peered":"2023-06-08T04:01:58.680108+0000","last_clean":"2023-06-08T04:01:58.680108+0000","last_became_active":"2023-06-08T04:01:57.305817+0000","last_became_peered":"2023-06-08T04:01:57.305817+0000","last_unstale":"2023-06-08T04:01:58.680108+0000","last_undegraded":"2023-06-08T04:01:58.680108+0000","last_fullsized":"2023-06-08T04:01:58.680108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298566+0000","last_change":"2023-06-08T04:01:57.309420+0000","last_active":"2023-06-08T04:01:58.298566+0000","last_peered":"2023-06-08T04:01:58.298566+0000","last_clean":"2023-06-08T04:01:58.298566+0000","last_became_active":"2023-06-08T04:01:57.309076+0000","last_became_peered":"2023-06-08T04:01:57.309076+0000","last_unstale":"2023-06-08T04:01:58.298566+0000","last_undegraded":"2023-06-08T04:01:58.298566+0000","last_fullsized":"2023-06-08T04:01:58.298566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679683+0000","last_change":"2023-06-08T04:01:57.324575+0000","last_active":"2023-06-08T04:01:58.679683+0000","last_peered":"2023-06-08T04:01:58.679683+0000","last_clean":"2023-06-08T04:01:58.679683+0000","last_became_active":"2023-06-08T04:01:57.323557+0000","last_became_peered":"2023-06-08T04:01:57.323557+0000","last_unstale":"2023-06-08T04:01:58.679683+0000","last_undegraded":"2023-06-08T04:01:58.679683+0000","last_fullsized":"2023-06-08T04:01:58.679683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:47.350874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294799+0000","last_change":"2023-06-08T04:01:57.324310+0000","last_active":"2023-06-08T04:01:58.294799+0000","last_peered":"2023-06-08T04:01:58.294799+0000","last_clean":"2023-06-08T04:01:58.294799+0000","last_became_active":"2023-06-08T04:01:57.324044+0000","last_became_peered":"2023-06-08T04:01:57.324044+0000","last_unstale":"2023-06-08T04:01:58.294799+0000","last_undegraded":"2023-06-08T04:01:58.294799+0000","last_fullsized":"2023-06-08T04:01:58.294799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:15:47.285133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294647+0000","last_change":"2023-06-08T04:01:57.300242+0000","last_active":"2023-06-08T04:01:58.294647+0000","last_peered":"2023-06-08T04:01:58.294647+0000","last_clean":"2023-06-08T04:01:58.294647+0000","last_became_active":"2023-06-08T04:01:57.299927+0000","last_became_peered":"2023-06-08T04:01:57.299927+0000","last_unstale":"2023-06-08T04:01:58.294647+0000","last_undegraded":"2023-06-08T04:01:58.294647+0000","last_fullsized":"2023-06-08T04:01:58.294647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:03:23.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298679+0000","last_change":"2023-06-08T04:01:57.309428+0000","last_active":"2023-06-08T04:01:58.298679+0000","last_peered":"2023-06-08T04:01:58.298679+0000","last_clean":"2023-06-08T04:01:58.298679+0000","last_became_active":"2023-06-08T04:01:57.309107+0000","last_became_peered":"2023-06-08T04:01:57.309107+0000","last_unstale":"2023-06-08T04:01:58.298679+0000","last_undegraded":"2023-06-08T04:01:58.298679+0000","last_fullsized":"2023-06-08T04:01:58.298679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298112+0000","last_change":"2023-06-08T04:01:57.317232+0000","last_active":"2023-06-08T04:01:58.298112+0000","last_peered":"2023-06-08T04:01:58.298112+0000","last_clean":"2023-06-08T04:01:58.298112+0000","last_became_active":"2023-06-08T04:01:57.316821+0000","last_became_peered":"2023-06-08T04:01:57.316821+0000","last_unstale":"2023-06-08T04:01:58.298112+0000","last_undegraded":"2023-06-08T04:01:58.298112+0000","last_fullsized":"2023-06-08T04:01:58.298112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:18.694789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678985+0000","last_change":"2023-06-08T04:01:57.314928+0000","last_active":"2023-06-08T04:01:58.678985+0000","last_peered":"2023-06-08T04:01:58.678985+0000","last_clean":"2023-06-08T04:01:58.678985+0000","last_became_active":"2023-06-08T04:01:57.314630+0000","last_became_peered":"2023-06-08T04:01:57.314630+0000","last_unstale":"2023-06-08T04:01:58.678985+0000","last_undegraded":"2023-06-08T04:01:58.678985+0000","last_fullsized":"2023-06-08T04:01:58.678985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:50.348618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680237+0000","last_change":"2023-06-08T04:01:57.304277+0000","last_active":"2023-06-08T04:01:58.680237+0000","last_peered":"2023-06-08T04:01:58.680237+0000","last_clean":"2023-06-08T04:01:58.680237+0000","last_became_active":"2023-06-08T04:01:57.303959+0000","last_became_peered":"2023-06-08T04:01:57.303959+0000","last_unstale":"2023-06-08T04:01:58.680237+0000","last_undegraded":"2023-06-08T04:01:58.680237+0000","last_fullsized":"2023-06-08T04:01:58.680237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679694+0000","last_change":"2023-06-08T04:01:57.316825+0000","last_active":"2023-06-08T04:01:58.679694+0000","last_peered":"2023-06-08T04:01:58.679694+0000","last_clean":"2023-06-08T04:01:58.679694+0000","last_became_active":"2023-06-08T04:01:57.315505+0000","last_became_peered":"2023-06-08T04:01:57.315505+0000","last_unstale":"2023-06-08T04:01:58.679694+0000","last_undegraded":"2023-06-08T04:01:58.679694+0000","last_fullsized":"2023-06-08T04:01:58.679694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294748+0000","last_change":"2023-06-08T04:01:57.317700+0000","last_active":"2023-06-08T04:01:58.294748+0000","last_peered":"2023-06-08T04:01:58.294748+0000","last_clean":"2023-06-08T04:01:58.294748+0000","last_became_active":"2023-06-08T04:01:57.317409+0000","last_became_peered":"2023-06-08T04:01:57.317409+0000","last_unstale":"2023-06-08T04:01:58.294748+0000","last_undegraded":"2023-06-08T04:01:58.294748+0000","last_fullsized":"2023-06-08T04:01:58.294748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:21:07.937389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680014+0000","last_change":"2023-06-08T04:01:57.327000+0000","last_active":"2023-06-08T04:01:58.680014+0000","last_peered":"2023-06-08T04:01:58.680014+0000","last_clean":"2023-06-08T04:01:58.680014+0000","last_became_active":"2023-06-08T04:01:57.326736+0000","last_became_peered":"2023-06-08T04:01:57.326736+0000","last_unstale":"2023-06-08T04:01:58.680014+0000","last_undegraded":"2023-06-08T04:01:58.680014+0000","last_fullsized":"2023-06-08T04:01:58.680014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:53:41.237371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298091+0000","last_change":"2023-06-08T04:01:57.320374+0000","last_active":"2023-06-08T04:01:58.298091+0000","last_peered":"2023-06-08T04:01:58.298091+0000","last_clean":"2023-06-08T04:01:58.298091+0000","last_became_active":"2023-06-08T04:01:57.320093+0000","last_became_peered":"2023-06-08T04:01:57.320093+0000","last_unstale":"2023-06-08T04:01:58.298091+0000","last_undegraded":"2023-06-08T04:01:58.298091+0000","last_fullsized":"2023-06-08T04:01:58.298091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678990+0000","last_change":"2023-06-08T04:01:57.307041+0000","last_active":"2023-06-08T04:01:58.678990+0000","last_peered":"2023-06-08T04:01:58.678990+0000","last_clean":"2023-06-08T04:01:58.678990+0000","last_became_active":"2023-06-08T04:01:57.306750+0000","last_became_peered":"2023-06-08T04:01:57.306750+0000","last_unstale":"2023-06-08T04:01:58.678990+0000","last_undegraded":"2023-06-08T04:01:58.678990+0000","last_fullsized":"2023-06-08T04:01:58.678990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:20.141121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679647+0000","last_change":"2023-06-08T04:01:57.305284+0000","last_active":"2023-06-08T04:01:58.679647+0000","last_peered":"2023-06-08T04:01:58.679647+0000","last_clean":"2023-06-08T04:01:58.679647+0000","last_became_active":"2023-06-08T04:01:57.304750+0000","last_became_peered":"2023-06-08T04:01:57.304750+0000","last_unstale":"2023-06-08T04:01:58.679647+0000","last_undegraded":"2023-06-08T04:01:58.679647+0000","last_fullsized":"2023-06-08T04:01:58.679647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:21.118831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297864+0000","last_change":"2023-06-08T04:01:57.319635+0000","last_active":"2023-06-08T04:01:58.297864+0000","last_peered":"2023-06-08T04:01:58.297864+0000","last_clean":"2023-06-08T04:01:58.297864+0000","last_became_active":"2023-06-08T04:01:57.319342+0000","last_became_peered":"2023-06-08T04:01:57.319342+0000","last_unstale":"2023-06-08T04:01:58.297864+0000","last_undegraded":"2023-06-08T04:01:58.297864+0000","last_fullsized":"2023-06-08T04:01:58.297864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:54.420632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679843+0000","last_change":"2023-06-08T04:01:57.313530+0000","last_active":"2023-06-08T04:01:58.679843+0000","last_peered":"2023-06-08T04:01:58.679843+0000","last_clean":"2023-06-08T04:01:58.679843+0000","last_became_active":"2023-06-08T04:01:57.313216+0000","last_became_peered":"2023-06-08T04:01:57.313216+0000","last_unstale":"2023-06-08T04:01:58.679843+0000","last_undegraded":"2023-06-08T04:01:58.679843+0000","last_fullsized":"2023-06-08T04:01:58.679843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680049+0000","last_change":"2023-06-08T04:01:57.312444+0000","last_active":"2023-06-08T04:01:58.680049+0000","last_peered":"2023-06-08T04:01:58.680049+0000","last_clean":"2023-06-08T04:01:58.680049+0000","last_became_active":"2023-06-08T04:01:57.312127+0000","last_became_peered":"2023-06-08T04:01:57.312127+0000","last_unstale":"2023-06-08T04:01:58.680049+0000","last_undegraded":"2023-06-08T04:01:58.680049+0000","last_fullsized":"2023-06-08T04:01:58.680049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298912+0000","last_change":"2023-06-08T04:01:57.311749+0000","last_active":"2023-06-08T04:01:58.298912+0000","last_peered":"2023-06-08T04:01:58.298912+0000","last_clean":"2023-06-08T04:01:58.298912+0000","last_became_active":"2023-06-08T04:01:57.311478+0000","last_became_peered":"2023-06-08T04:01:57.311478+0000","last_unstale":"2023-06-08T04:01:58.298912+0000","last_undegraded":"2023-06-08T04:01:58.298912+0000","last_fullsized":"2023-06-08T04:01:58.298912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680117+0000","last_change":"2023-06-08T04:01:56.788030+0000","last_active":"2023-06-08T04:01:58.680117+0000","last_peered":"2023-06-08T04:01:58.680117+0000","last_clean":"2023-06-08T04:01:58.680117+0000","last_became_active":"2023-06-08T04:01:56.787625+0000","last_became_peered":"2023-06-08T04:01:56.787625+0000","last_unstale":"2023-06-08T04:01:58.680117+0000","last_undegraded":"2023-06-08T04:01:58.680117+0000","last_fullsized":"2023-06-08T04:01:58.680117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:19.055855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679624+0000","last_change":"2023-06-08T04:01:57.308473+0000","last_active":"2023-06-08T04:01:58.679624+0000","last_peered":"2023-06-08T04:01:58.679624+0000","last_clean":"2023-06-08T04:01:58.679624+0000","last_became_active":"2023-06-08T04:01:57.307707+0000","last_became_peered":"2023-06-08T04:01:57.307707+0000","last_unstale":"2023-06-08T04:01:58.679624+0000","last_undegraded":"2023-06-08T04:01:58.679624+0000","last_fullsized":"2023-06-08T04:01:58.679624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678826+0000","last_change":"2023-06-08T04:01:56.782915+0000","last_active":"2023-06-08T04:01:58.678826+0000","last_peered":"2023-06-08T04:01:58.678826+0000","last_clean":"2023-06-08T04:01:58.678826+0000","last_became_active":"2023-06-08T04:01:56.782574+0000","last_became_peered":"2023-06-08T04:01:56.782574+0000","last_unstale":"2023-06-08T04:01:58.678826+0000","last_undegraded":"2023-06-08T04:01:58.678826+0000","last_fullsized":"2023-06-08T04:01:58.678826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:19.133778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680505+0000","last_change":"2023-06-08T04:01:57.310946+0000","last_active":"2023-06-08T04:01:58.680505+0000","last_peered":"2023-06-08T04:01:58.680505+0000","last_clean":"2023-06-08T04:01:58.680505+0000","last_became_active":"2023-06-08T04:01:57.310665+0000","last_became_peered":"2023-06-08T04:01:57.310665+0000","last_unstale":"2023-06-08T04:01:58.680505+0000","last_undegraded":"2023-06-08T04:01:58.680505+0000","last_fullsized":"2023-06-08T04:01:58.680505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:54.420632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679960+0000","last_change":"2023-06-08T04:01:56.781278+0000","last_active":"2023-06-08T04:01:58.679960+0000","last_peered":"2023-06-08T04:01:58.679960+0000","last_clean":"2023-06-08T04:01:58.679960+0000","last_became_active":"2023-06-08T04:01:56.780953+0000","last_became_peered":"2023-06-08T04:01:56.780953+0000","last_unstale":"2023-06-08T04:01:58.679960+0000","last_undegraded":"2023-06-08T04:01:58.679960+0000","last_fullsized":"2023-06-08T04:01:58.679960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:12.973041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679890+0000","last_change":"2023-06-08T04:01:57.313256+0000","last_active":"2023-06-08T04:01:58.679890+0000","last_peered":"2023-06-08T04:01:58.679890+0000","last_clean":"2023-06-08T04:01:58.679890+0000","last_became_active":"2023-06-08T04:01:57.312990+0000","last_became_peered":"2023-06-08T04:01:57.312990+0000","last_unstale":"2023-06-08T04:01:58.679890+0000","last_undegraded":"2023-06-08T04:01:58.679890+0000","last_fullsized":"2023-06-08T04:01:58.679890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680347+0000","last_change":"2023-06-08T04:01:56.773826+0000","last_active":"2023-06-08T04:01:58.680347+0000","last_peered":"2023-06-08T04:01:58.680347+0000","last_clean":"2023-06-08T04:01:58.680347+0000","last_became_active":"2023-06-08T04:01:56.773459+0000","last_became_peered":"2023-06-08T04:01:56.773459+0000","last_unstale":"2023-06-08T04:01:58.680347+0000","last_undegraded":"2023-06-08T04:01:58.680347+0000","last_fullsized":"2023-06-08T04:01:58.680347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:24.507881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679843+0000","last_change":"2023-06-08T04:01:57.304560+0000","last_active":"2023-06-08T04:01:58.679843+0000","last_peered":"2023-06-08T04:01:58.679843+0000","last_clean":"2023-06-08T04:01:58.679843+0000","last_became_active":"2023-06-08T04:01:57.304311+0000","last_became_peered":"2023-06-08T04:01:57.304311+0000","last_unstale":"2023-06-08T04:01:58.679843+0000","last_undegraded":"2023-06-08T04:01:58.679843+0000","last_fullsized":"2023-06-08T04:01:58.679843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:12:00.959096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298423+0000","last_change":"2023-06-08T04:01:56.783994+0000","last_active":"2023-06-08T04:01:58.298423+0000","last_peered":"2023-06-08T04:01:58.298423+0000","last_clean":"2023-06-08T04:01:58.298423+0000","last_became_active":"2023-06-08T04:01:56.783344+0000","last_became_peered":"2023-06-08T04:01:56.783344+0000","last_unstale":"2023-06-08T04:01:58.298423+0000","last_undegraded":"2023-06-08T04:01:58.298423+0000","last_fullsized":"2023-06-08T04:01:58.298423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:42.712772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680687+0000","last_change":"2023-06-08T04:01:57.313756+0000","last_active":"2023-06-08T04:01:58.680687+0000","last_peered":"2023-06-08T04:01:58.680687+0000","last_clean":"2023-06-08T04:01:58.680687+0000","last_became_active":"2023-06-08T04:01:57.313436+0000","last_became_peered":"2023-06-08T04:01:57.313436+0000","last_unstale":"2023-06-08T04:01:58.680687+0000","last_undegraded":"2023-06-08T04:01:58.680687+0000","last_fullsized":"2023-06-08T04:01:58.680687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:19:05.998159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299112+0000","last_change":"2023-06-08T04:01:56.788377+0000","last_active":"2023-06-08T04:01:58.299112+0000","last_peered":"2023-06-08T04:01:58.299112+0000","last_clean":"2023-06-08T04:01:58.299112+0000","last_became_active":"2023-06-08T04:01:56.788107+0000","last_became_peered":"2023-06-08T04:01:56.788107+0000","last_unstale":"2023-06-08T04:01:58.299112+0000","last_undegraded":"2023-06-08T04:01:58.299112+0000","last_fullsized":"2023-06-08T04:01:58.299112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:11.801004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679085+0000","last_change":"2023-06-08T04:01:57.313322+0000","last_active":"2023-06-08T04:01:58.679085+0000","last_peered":"2023-06-08T04:01:58.679085+0000","last_clean":"2023-06-08T04:01:58.679085+0000","last_became_active":"2023-06-08T04:01:57.312901+0000","last_became_peered":"2023-06-08T04:01:57.312901+0000","last_unstale":"2023-06-08T04:01:58.679085+0000","last_undegraded":"2023-06-08T04:01:58.679085+0000","last_fullsized":"2023-06-08T04:01:58.679085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679636+0000","last_change":"2023-06-08T04:01:56.787707+0000","last_active":"2023-06-08T04:01:58.679636+0000","last_peered":"2023-06-08T04:01:58.679636+0000","last_clean":"2023-06-08T04:01:58.679636+0000","last_became_active":"2023-06-08T04:01:56.787416+0000","last_became_peered":"2023-06-08T04:01:56.787416+0000","last_unstale":"2023-06-08T04:01:58.679636+0000","last_undegraded":"2023-06-08T04:01:58.679636+0000","last_fullsized":"2023-06-08T04:01:58.679636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:17.687446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679084+0000","last_change":"2023-06-08T04:01:57.330479+0000","last_active":"2023-06-08T04:01:58.679084+0000","last_peered":"2023-06-08T04:01:58.679084+0000","last_clean":"2023-06-08T04:01:58.679084+0000","last_became_active":"2023-06-08T04:01:57.330160+0000","last_became_peered":"2023-06-08T04:01:57.330160+0000","last_unstale":"2023-06-08T04:01:58.679084+0000","last_undegraded":"2023-06-08T04:01:58.679084+0000","last_fullsized":"2023-06-08T04:01:58.679084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298027+0000","last_change":"2023-06-08T04:01:56.784611+0000","last_active":"2023-06-08T04:01:58.298027+0000","last_peered":"2023-06-08T04:01:58.298027+0000","last_clean":"2023-06-08T04:01:58.298027+0000","last_became_active":"2023-06-08T04:01:56.784281+0000","last_became_peered":"2023-06-08T04:01:56.784281+0000","last_unstale":"2023-06-08T04:01:58.298027+0000","last_undegraded":"2023-06-08T04:01:58.298027+0000","last_fullsized":"2023-06-08T04:01:58.298027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:12.973041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679123+0000","last_change":"2023-06-08T04:01:57.308023+0000","last_active":"2023-06-08T04:01:58.679123+0000","last_peered":"2023-06-08T04:01:58.679123+0000","last_clean":"2023-06-08T04:01:58.679123+0000","last_became_active":"2023-06-08T04:01:57.307736+0000","last_became_peered":"2023-06-08T04:01:57.307736+0000","last_unstale":"2023-06-08T04:01:58.679123+0000","last_undegraded":"2023-06-08T04:01:58.679123+0000","last_fullsized":"2023-06-08T04:01:58.679123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679194+0000","last_change":"2023-06-08T04:01:56.785032+0000","last_active":"2023-06-08T04:01:58.679194+0000","last_peered":"2023-06-08T04:01:58.679194+0000","last_clean":"2023-06-08T04:01:58.679194+0000","last_became_active":"2023-06-08T04:01:56.784737+0000","last_became_peered":"2023-06-08T04:01:56.784737+0000","last_unstale":"2023-06-08T04:01:58.679194+0000","last_undegraded":"2023-06-08T04:01:58.679194+0000","last_fullsized":"2023-06-08T04:01:58.679194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:16.084147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298926+0000","last_change":"2023-06-08T04:01:57.311452+0000","last_active":"2023-06-08T04:01:58.298926+0000","last_peered":"2023-06-08T04:01:58.298926+0000","last_clean":"2023-06-08T04:01:58.298926+0000","last_became_active":"2023-06-08T04:01:57.311216+0000","last_became_peered":"2023-06-08T04:01:57.311216+0000","last_unstale":"2023-06-08T04:01:58.298926+0000","last_undegraded":"2023-06-08T04:01:58.298926+0000","last_fullsized":"2023-06-08T04:01:58.298926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:25.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298001+0000","last_change":"2023-06-08T04:01:56.787492+0000","last_active":"2023-06-08T04:01:58.298001+0000","last_peered":"2023-06-08T04:01:58.298001+0000","last_clean":"2023-06-08T04:01:58.298001+0000","last_became_active":"2023-06-08T04:01:56.787212+0000","last_became_peered":"2023-06-08T04:01:56.787212+0000","last_unstale":"2023-06-08T04:01:58.298001+0000","last_undegraded":"2023-06-08T04:01:58.298001+0000","last_fullsized":"2023-06-08T04:01:58.298001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:11:59.951753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680188+0000","last_change":"2023-06-08T04:01:57.307696+0000","last_active":"2023-06-08T04:01:58.680188+0000","last_peered":"2023-06-08T04:01:58.680188+0000","last_clean":"2023-06-08T04:01:58.680188+0000","last_became_active":"2023-06-08T04:01:57.307394+0000","last_became_peered":"2023-06-08T04:01:57.307394+0000","last_unstale":"2023-06-08T04:01:58.680188+0000","last_undegraded":"2023-06-08T04:01:58.680188+0000","last_fullsized":"2023-06-08T04:01:58.680188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679211+0000","last_change":"2023-06-08T04:01:56.792893+0000","last_active":"2023-06-08T04:01:58.679211+0000","last_peered":"2023-06-08T04:01:58.679211+0000","last_clean":"2023-06-08T04:01:58.679211+0000","last_became_active":"2023-06-08T04:01:56.792583+0000","last_became_peered":"2023-06-08T04:01:56.792583+0000","last_unstale":"2023-06-08T04:01:58.679211+0000","last_undegraded":"2023-06-08T04:01:58.679211+0000","last_fullsized":"2023-06-08T04:01:58.679211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:51:11.572500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679629+0000","last_change":"2023-06-08T04:01:57.313638+0000","last_active":"2023-06-08T04:01:58.679629+0000","last_peered":"2023-06-08T04:01:58.679629+0000","last_clean":"2023-06-08T04:01:58.679629+0000","last_became_active":"2023-06-08T04:01:57.313084+0000","last_became_peered":"2023-06-08T04:01:57.313084+0000","last_unstale":"2023-06-08T04:01:58.679629+0000","last_undegraded":"2023-06-08T04:01:58.679629+0000","last_fullsized":"2023-06-08T04:01:58.679629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:23.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298175+0000","last_change":"2023-06-08T04:01:56.786135+0000","last_active":"2023-06-08T04:01:58.298175+0000","last_peered":"2023-06-08T04:01:58.298175+0000","last_clean":"2023-06-08T04:01:58.298175+0000","last_became_active":"2023-06-08T04:01:56.785831+0000","last_became_peered":"2023-06-08T04:01:56.785831+0000","last_unstale":"2023-06-08T04:01:58.298175+0000","last_undegraded":"2023-06-08T04:01:58.298175+0000","last_fullsized":"2023-06-08T04:01:58.298175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:46.343531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298483+0000","last_change":"2023-06-08T04:01:57.311375+0000","last_active":"2023-06-08T04:01:58.298483+0000","last_peered":"2023-06-08T04:01:58.298483+0000","last_clean":"2023-06-08T04:01:58.298483+0000","last_became_active":"2023-06-08T04:01:57.310796+0000","last_became_peered":"2023-06-08T04:01:57.310796+0000","last_unstale":"2023-06-08T04:01:58.298483+0000","last_undegraded":"2023-06-08T04:01:58.298483+0000","last_fullsized":"2023-06-08T04:01:58.298483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:41.897231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298396+0000","last_change":"2023-06-08T04:01:56.786840+0000","last_active":"2023-06-08T04:01:58.298396+0000","last_peered":"2023-06-08T04:01:58.298396+0000","last_clean":"2023-06-08T04:01:58.298396+0000","last_became_active":"2023-06-08T04:01:56.786481+0000","last_became_peered":"2023-06-08T04:01:56.786481+0000","last_unstale":"2023-06-08T04:01:58.298396+0000","last_undegraded":"2023-06-08T04:01:58.298396+0000","last_fullsized":"2023-06-08T04:01:58.298396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:19:04.990816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678894+0000","last_change":"2023-06-08T04:01:57.324051+0000","last_active":"2023-06-08T04:01:58.678894+0000","last_peered":"2023-06-08T04:01:58.678894+0000","last_clean":"2023-06-08T04:01:58.678894+0000","last_became_active":"2023-06-08T04:01:57.323207+0000","last_became_peered":"2023-06-08T04:01:57.323207+0000","last_unstale":"2023-06-08T04:01:58.678894+0000","last_undegraded":"2023-06-08T04:01:58.678894+0000","last_fullsized":"2023-06-08T04:01:58.678894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299059+0000","last_change":"2023-06-08T04:01:56.785385+0000","last_active":"2023-06-08T04:01:58.299059+0000","last_peered":"2023-06-08T04:01:58.299059+0000","last_clean":"2023-06-08T04:01:58.299059+0000","last_became_active":"2023-06-08T04:01:56.785079+0000","last_became_peered":"2023-06-08T04:01:56.785079+0000","last_unstale":"2023-06-08T04:01:58.299059+0000","last_undegraded":"2023-06-08T04:01:58.299059+0000","last_fullsized":"2023-06-08T04:01:58.299059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:56.785165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679791+0000","last_change":"2023-06-08T04:01:57.313448+0000","last_active":"2023-06-08T04:01:58.679791+0000","last_peered":"2023-06-08T04:01:58.679791+0000","last_clean":"2023-06-08T04:01:58.679791+0000","last_became_active":"2023-06-08T04:01:57.312734+0000","last_became_peered":"2023-06-08T04:01:57.312734+0000","last_unstale":"2023-06-08T04:01:58.679791+0000","last_undegraded":"2023-06-08T04:01:58.679791+0000","last_fullsized":"2023-06-08T04:01:58.679791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298787+0000","last_change":"2023-06-08T04:01:56.779903+0000","last_active":"2023-06-08T04:01:58.298787+0000","last_peered":"2023-06-08T04:01:58.298787+0000","last_clean":"2023-06-08T04:01:58.298787+0000","last_became_active":"2023-06-08T04:01:56.779569+0000","last_became_peered":"2023-06-08T04:01:56.779569+0000","last_unstale":"2023-06-08T04:01:58.298787+0000","last_undegraded":"2023-06-08T04:01:58.298787+0000","last_fullsized":"2023-06-08T04:01:58.298787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:52.080071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679025+0000","last_change":"2023-06-08T04:01:57.309781+0000","last_active":"2023-06-08T04:01:58.679025+0000","last_peered":"2023-06-08T04:01:58.679025+0000","last_clean":"2023-06-08T04:01:58.679025+0000","last_became_active":"2023-06-08T04:01:57.309383+0000","last_became_peered":"2023-06-08T04:01:57.309383+0000","last_unstale":"2023-06-08T04:01:58.679025+0000","last_undegraded":"2023-06-08T04:01:58.679025+0000","last_fullsized":"2023-06-08T04:01:58.679025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680127+0000","last_change":"2023-06-08T04:01:56.785855+0000","last_active":"2023-06-08T04:01:58.680127+0000","last_peered":"2023-06-08T04:01:58.680127+0000","last_clean":"2023-06-08T04:01:58.680127+0000","last_became_active":"2023-06-08T04:01:56.785233+0000","last_became_peered":"2023-06-08T04:01:56.785233+0000","last_unstale":"2023-06-08T04:01:58.680127+0000","last_undegraded":"2023-06-08T04:01:58.680127+0000","last_fullsized":"2023-06-08T04:01:58.680127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:17.687446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679452+0000","last_change":"2023-06-08T04:01:57.322184+0000","last_active":"2023-06-08T04:01:58.679452+0000","last_peered":"2023-06-08T04:01:58.679452+0000","last_clean":"2023-06-08T04:01:58.679452+0000","last_became_active":"2023-06-08T04:01:57.321644+0000","last_became_peered":"2023-06-08T04:01:57.321644+0000","last_unstale":"2023-06-08T04:01:58.679452+0000","last_undegraded":"2023-06-08T04:01:58.679452+0000","last_fullsized":"2023-06-08T04:01:58.679452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:12:00.959096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679629+0000","last_change":"2023-06-08T04:01:56.793021+0000","last_active":"2023-06-08T04:01:58.679629+0000","last_peered":"2023-06-08T04:01:58.679629+0000","last_clean":"2023-06-08T04:01:58.679629+0000","last_became_active":"2023-06-08T04:01:56.792695+0000","last_became_peered":"2023-06-08T04:01:56.792695+0000","last_unstale":"2023-06-08T04:01:58.679629+0000","last_undegraded":"2023-06-08T04:01:58.679629+0000","last_fullsized":"2023-06-08T04:01:58.679629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:16.084147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679919+0000","last_change":"2023-06-08T04:01:57.315172+0000","last_active":"2023-06-08T04:01:58.679919+0000","last_peered":"2023-06-08T04:01:58.679919+0000","last_clean":"2023-06-08T04:01:58.679919+0000","last_became_active":"2023-06-08T04:01:57.314816+0000","last_became_peered":"2023-06-08T04:01:57.314816+0000","last_unstale":"2023-06-08T04:01:58.679919+0000","last_undegraded":"2023-06-08T04:01:58.679919+0000","last_fullsized":"2023-06-08T04:01:58.679919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:12.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679033+0000","last_change":"2023-06-08T04:01:56.782841+0000","last_active":"2023-06-08T04:01:58.679033+0000","last_peered":"2023-06-08T04:01:58.679033+0000","last_clean":"2023-06-08T04:01:58.679033+0000","last_became_active":"2023-06-08T04:01:56.782518+0000","last_became_peered":"2023-06-08T04:01:56.782518+0000","last_unstale":"2023-06-08T04:01:58.679033+0000","last_undegraded":"2023-06-08T04:01:58.679033+0000","last_fullsized":"2023-06-08T04:01:58.679033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679866+0000","last_change":"2023-06-08T04:01:57.326388+0000","last_active":"2023-06-08T04:01:58.679866+0000","last_peered":"2023-06-08T04:01:58.679866+0000","last_clean":"2023-06-08T04:01:58.679866+0000","last_became_active":"2023-06-08T04:01:57.326127+0000","last_became_peered":"2023-06-08T04:01:57.326127+0000","last_unstale":"2023-06-08T04:01:58.679866+0000","last_undegraded":"2023-06-08T04:01:58.679866+0000","last_fullsized":"2023-06-08T04:01:58.679866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:57.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679592+0000","last_change":"2023-06-08T04:01:56.789026+0000","last_active":"2023-06-08T04:01:58.679592+0000","last_peered":"2023-06-08T04:01:58.679592+0000","last_clean":"2023-06-08T04:01:58.679592+0000","last_became_active":"2023-06-08T04:01:56.788477+0000","last_became_peered":"2023-06-08T04:01:56.788477+0000","last_unstale":"2023-06-08T04:01:58.679592+0000","last_undegraded":"2023-06-08T04:01:58.679592+0000","last_fullsized":"2023-06-08T04:01:58.679592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680114+0000","last_change":"2023-06-08T04:01:57.305826+0000","last_active":"2023-06-08T04:01:58.680114+0000","last_peered":"2023-06-08T04:01:58.680114+0000","last_clean":"2023-06-08T04:01:58.680114+0000","last_became_active":"2023-06-08T04:01:57.305443+0000","last_became_peered":"2023-06-08T04:01:57.305443+0000","last_unstale":"2023-06-08T04:01:58.680114+0000","last_undegraded":"2023-06-08T04:01:58.680114+0000","last_fullsized":"2023-06-08T04:01:58.680114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679382+0000","last_change":"2023-06-08T04:01:56.789943+0000","last_active":"2023-06-08T04:01:58.679382+0000","last_peered":"2023-06-08T04:01:58.679382+0000","last_clean":"2023-06-08T04:01:58.679382+0000","last_became_active":"2023-06-08T04:01:56.789641+0000","last_became_peered":"2023-06-08T04:01:56.789641+0000","last_unstale":"2023-06-08T04:01:58.679382+0000","last_undegraded":"2023-06-08T04:01:58.679382+0000","last_fullsized":"2023-06-08T04:01:58.679382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:24.507881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679700+0000","last_change":"2023-06-08T04:01:50.999784+0000","last_active":"2023-06-08T04:01:58.679700+0000","last_peered":"2023-06-08T04:01:58.679700+0000","last_clean":"2023-06-08T04:01:58.679700+0000","last_became_active":"2023-06-08T04:01:50.999446+0000","last_became_peered":"2023-06-08T04:01:50.999446+0000","last_unstale":"2023-06-08T04:01:58.679700+0000","last_undegraded":"2023-06-08T04:01:58.679700+0000","last_fullsized":"2023-06-08T04:01:58.679700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:18:58.957649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679453+0000","last_change":"2023-06-08T04:01:57.314412+0000","last_active":"2023-06-08T04:01:58.679453+0000","last_peered":"2023-06-08T04:01:58.679453+0000","last_clean":"2023-06-08T04:01:58.679453+0000","last_became_active":"2023-06-08T04:01:57.314079+0000","last_became_peered":"2023-06-08T04:01:57.314079+0000","last_unstale":"2023-06-08T04:01:58.679453+0000","last_undegraded":"2023-06-08T04:01:58.679453+0000","last_fullsized":"2023-06-08T04:01:58.679453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:50.348618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679209+0000","last_change":"2023-06-08T04:01:50.729188+0000","last_active":"2023-06-08T04:01:58.679209+0000","last_peered":"2023-06-08T04:01:58.679209+0000","last_clean":"2023-06-08T04:01:58.679209+0000","last_became_active":"2023-06-08T04:01:50.728711+0000","last_became_peered":"2023-06-08T04:01:50.728711+0000","last_unstale":"2023-06-08T04:01:58.679209+0000","last_undegraded":"2023-06-08T04:01:58.679209+0000","last_fullsized":"2023-06-08T04:01:58.679209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:46.046903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680628+0000","last_change":"2023-06-08T04:01:56.784336+0000","last_active":"2023-06-08T04:01:58.680628+0000","last_peered":"2023-06-08T04:01:58.680628+0000","last_clean":"2023-06-08T04:01:58.680628+0000","last_became_active":"2023-06-08T04:01:56.783906+0000","last_became_peered":"2023-06-08T04:01:56.783906+0000","last_unstale":"2023-06-08T04:01:58.680628+0000","last_undegraded":"2023-06-08T04:01:58.680628+0000","last_fullsized":"2023-06-08T04:01:58.680628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:48.770281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678949+0000","last_change":"2023-06-08T04:01:57.325405+0000","last_active":"2023-06-08T04:01:58.678949+0000","last_peered":"2023-06-08T04:01:58.678949+0000","last_clean":"2023-06-08T04:01:58.678949+0000","last_became_active":"2023-06-08T04:01:57.325123+0000","last_became_peered":"2023-06-08T04:01:57.325123+0000","last_unstale":"2023-06-08T04:01:58.678949+0000","last_undegraded":"2023-06-08T04:01:58.678949+0000","last_fullsized":"2023-06-08T04:01:58.678949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:25.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678720+0000","last_change":"2023-06-08T04:01:50.734710+0000","last_active":"2023-06-08T04:01:58.678720+0000","last_peered":"2023-06-08T04:01:58.678720+0000","last_clean":"2023-06-08T04:01:58.678720+0000","last_became_active":"2023-06-08T04:01:50.734287+0000","last_became_peered":"2023-06-08T04:01:50.734287+0000","last_unstale":"2023-06-08T04:01:58.678720+0000","last_undegraded":"2023-06-08T04:01:58.678720+0000","last_fullsized":"2023-06-08T04:01:58.678720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:51:05.539333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297919+0000","last_change":"2023-06-08T04:01:51.742803+0000","last_active":"2023-06-08T04:01:58.297919+0000","last_peered":"2023-06-08T04:01:58.297919+0000","last_clean":"2023-06-08T04:01:58.297919+0000","last_became_active":"2023-06-08T04:01:51.742466+0000","last_became_peered":"2023-06-08T04:01:51.742466+0000","last_unstale":"2023-06-08T04:01:58.297919+0000","last_undegraded":"2023-06-08T04:01:58.297919+0000","last_fullsized":"2023-06-08T04:01:58.297919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_clean_scrub_stamp":"2023-06-08T04:01:50.718021+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:17.413272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679950+0000","last_change":"2023-06-08T04:01:56.783919+0000","last_active":"2023-06-08T04:01:58.679950+0000","last_peered":"2023-06-08T04:01:58.679950+0000","last_clean":"2023-06-08T04:01:58.679950+0000","last_became_active":"2023-06-08T04:01:56.783607+0000","last_became_peered":"2023-06-08T04:01:56.783607+0000","last_unstale":"2023-06-08T04:01:58.679950+0000","last_undegraded":"2023-06-08T04:01:58.679950+0000","last_fullsized":"2023-06-08T04:01:58.679950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:27.687219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680318+0000","last_change":"2023-06-08T04:01:57.309149+0000","last_active":"2023-06-08T04:01:58.680318+0000","last_peered":"2023-06-08T04:01:58.680318+0000","last_clean":"2023-06-08T04:01:58.680318+0000","last_became_active":"2023-06-08T04:01:57.308445+0000","last_became_peered":"2023-06-08T04:01:57.308445+0000","last_unstale":"2023-06-08T04:01:58.680318+0000","last_undegraded":"2023-06-08T04:01:58.680318+0000","last_fullsized":"2023-06-08T04:01:58.680318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297951+0000","last_change":"2023-06-08T04:01:51.001331+0000","last_active":"2023-06-08T04:01:58.297951+0000","last_peered":"2023-06-08T04:01:58.297951+0000","last_clean":"2023-06-08T04:01:58.297951+0000","last_became_active":"2023-06-08T04:01:51.001009+0000","last_became_peered":"2023-06-08T04:01:51.001009+0000","last_unstale":"2023-06-08T04:01:58.297951+0000","last_undegraded":"2023-06-08T04:01:58.297951+0000","last_fullsized":"2023-06-08T04:01:58.297951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:14.078321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678533+0000","last_change":"2023-06-08T04:01:56.787400+0000","last_active":"2023-06-08T04:01:58.678533+0000","last_peered":"2023-06-08T04:01:58.678533+0000","last_clean":"2023-06-08T04:01:58.678533+0000","last_became_active":"2023-06-08T04:01:56.785569+0000","last_became_peered":"2023-06-08T04:01:56.785569+0000","last_unstale":"2023-06-08T04:01:58.678533+0000","last_undegraded":"2023-06-08T04:01:58.678533+0000","last_fullsized":"2023-06-08T04:01:58.678533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:44:53.499091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679987+0000","last_change":"2023-06-08T04:01:57.314750+0000","last_active":"2023-06-08T04:01:58.679987+0000","last_peered":"2023-06-08T04:01:58.679987+0000","last_clean":"2023-06-08T04:01:58.679987+0000","last_became_active":"2023-06-08T04:01:57.314472+0000","last_became_peered":"2023-06-08T04:01:57.314472+0000","last_unstale":"2023-06-08T04:01:58.679987+0000","last_undegraded":"2023-06-08T04:01:58.679987+0000","last_fullsized":"2023-06-08T04:01:58.679987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297740+0000","last_change":"2023-06-08T04:01:51.000319+0000","last_active":"2023-06-08T04:01:58.297740+0000","last_peered":"2023-06-08T04:01:58.297740+0000","last_clean":"2023-06-08T04:01:58.297740+0000","last_became_active":"2023-06-08T04:01:50.999943+0000","last_became_peered":"2023-06-08T04:01:50.999943+0000","last_unstale":"2023-06-08T04:01:58.297740+0000","last_undegraded":"2023-06-08T04:01:58.297740+0000","last_fullsized":"2023-06-08T04:01:58.297740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:43.308108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678945+0000","last_change":"2023-06-08T04:01:56.774312+0000","last_active":"2023-06-08T04:01:58.678945+0000","last_peered":"2023-06-08T04:01:58.678945+0000","last_clean":"2023-06-08T04:01:58.678945+0000","last_became_active":"2023-06-08T04:01:56.774005+0000","last_became_peered":"2023-06-08T04:01:56.774005+0000","last_unstale":"2023-06-08T04:01:58.678945+0000","last_undegraded":"2023-06-08T04:01:58.678945+0000","last_fullsized":"2023-06-08T04:01:58.678945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:30.163198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679484+0000","last_change":"2023-06-08T04:01:57.326639+0000","last_active":"2023-06-08T04:01:58.679484+0000","last_peered":"2023-06-08T04:01:58.679484+0000","last_clean":"2023-06-08T04:01:58.679484+0000","last_became_active":"2023-06-08T04:01:57.326373+0000","last_became_peered":"2023-06-08T04:01:57.326373+0000","last_unstale":"2023-06-08T04:01:58.679484+0000","last_undegraded":"2023-06-08T04:01:58.679484+0000","last_fullsized":"2023-06-08T04:01:58.679484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298044+0000","last_change":"2023-06-08T04:01:51.000090+0000","last_active":"2023-06-08T04:01:58.298044+0000","last_peered":"2023-06-08T04:01:58.298044+0000","last_clean":"2023-06-08T04:01:58.298044+0000","last_became_active":"2023-06-08T04:01:50.999789+0000","last_became_peered":"2023-06-08T04:01:50.999789+0000","last_unstale":"2023-06-08T04:01:58.298044+0000","last_undegraded":"2023-06-08T04:01:58.298044+0000","last_fullsized":"2023-06-08T04:01:58.298044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:11:58.206736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679223+0000","last_change":"2023-06-08T04:01:56.778178+0000","last_active":"2023-06-08T04:01:58.679223+0000","last_peered":"2023-06-08T04:01:58.679223+0000","last_clean":"2023-06-08T04:01:58.679223+0000","last_became_active":"2023-06-08T04:01:56.777877+0000","last_became_peered":"2023-06-08T04:01:56.777877+0000","last_unstale":"2023-06-08T04:01:58.679223+0000","last_undegraded":"2023-06-08T04:01:58.679223+0000","last_fullsized":"2023-06-08T04:01:58.679223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:22.443805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679364+0000","last_change":"2023-06-08T04:01:57.312009+0000","last_active":"2023-06-08T04:01:58.679364+0000","last_peered":"2023-06-08T04:01:58.679364+0000","last_clean":"2023-06-08T04:01:58.679364+0000","last_became_active":"2023-06-08T04:01:57.311651+0000","last_became_peered":"2023-06-08T04:01:57.311651+0000","last_unstale":"2023-06-08T04:01:58.679364+0000","last_undegraded":"2023-06-08T04:01:58.679364+0000","last_fullsized":"2023-06-08T04:01:58.679364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:41.897231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679250+0000","last_change":"2023-06-08T04:01:51.000507+0000","last_active":"2023-06-08T04:01:58.679250+0000","last_peered":"2023-06-08T04:01:58.679250+0000","last_clean":"2023-06-08T04:01:58.679250+0000","last_became_active":"2023-06-08T04:01:51.000175+0000","last_became_peered":"2023-06-08T04:01:51.000175+0000","last_unstale":"2023-06-08T04:01:58.679250+0000","last_undegraded":"2023-06-08T04:01:58.679250+0000","last_fullsized":"2023-06-08T04:01:58.679250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:13.100611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679229+0000","last_change":"2023-06-08T04:01:56.785424+0000","last_active":"2023-06-08T04:01:58.679229+0000","last_peered":"2023-06-08T04:01:58.679229+0000","last_clean":"2023-06-08T04:01:58.679229+0000","last_became_active":"2023-06-08T04:01:56.785198+0000","last_became_peered":"2023-06-08T04:01:56.785198+0000","last_unstale":"2023-06-08T04:01:58.679229+0000","last_undegraded":"2023-06-08T04:01:58.679229+0000","last_fullsized":"2023-06-08T04:01:58.679229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:47.851853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679359+0000","last_change":"2023-06-08T04:01:57.315582+0000","last_active":"2023-06-08T04:01:58.679359+0000","last_peered":"2023-06-08T04:01:58.679359+0000","last_clean":"2023-06-08T04:01:58.679359+0000","last_became_active":"2023-06-08T04:01:57.314479+0000","last_became_peered":"2023-06-08T04:01:57.314479+0000","last_unstale":"2023-06-08T04:01:58.679359+0000","last_undegraded":"2023-06-08T04:01:58.679359+0000","last_fullsized":"2023-06-08T04:01:58.679359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679828+0000","last_change":"2023-06-08T04:01:50.734174+0000","last_active":"2023-06-08T04:01:58.679828+0000","last_peered":"2023-06-08T04:01:58.679828+0000","last_clean":"2023-06-08T04:01:58.679828+0000","last_became_active":"2023-06-08T04:01:50.733832+0000","last_became_peered":"2023-06-08T04:01:50.733832+0000","last_unstale":"2023-06-08T04:01:58.679828+0000","last_undegraded":"2023-06-08T04:01:58.679828+0000","last_fullsized":"2023-06-08T04:01:58.679828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:34.856721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299103+0000","last_change":"2023-06-08T04:01:56.782230+0000","last_active":"2023-06-08T04:01:58.299103+0000","last_peered":"2023-06-08T04:01:58.299103+0000","last_clean":"2023-06-08T04:01:58.299103+0000","last_became_active":"2023-06-08T04:01:56.781942+0000","last_became_peered":"2023-06-08T04:01:56.781942+0000","last_unstale":"2023-06-08T04:01:58.299103+0000","last_undegraded":"2023-06-08T04:01:58.299103+0000","last_fullsized":"2023-06-08T04:01:58.299103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679365+0000","last_change":"2023-06-08T04:01:57.314750+0000","last_active":"2023-06-08T04:01:58.679365+0000","last_peered":"2023-06-08T04:01:58.679365+0000","last_clean":"2023-06-08T04:01:58.679365+0000","last_became_active":"2023-06-08T04:01:57.314515+0000","last_became_peered":"2023-06-08T04:01:57.314515+0000","last_unstale":"2023-06-08T04:01:58.679365+0000","last_undegraded":"2023-06-08T04:01:58.679365+0000","last_fullsized":"2023-06-08T04:01:58.679365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679505+0000","last_change":"2023-06-08T04:01:56.784632+0000","last_active":"2023-06-08T04:01:58.679505+0000","last_peered":"2023-06-08T04:01:58.679505+0000","last_clean":"2023-06-08T04:01:58.679505+0000","last_became_active":"2023-06-08T04:01:56.784077+0000","last_became_peered":"2023-06-08T04:01:56.784077+0000","last_unstale":"2023-06-08T04:01:58.679505+0000","last_undegraded":"2023-06-08T04:01:58.679505+0000","last_fullsized":"2023-06-08T04:01:58.679505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:40.889888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294761+0000","last_change":"2023-06-08T04:01:57.306546+0000","last_active":"2023-06-08T04:01:58.294761+0000","last_peered":"2023-06-08T04:01:58.294761+0000","last_clean":"2023-06-08T04:01:58.294761+0000","last_became_active":"2023-06-08T04:01:57.306284+0000","last_became_peered":"2023-06-08T04:01:57.306284+0000","last_unstale":"2023-06-08T04:01:58.294761+0000","last_undegraded":"2023-06-08T04:01:58.294761+0000","last_fullsized":"2023-06-08T04:01:58.294761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:27:15.918495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298675+0000","last_change":"2023-06-08T04:01:56.782619+0000","last_active":"2023-06-08T04:01:58.298675+0000","last_peered":"2023-06-08T04:01:58.298675+0000","last_clean":"2023-06-08T04:01:58.298675+0000","last_became_active":"2023-06-08T04:01:56.782330+0000","last_became_peered":"2023-06-08T04:01:56.782330+0000","last_unstale":"2023-06-08T04:01:58.298675+0000","last_undegraded":"2023-06-08T04:01:58.298675+0000","last_fullsized":"2023-06-08T04:01:58.298675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:30.163198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679246+0000","last_change":"2023-06-08T04:01:57.321947+0000","last_active":"2023-06-08T04:01:58.679246+0000","last_peered":"2023-06-08T04:01:58.679246+0000","last_clean":"2023-06-08T04:01:58.679246+0000","last_became_active":"2023-06-08T04:01:57.321553+0000","last_became_peered":"2023-06-08T04:01:57.321553+0000","last_unstale":"2023-06-08T04:01:58.679246+0000","last_undegraded":"2023-06-08T04:01:58.679246+0000","last_fullsized":"2023-06-08T04:01:58.679246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:21.118831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299053+0000","last_change":"2023-06-08T04:01:56.781610+0000","last_active":"2023-06-08T04:01:58.299053+0000","last_peered":"2023-06-08T04:01:58.299053+0000","last_clean":"2023-06-08T04:01:58.299053+0000","last_became_active":"2023-06-08T04:01:56.781235+0000","last_became_peered":"2023-06-08T04:01:56.781235+0000","last_unstale":"2023-06-08T04:01:58.299053+0000","last_undegraded":"2023-06-08T04:01:58.299053+0000","last_fullsized":"2023-06-08T04:01:58.299053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:49.341275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680212+0000","last_change":"2023-06-08T04:01:57.320898+0000","last_active":"2023-06-08T04:01:58.680212+0000","last_peered":"2023-06-08T04:01:58.680212+0000","last_clean":"2023-06-08T04:01:58.680212+0000","last_became_active":"2023-06-08T04:01:57.320681+0000","last_became_peered":"2023-06-08T04:01:57.320681+0000","last_unstale":"2023-06-08T04:01:58.680212+0000","last_undegraded":"2023-06-08T04:01:58.680212+0000","last_fullsized":"2023-06-08T04:01:58.680212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:34:03.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679303+0000","last_change":"2023-06-08T04:01:56.789740+0000","last_active":"2023-06-08T04:01:58.679303+0000","last_peered":"2023-06-08T04:01:58.679303+0000","last_clean":"2023-06-08T04:01:58.679303+0000","last_became_active":"2023-06-08T04:01:56.789322+0000","last_became_peered":"2023-06-08T04:01:56.789322+0000","last_unstale":"2023-06-08T04:01:58.679303+0000","last_undegraded":"2023-06-08T04:01:58.679303+0000","last_fullsized":"2023-06-08T04:01:58.679303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:49.253411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680786+0000","last_change":"2023-06-08T04:01:57.301738+0000","last_active":"2023-06-08T04:01:58.680786+0000","last_peered":"2023-06-08T04:01:58.680786+0000","last_clean":"2023-06-08T04:01:58.680786+0000","last_became_active":"2023-06-08T04:01:57.301468+0000","last_became_peered":"2023-06-08T04:01:57.301468+0000","last_unstale":"2023-06-08T04:01:58.680786+0000","last_undegraded":"2023-06-08T04:01:58.680786+0000","last_fullsized":"2023-06-08T04:01:58.680786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:57.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680472+0000","last_change":"2023-06-08T04:01:56.774643+0000","last_active":"2023-06-08T04:01:58.680472+0000","last_peered":"2023-06-08T04:01:58.680472+0000","last_clean":"2023-06-08T04:01:58.680472+0000","last_became_active":"2023-06-08T04:01:56.774331+0000","last_became_peered":"2023-06-08T04:01:56.774331+0000","last_unstale":"2023-06-08T04:01:58.680472+0000","last_undegraded":"2023-06-08T04:01:58.680472+0000","last_fullsized":"2023-06-08T04:01:58.680472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:49.341275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678854+0000","last_change":"2023-06-08T04:01:57.325733+0000","last_active":"2023-06-08T04:01:58.678854+0000","last_peered":"2023-06-08T04:01:58.678854+0000","last_clean":"2023-06-08T04:01:58.678854+0000","last_became_active":"2023-06-08T04:01:57.325478+0000","last_became_peered":"2023-06-08T04:01:57.325478+0000","last_unstale":"2023-06-08T04:01:58.678854+0000","last_undegraded":"2023-06-08T04:01:58.678854+0000","last_fullsized":"2023-06-08T04:01:58.678854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679936+0000","last_change":"2023-06-08T04:01:57.316607+0000","last_active":"2023-06-08T04:01:58.679936+0000","last_peered":"2023-06-08T04:01:58.679936+0000","last_clean":"2023-06-08T04:01:58.679936+0000","last_became_active":"2023-06-08T04:01:57.316279+0000","last_became_peered":"2023-06-08T04:01:57.316279+0000","last_unstale":"2023-06-08T04:01:58.679936+0000","last_undegraded":"2023-06-08T04:01:58.679936+0000","last_fullsized":"2023-06-08T04:01:58.679936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680685+0000","last_change":"2023-06-08T04:01:57.307400+0000","last_active":"2023-06-08T04:01:58.680685+0000","last_peered":"2023-06-08T04:01:58.680685+0000","last_clean":"2023-06-08T04:01:58.680685+0000","last_became_active":"2023-06-08T04:01:57.307110+0000","last_became_peered":"2023-06-08T04:01:57.307110+0000","last_unstale":"2023-06-08T04:01:58.680685+0000","last_undegraded":"2023-06-08T04:01:58.680685+0000","last_fullsized":"2023-06-08T04:01:58.680685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:47.350874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680097+0000","last_change":"2023-06-08T04:01:57.328380+0000","last_active":"2023-06-08T04:01:58.680097+0000","last_peered":"2023-06-08T04:01:58.680097+0000","last_clean":"2023-06-08T04:01:58.680097+0000","last_became_active":"2023-06-08T04:01:57.328134+0000","last_became_peered":"2023-06-08T04:01:57.328134+0000","last_unstale":"2023-06-08T04:01:58.680097+0000","last_undegraded":"2023-06-08T04:01:58.680097+0000","last_fullsized":"2023-06-08T04:01:58.680097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:25:34.644774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680126+0000","last_change":"2023-06-08T04:01:57.313801+0000","last_active":"2023-06-08T04:01:58.680126+0000","last_peered":"2023-06-08T04:01:58.680126+0000","last_clean":"2023-06-08T04:01:58.680126+0000","last_became_active":"2023-06-08T04:01:57.313059+0000","last_became_peered":"2023-06-08T04:01:57.313059+0000","last_unstale":"2023-06-08T04:01:58.680126+0000","last_undegraded":"2023-06-08T04:01:58.680126+0000","last_fullsized":"2023-06-08T04:01:58.680126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679109+0000","last_change":"2023-06-08T04:01:57.316784+0000","last_active":"2023-06-08T04:01:58.679109+0000","last_peered":"2023-06-08T04:01:58.679109+0000","last_clean":"2023-06-08T04:01:58.679109+0000","last_became_active":"2023-06-08T04:01:57.316329+0000","last_became_peered":"2023-06-08T04:01:57.316329+0000","last_unstale":"2023-06-08T04:01:58.679109+0000","last_undegraded":"2023-06-08T04:01:58.679109+0000","last_fullsized":"2023-06-08T04:01:58.679109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:17.091490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":671608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":669828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":72403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":72897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":74427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":80112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T04:02:02.695 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-08T04:02:02.695 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-08T04:02:02.696 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-08T04:02:02.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-08T04:02:02.696 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-08T04:02:02.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.927+0000 7fb76bbff700 1 Processor -- start 2023-06-08T04:02:02.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.927+0000 7fb76bbff700 1 -- start start 2023-06-08T04:02:02.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.928+0000 7fb76bbff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7640b83f0 0x7fb764160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.928+0000 7fb76bbff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb7640ced40 0x7fb7640b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.928+0000 7fb76bbff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb7640b4b50 0x7fb76406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.928+0000 7fb76bbff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7640b4fd0 con 0x7fb7640ced40 2023-06-08T04:02:02.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.928+0000 7fb76bbff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7640d0800 con 0x7fb7640b4b50 2023-06-08T04:02:02.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.928+0000 7fb76bbff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640cd1e0 con 0x7fb7640b83f0 2023-06-08T04:02:02.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.928+0000 7fb76919a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb7640ced40 0x7fb7640b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.928+0000 7fb76919a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb7640ced40 0x7fb7640b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41864/0 (socket says 172.21.15.16:41864) 2023-06-08T04:02:02.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.928+0000 7fb76919a700 1 -- 172.21.15.16:0/3788004354 learned_addr learned my addr 172.21.15.16:0/3788004354 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:02.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.928+0000 7fb76a19c700 1 --2- 172.21.15.16:0/3788004354 >> v2:172.21.15.169:3300/0 conn(0x7fb7640b4b50 0x7fb76406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.928+0000 7fb76999b700 1 --2- 172.21.15.16:0/3788004354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7640b83f0 0x7fb764160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.929+0000 7fb76919a700 1 -- 172.21.15.16:0/3788004354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7640b83f0 msgr2=0x7fb764160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:02.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.929+0000 7fb76919a700 1 --2- 172.21.15.16:0/3788004354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7640b83f0 0x7fb764160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.929+0000 7fb76919a700 1 -- 172.21.15.16:0/3788004354 >> v2:172.21.15.169:3300/0 conn(0x7fb7640b4b50 msgr2=0x7fb76406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:02.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.929+0000 7fb76919a700 1 --2- 172.21.15.16:0/3788004354 >> v2:172.21.15.169:3300/0 conn(0x7fb7640b4b50 0x7fb76406b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.929+0000 7fb76919a700 1 -- 172.21.15.16:0/3788004354 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640cd4c0 con 0x7fb7640ced40 2023-06-08T04:02:02.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.929+0000 7fb76919a700 1 --2- 172.21.15.16:0/3788004354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7640ced40 0x7fb7640b4610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb764073cb0 tx=0x7fb754009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aec9bb53c14fb5d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:02.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.929+0000 7fb768999700 1 -- 172.21.15.16:0/3788004354 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754011830 con 0x7fb7640ced40 2023-06-08T04:02:02.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.929+0000 7fb768999700 1 -- 172.21.15.16:0/3788004354 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb754011990 con 0x7fb7640ced40 2023-06-08T04:02:02.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.929+0000 7fb768999700 1 -- 172.21.15.16:0/3788004354 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754011d20 con 0x7fb7640ced40 2023-06-08T04:02:02.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.930+0000 7fb76bbff700 1 -- 172.21.15.16:0/3788004354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7640ced40 msgr2=0x7fb7640b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.930+0000 7fb76bbff700 1 --2- 172.21.15.16:0/3788004354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7640ced40 0x7fb7640b4610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb764073cb0 tx=0x7fb754009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.930+0000 7fb76bbff700 1 -- 172.21.15.16:0/3788004354 shutdown_connections 2023-06-08T04:02:02.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.930+0000 7fb76bbff700 1 --2- 172.21.15.16:0/3788004354 >> v2:172.21.15.169:3300/0 conn(0x7fb7640b4b50 0x7fb76406b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.930+0000 7fb76bbff700 1 --2- 172.21.15.16:0/3788004354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7640b83f0 0x7fb764160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.930+0000 7fb76bbff700 1 --2- 172.21.15.16:0/3788004354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7640ced40 0x7fb7640b4610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.930+0000 7fb76bbff700 1 -- 172.21.15.16:0/3788004354 >> 172.21.15.16:0/3788004354 conn(0x7fb7640cf610 msgr2=0x7fb7640cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:02.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.930+0000 7fb76bbff700 1 -- 172.21.15.16:0/3788004354 shutdown_connections 2023-06-08T04:02:02.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.930+0000 7fb76bbff700 1 -- 172.21.15.16:0/3788004354 wait complete. 2023-06-08T04:02:02.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.932+0000 7fb76bbff700 1 Processor -- start 2023-06-08T04:02:02.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.932+0000 7fb76bbff700 1 -- start start 2023-06-08T04:02:02.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.933+0000 7fb76bbff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7640b4b50 0x7fb76415df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.933+0000 7fb76bbff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7640b83f0 0x7fb76415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.933+0000 7fb76bbff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7640ced40 0x7fb7640d1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.933+0000 7fb76bbff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76415a6c0 con 0x7fb7640b83f0 2023-06-08T04:02:02.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.933+0000 7fb76bbff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76415f200 con 0x7fb7640ced40 2023-06-08T04:02:02.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.933+0000 7fb76bbff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640d1850 con 0x7fb7640b4b50 2023-06-08T04:02:02.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.933+0000 7fb76919a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7640b83f0 0x7fb76415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.933+0000 7fb76919a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7640b83f0 0x7fb76415a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41870/0 (socket says 172.21.15.16:41870) 2023-06-08T04:02:02.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.933+0000 7fb76919a700 1 -- 172.21.15.16:0/2135329190 learned_addr learned my addr 172.21.15.16:0/2135329190 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:02.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.933+0000 7fb76999b700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7640b4b50 0x7fb76415df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.933+0000 7fb76a19c700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7640ced40 0x7fb7640d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.934+0000 7fb76919a700 1 -- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7640b4b50 msgr2=0x7fb76415df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.934+0000 7fb76919a700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7640b4b50 0x7fb76415df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.934+0000 7fb76919a700 1 -- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7640ced40 msgr2=0x7fb7640d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:02.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.934+0000 7fb76919a700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7640ced40 0x7fb7640d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:02.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.934+0000 7fb76919a700 1 -- 172.21.15.16:0/2135329190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754009550 con 0x7fb7640b83f0 2023-06-08T04:02:02.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.934+0000 7fb76919a700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7640b83f0 0x7fb76415a180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb754009c10 tx=0x7fb754004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:02.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.934+0000 7fb75a7fc700 1 -- 172.21.15.16:0/2135329190 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754004450 con 0x7fb7640b83f0 2023-06-08T04:02:02.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.934+0000 7fb75a7fc700 1 -- 172.21.15.16:0/2135329190 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75401e070 con 0x7fb7640b83f0 2023-06-08T04:02:02.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.934+0000 7fb75a7fc700 1 -- 172.21.15.16:0/2135329190 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7540038e0 con 0x7fb7640b83f0 2023-06-08T04:02:02.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.934+0000 7fb76bbff700 1 -- 172.21.15.16:0/2135329190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76415e5f0 con 0x7fb7640b83f0 2023-06-08T04:02:02.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.934+0000 7fb76bbff700 1 -- 172.21.15.16:0/2135329190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76415ebb0 con 0x7fb7640b83f0 2023-06-08T04:02:02.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.935+0000 7fb76bbff700 1 -- 172.21.15.16:0/2135329190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7640740e0 con 0x7fb7640b83f0 2023-06-08T04:02:02.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.936+0000 7fb75a7fc700 1 -- 172.21.15.16:0/2135329190 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb754003a40 con 0x7fb7640b83f0 2023-06-08T04:02:02.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.937+0000 7fb75a7fc700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb74806ace0 0x7fb74806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:02.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.937+0000 7fb75a7fc700 1 -- 172.21.15.16:0/2135329190 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb75408a260 con 0x7fb7640b83f0 2023-06-08T04:02:02.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.938+0000 7fb76999b700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb74806ace0 0x7fb74806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:02.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.938+0000 7fb76999b700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb74806ace0 0x7fb74806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb760009be0 tx=0x7fb760009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:02.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:02.941+0000 7fb75a7fc700 1 -- 172.21.15.16:0/2135329190 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb754055300 con 0x7fb7640b83f0 2023-06-08T04:02:03.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.203+0000 7fb76bbff700 1 -- 172.21.15.16:0/2135329190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb76406c150 con 0x7fb7640b83f0 2023-06-08T04:02:03.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.206+0000 7fb75a7fc700 1 -- 172.21.15.16:0/2135329190 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170849 (secure 0 0 0) 0x7fb754058920 con 0x7fb7640b83f0 2023-06-08T04:02:03.212 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:03.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.209+0000 7fb76bbff700 1 -- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb74806ace0 msgr2=0x7fb74806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.209+0000 7fb76bbff700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb74806ace0 0x7fb74806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb760009be0 tx=0x7fb760009210 comp rx=0 tx=0).stop 2023-06-08T04:02:03.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.209+0000 7fb76bbff700 1 -- 172.21.15.16:0/2135329190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7640b83f0 msgr2=0x7fb76415a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.209+0000 7fb76bbff700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7640b83f0 0x7fb76415a180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb754009c10 tx=0x7fb754004750 comp rx=0 tx=0).stop 2023-06-08T04:02:03.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.210+0000 7fb76bbff700 1 -- 172.21.15.16:0/2135329190 shutdown_connections 2023-06-08T04:02:03.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.210+0000 7fb76bbff700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb74806ace0 0x7fb74806d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.210+0000 7fb76bbff700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7640ced40 0x7fb7640d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.210+0000 7fb76bbff700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7640b4b50 0x7fb76415df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.210+0000 7fb76bbff700 1 --2- 172.21.15.16:0/2135329190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7640b83f0 0x7fb76415a180 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.210+0000 7fb76bbff700 1 -- 172.21.15.16:0/2135329190 >> 172.21.15.16:0/2135329190 conn(0x7fb7640cf610 msgr2=0x7fb76415fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:03.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.210+0000 7fb76bbff700 1 -- 172.21.15.16:0/2135329190 shutdown_connections 2023-06-08T04:02:03.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.210+0000 7fb76bbff700 1 -- 172.21.15.16:0/2135329190 wait complete. 2023-06-08T04:02:03.231 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2339348297},{"type":"v1","addr":"172.21.15.169:6833","nonce":2339348297}]},"active_addr":"172.21.15.169:6833/2339348297","active_change":"2023-06-08T04:01:44.170568+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":1590396970}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":4278316321}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":4021890620}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":2805019308}]}]} 2023-06-08T04:02:03.236 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-08T04:02:03.236 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-08T04:02:03.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:03.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.431+0000 7f5d807ff700 1 Processor -- start 2023-06-08T04:02:03.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.432+0000 7f5d807ff700 1 -- start start 2023-06-08T04:02:03.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.433+0000 7f5d807ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5d78160a60 0x7f5d780b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.433+0000 7f5d807ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5d780b4b50 0x7f5d780d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.433+0000 7f5d807ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d780d0800 con 0x7f5d780b83f0 2023-06-08T04:02:03.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.433+0000 7f5d807ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d78160ed0 con 0x7f5d780b4b50 2023-06-08T04:02:03.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.433+0000 7f5d807ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d780b4fd0 con 0x7f5d78160a60 2023-06-08T04:02:03.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.433+0000 7f5d7ed9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5d780b4b50 0x7f5d780d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.433+0000 7f5d7ed9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5d780b4b50 0x7f5d780d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41874/0 (socket says 172.21.15.16:41874) 2023-06-08T04:02:03.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.433+0000 7f5d7ed9c700 1 -- 172.21.15.16:0/1735190771 learned_addr learned my addr 172.21.15.16:0/1735190771 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:03.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.433+0000 7f5d7dd9a700 1 --2- 172.21.15.16:0/1735190771 >> v2:172.21.15.169:3300/0 conn(0x7f5d78160a60 0x7f5d780b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.434+0000 7f5d7ed9c700 1 -- 172.21.15.16:0/1735190771 >> v2:172.21.15.169:3300/0 conn(0x7f5d78160a60 msgr2=0x7f5d780b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.434+0000 7f5d7ed9c700 1 --2- 172.21.15.16:0/1735190771 >> v2:172.21.15.169:3300/0 conn(0x7f5d78160a60 0x7f5d780b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.434+0000 7f5d7ed9c700 1 -- 172.21.15.16:0/1735190771 >> v1:172.21.15.169:6789/0 conn(0x7f5d780b83f0 legacy=0x7f5d780ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.434+0000 7f5d7ed9c700 1 -- 172.21.15.16:0/1735190771 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780cd1e0 con 0x7f5d780b4b50 2023-06-08T04:02:03.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.434+0000 7f5d7ed9c700 1 --2- 172.21.15.16:0/1735190771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d780b4b50 0x7f5d780d0fc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d7806c4e0 tx=0x7f5d7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bfbb58084d981a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.434+0000 7f5d7d599700 1 -- 172.21.15.16:0/1735190771 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000e070 con 0x7f5d780b4b50 2023-06-08T04:02:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.434+0000 7f5d7d599700 1 -- 172.21.15.16:0/1735190771 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7000b910 con 0x7f5d780b4b50 2023-06-08T04:02:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.434+0000 7f5d7d599700 1 -- 172.21.15.16:0/1735190771 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000bcc0 con 0x7f5d780b4b50 2023-06-08T04:02:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.435+0000 7f5d807ff700 1 -- 172.21.15.16:0/1735190771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d780b4b50 msgr2=0x7f5d780d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.435+0000 7f5d807ff700 1 --2- 172.21.15.16:0/1735190771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d780b4b50 0x7f5d780d0fc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d7806c4e0 tx=0x7f5d7000b330 comp rx=0 tx=0).stop 2023-06-08T04:02:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.435+0000 7f5d807ff700 1 -- 172.21.15.16:0/1735190771 shutdown_connections 2023-06-08T04:02:03.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.435+0000 7f5d807ff700 1 --2- 172.21.15.16:0/1735190771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d780b4b50 0x7f5d780d0fc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.435+0000 7f5d807ff700 1 --2- 172.21.15.16:0/1735190771 >> v2:172.21.15.169:3300/0 conn(0x7f5d78160a60 0x7f5d780b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.435+0000 7f5d807ff700 1 -- 172.21.15.16:0/1735190771 >> 172.21.15.16:0/1735190771 conn(0x7f5d780cf610 msgr2=0x7f5d780cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:03.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.435+0000 7f5d807ff700 1 -- 172.21.15.16:0/1735190771 shutdown_connections 2023-06-08T04:02:03.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.435+0000 7f5d807ff700 1 -- 172.21.15.16:0/1735190771 wait complete. 2023-06-08T04:02:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.437+0000 7f5d807ff700 1 Processor -- start 2023-06-08T04:02:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.437+0000 7f5d807ff700 1 -- start start 2023-06-08T04:02:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d807ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d780b4b50 0x7f5d78152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d807ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d780b83f0 0x7f5d7815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d807ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78160a60 0x7f5d7815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d807ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780ca6c0 con 0x7f5d78160a60 2023-06-08T04:02:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d807ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780c8cc0 con 0x7f5d780b4b50 2023-06-08T04:02:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d807ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780c9d90 con 0x7f5d780b83f0 2023-06-08T04:02:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d7ed9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78160a60 0x7f5d7815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d7ed9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78160a60 0x7f5d7815cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41884/0 (socket says 172.21.15.16:41884) 2023-06-08T04:02:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d7ed9c700 1 -- 172.21.15.16:0/1794647353 learned_addr learned my addr 172.21.15.16:0/1794647353 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d7dd9a700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d780b83f0 0x7f5d7815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d7e59b700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d780b4b50 0x7f5d78152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d7ed9c700 1 -- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d780b83f0 msgr2=0x7f5d7815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d7ed9c700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d780b83f0 0x7f5d7815ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d7ed9c700 1 -- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d780b4b50 msgr2=0x7f5d78152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d7ed9c700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d780b4b50 0x7f5d78152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.438+0000 7f5d7ed9c700 1 -- 172.21.15.16:0/1794647353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d70009b30 con 0x7f5d78160a60 2023-06-08T04:02:03.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.439+0000 7f5d7ed9c700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78160a60 0x7f5d7815cf70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d7806aca0 tx=0x7f5d70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:03.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.439+0000 7f5d6effd700 1 -- 172.21.15.16:0/1794647353 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d700099b0 con 0x7f5d78160a60 2023-06-08T04:02:03.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.439+0000 7f5d6effd700 1 -- 172.21.15.16:0/1794647353 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d700092e0 con 0x7f5d78160a60 2023-06-08T04:02:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.439+0000 7f5d6effd700 1 -- 172.21.15.16:0/1794647353 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7001c640 con 0x7f5d78160a60 2023-06-08T04:02:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.439+0000 7f5d807ff700 1 -- 172.21.15.16:0/1794647353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d780ca070 con 0x7f5d78160a60 2023-06-08T04:02:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.439+0000 7f5d807ff700 1 -- 172.21.15.16:0/1794647353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7815f240 con 0x7f5d78160a60 2023-06-08T04:02:03.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.440+0000 7f5d807ff700 1 -- 172.21.15.16:0/1794647353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d780ca830 con 0x7f5d78160a60 2023-06-08T04:02:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.441+0000 7f5d6effd700 1 -- 172.21.15.16:0/1794647353 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d7001c7a0 con 0x7f5d78160a60 2023-06-08T04:02:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.442+0000 7f5d6effd700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d5c06ace0 0x7f5d5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.442+0000 7f5d6effd700 1 -- 172.21.15.16:0/1794647353 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d7008b150 con 0x7f5d78160a60 2023-06-08T04:02:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.442+0000 7f5d7e59b700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d5c06ace0 0x7f5d5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.443+0000 7f5d7e59b700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d5c06ace0 0x7f5d5c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d74000f60 tx=0x7f5d74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:03.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.446+0000 7f5d6effd700 1 -- 172.21.15.16:0/1794647353 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5d700561f0 con 0x7f5d78160a60 2023-06-08T04:02:03.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.650+0000 7f5d807ff700 1 -- 172.21.15.16:0/1794647353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d780740e0 con 0x7f5d78160a60 2023-06-08T04:02:03.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.651+0000 7f5d6effd700 1 -- 172.21.15.16:0/1794647353 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7f5d70059810 con 0x7f5d78160a60 2023-06-08T04:02:03.655 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:03.655 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.653+0000 7f5d807ff700 1 -- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d5c06ace0 msgr2=0x7f5d5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.653+0000 7f5d807ff700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d5c06ace0 0x7f5d5c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d74000f60 tx=0x7f5d74009040 comp rx=0 tx=0).stop 2023-06-08T04:02:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.653+0000 7f5d807ff700 1 -- 172.21.15.16:0/1794647353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78160a60 msgr2=0x7f5d7815cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.653+0000 7f5d807ff700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78160a60 0x7f5d7815cf70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d7806aca0 tx=0x7f5d70004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.653+0000 7f5d807ff700 1 -- 172.21.15.16:0/1794647353 shutdown_connections 2023-06-08T04:02:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.653+0000 7f5d807ff700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d5c06ace0 0x7f5d5c06d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.653+0000 7f5d807ff700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d78160a60 0x7f5d7815cf70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.653+0000 7f5d807ff700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d780b4b50 0x7f5d78152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.653+0000 7f5d807ff700 1 --2- 172.21.15.16:0/1794647353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d780b83f0 0x7f5d7815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.653+0000 7f5d807ff700 1 -- 172.21.15.16:0/1794647353 >> 172.21.15.16:0/1794647353 conn(0x7f5d780cf610 msgr2=0x7f5d780d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.653+0000 7f5d807ff700 1 -- 172.21.15.16:0/1794647353 shutdown_connections 2023-06-08T04:02:03.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.654+0000 7f5d807ff700 1 -- 172.21.15.16:0/1794647353 wait complete. 2023-06-08T04:02:03.675 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-08T04:02:03.675 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.873+0000 7f7c9d7ff700 1 Processor -- start 2023-06-08T04:02:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.873+0000 7f7c9d7ff700 1 -- start start 2023-06-08T04:02:03.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.874+0000 7f7c9d7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c980b83f0 0x7f7c98160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.874+0000 7f7c9d7ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7c980b4d20 0x7f7c980d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.874+0000 7f7c9d7ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c980d0800 con 0x7f7c980ced40 2023-06-08T04:02:03.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.874+0000 7f7c9d7ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c980cd1e0 con 0x7f7c980b4d20 2023-06-08T04:02:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.874+0000 7f7c9d7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980cd4c0 con 0x7f7c980b83f0 2023-06-08T04:02:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.874+0000 7f7c967fc700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7c980ced40 0x7f7c980b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51534/0 (socket says 172.21.15.16:51534) 2023-06-08T04:02:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.874+0000 7f7c967fc700 1 -- 172.21.15.16:0/3671544716 learned_addr learned my addr 172.21.15.16:0/3671544716 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:03.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.875+0000 7f7c977fe700 1 --2- 172.21.15.16:0/3671544716 >> v2:172.21.15.169:3300/0 conn(0x7f7c980b4d20 0x7f7c980d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.875+0000 7f7c96ffd700 1 --2- 172.21.15.16:0/3671544716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c980b83f0 0x7f7c98160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.875+0000 7f7c95ffb700 1 -- 172.21.15.16:0/3671544716 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679359549 0 0) 0x7f7c980d0800 con 0x7f7c980ced40 2023-06-08T04:02:03.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.875+0000 7f7c95ffb700 1 -- 172.21.15.16:0/3671544716 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c800035b0 con 0x7f7c980ced40 2023-06-08T04:02:03.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.875+0000 7f7c96ffd700 1 -- 172.21.15.16:0/3671544716 >> v2:172.21.15.169:3300/0 conn(0x7f7c980b4d20 msgr2=0x7f7c980d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:03.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.875+0000 7f7c96ffd700 1 --2- 172.21.15.16:0/3671544716 >> v2:172.21.15.169:3300/0 conn(0x7f7c980b4d20 0x7f7c980d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.875+0000 7f7c96ffd700 1 -- 172.21.15.16:0/3671544716 >> v1:172.21.15.16:6789/0 conn(0x7f7c980ced40 legacy=0x7f7c980b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.875+0000 7f7c96ffd700 1 -- 172.21.15.16:0/3671544716 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980d0aa0 con 0x7f7c980b83f0 2023-06-08T04:02:03.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.875+0000 7f7c96ffd700 1 --2- 172.21.15.16:0/3671544716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c980b83f0 0x7f7c98160a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009840 tx=0x7f7c88009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5136216bacc10579 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:03.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.876+0000 7f7c95ffb700 1 -- 172.21.15.16:0/3671544716 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88011830 con 0x7f7c980b83f0 2023-06-08T04:02:03.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.876+0000 7f7c95ffb700 1 -- 172.21.15.16:0/3671544716 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88011990 con 0x7f7c980b83f0 2023-06-08T04:02:03.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.876+0000 7f7c95ffb700 1 -- 172.21.15.16:0/3671544716 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88011d20 con 0x7f7c980b83f0 2023-06-08T04:02:03.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.876+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3671544716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c980b83f0 msgr2=0x7f7c98160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.876+0000 7f7c9d7ff700 1 --2- 172.21.15.16:0/3671544716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c980b83f0 0x7f7c98160a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009840 tx=0x7f7c88009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:03.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.876+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3671544716 shutdown_connections 2023-06-08T04:02:03.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.876+0000 7f7c9d7ff700 1 --2- 172.21.15.16:0/3671544716 >> v2:172.21.15.169:3300/0 conn(0x7f7c980b4d20 0x7f7c980d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.876+0000 7f7c9d7ff700 1 --2- 172.21.15.16:0/3671544716 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c980b83f0 0x7f7c98160a60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.876+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3671544716 >> 172.21.15.16:0/3671544716 conn(0x7f7c980cf610 msgr2=0x7f7c980cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.876+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3671544716 shutdown_connections 2023-06-08T04:02:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.876+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3671544716 wait complete. 2023-06-08T04:02:03.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.878+0000 7f7c9d7ff700 1 Processor -- start 2023-06-08T04:02:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.878+0000 7f7c9d7ff700 1 -- start start 2023-06-08T04:02:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.879+0000 7f7c9d7ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c980b4d20 0x7f7c98159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.879+0000 7f7c9d7ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c980b83f0 0x7f7c981e8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.879+0000 7f7c9d7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c980ced40 0x7f7c981e87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.879+0000 7f7c9d7ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9815d620 con 0x7f7c980b83f0 2023-06-08T04:02:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.879+0000 7f7c9d7ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9815a430 con 0x7f7c980b4d20 2023-06-08T04:02:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.879+0000 7f7c9d7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9815d870 con 0x7f7c980ced40 2023-06-08T04:02:03.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.879+0000 7f7c967fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c980b83f0 0x7f7c981e8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.879+0000 7f7c967fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c980b83f0 0x7f7c981e8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41894/0 (socket says 172.21.15.16:41894) 2023-06-08T04:02:03.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.879+0000 7f7c967fc700 1 -- 172.21.15.16:0/3811768926 learned_addr learned my addr 172.21.15.16:0/3811768926 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:03.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.879+0000 7f7c977fe700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c980ced40 0x7f7c981e87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.879+0000 7f7c96ffd700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c980b4d20 0x7f7c98159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.880+0000 7f7c967fc700 1 -- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c980ced40 msgr2=0x7f7c981e87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.880+0000 7f7c967fc700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c980ced40 0x7f7c981e87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.880+0000 7f7c967fc700 1 -- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c980b4d20 msgr2=0x7f7c98159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:03.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.880+0000 7f7c967fc700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c980b4d20 0x7f7c98159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:03.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.880+0000 7f7c967fc700 1 -- 172.21.15.16:0/3811768926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c880094a0 con 0x7f7c980b83f0 2023-06-08T04:02:03.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.880+0000 7f7c967fc700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c980b83f0 0x7f7c981e8280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00c4d0 tx=0x7f7c8c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:03.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.880+0000 7f7c7f7fe700 1 -- 172.21.15.16:0/3811768926 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00cea0 con 0x7f7c980b83f0 2023-06-08T04:02:03.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.880+0000 7f7c7f7fe700 1 -- 172.21.15.16:0/3811768926 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c005d70 con 0x7f7c980b83f0 2023-06-08T04:02:03.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.880+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3811768926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9815db50 con 0x7f7c980b83f0 2023-06-08T04:02:03.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.880+0000 7f7c7f7fe700 1 -- 172.21.15.16:0/3811768926 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c0072f0 con 0x7f7c980b83f0 2023-06-08T04:02:03.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.880+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3811768926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9815e110 con 0x7f7c980b83f0 2023-06-08T04:02:03.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.882+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3811768926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c980740e0 con 0x7f7c980b83f0 2023-06-08T04:02:03.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.882+0000 7f7c7f7fe700 1 -- 172.21.15.16:0/3811768926 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c8c007450 con 0x7f7c980b83f0 2023-06-08T04:02:03.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.883+0000 7f7c7f7fe700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c8406ace0 0x7f7c8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:03.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.883+0000 7f7c7f7fe700 1 -- 172.21.15.16:0/3811768926 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7c8c088950 con 0x7f7c980b83f0 2023-06-08T04:02:03.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.884+0000 7f7c96ffd700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c8406ace0 0x7f7c8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:03.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.884+0000 7f7c96ffd700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c8406ace0 0x7f7c8406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c88000c00 tx=0x7f7c88008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:03.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:03.888+0000 7f7c7f7fe700 1 -- 172.21.15.16:0/3811768926 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7c8c053960 con 0x7f7c980b83f0 2023-06-08T04:02:04.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.093+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3811768926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c980b87c0 con 0x7f7c980b83f0 2023-06-08T04:02:04.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.095+0000 7f7c7f7fe700 1 -- 172.21.15.16:0/3811768926 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7f7c8c056f80 con 0x7f7c980b83f0 2023-06-08T04:02:04.099 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:04.099 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:04.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c8406ace0 msgr2=0x7f7c8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c8406ace0 0x7f7c8406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c88000c00 tx=0x7f7c88008030 comp rx=0 tx=0).stop 2023-06-08T04:02:04.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3811768926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c980b83f0 msgr2=0x7f7c981e8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c980b83f0 0x7f7c981e8280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00c4d0 tx=0x7f7c8c00c7e0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3811768926 shutdown_connections 2023-06-08T04:02:04.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7c8406ace0 0x7f7c8406d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7c980ced40 0x7f7c981e87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c980b4d20 0x7f7c98159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 --2- 172.21.15.16:0/3811768926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c980b83f0 0x7f7c981e8280 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3811768926 >> 172.21.15.16:0/3811768926 conn(0x7f7c980cf610 msgr2=0x7f7c9806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3811768926 shutdown_connections 2023-06-08T04:02:04.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.097+0000 7f7c9d7ff700 1 -- 172.21.15.16:0/3811768926 wait complete. 2023-06-08T04:02:04.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-08T04:02:04.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-08T04:02:04.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-08T04:02:04.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-08T04:02:04.121 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-08T04:02:04.121 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-08T04:02:04.122 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-08T04:02:04.122 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-08T04:02:04.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.477+0000 7fd3da1ff700 1 Processor -- start 2023-06-08T04:02:04.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.478+0000 7fd3da1ff700 1 -- start start 2023-06-08T04:02:04.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.483+0000 7f4498bff700 1 Processor -- start 2023-06-08T04:02:04.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.483+0000 7f4498bff700 1 -- start start 2023-06-08T04:02:04.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.480+0000 7fd3da1ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd3d414f560 0x7fd3d41589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.480+0000 7fd3da1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3d4158f00 0x7fd3d40cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.480+0000 7fd3da1ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d40ccce0 con 0x7fd3d40cc880 2023-06-08T04:02:04.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.480+0000 7fd3da1ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d41593f0 con 0x7fd3d414f560 2023-06-08T04:02:04.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.480+0000 7fd3da1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d41596d0 con 0x7fd3d4158f00 2023-06-08T04:02:04.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.481+0000 7fd3d2ffd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3d4158f00 0x7fd3d40cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.481+0000 7fd3d2ffd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3d4158f00 0x7fd3d40cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:54950/0 (socket says 172.21.15.16:54950) 2023-06-08T04:02:04.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.481+0000 7fd3d2ffd700 1 -- 172.21.15.16:0/366824813 learned_addr learned my addr 172.21.15.16:0/366824813 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.482+0000 7fd3d37fe700 1 --2- 172.21.15.16:0/366824813 >> v2:172.21.15.169:3300/0 conn(0x7fd3d414f560 0x7fd3d41589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.482+0000 7fd3d2ffd700 1 -- 172.21.15.16:0/366824813 >> v2:172.21.15.169:3300/0 conn(0x7fd3d414f560 msgr2=0x7fd3d41589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.482+0000 7fd3d2ffd700 1 --2- 172.21.15.16:0/366824813 >> v2:172.21.15.169:3300/0 conn(0x7fd3d414f560 0x7fd3d41589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.482+0000 7fd3d2ffd700 1 -- 172.21.15.16:0/366824813 >> v1:172.21.15.16:6789/0 conn(0x7fd3d40cc880 legacy=0x7fd3d4070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.482+0000 7fd3d2ffd700 1 -- 172.21.15.16:0/366824813 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d406c650 con 0x7fd3d4158f00 2023-06-08T04:02:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.483+0000 7fd3d2ffd700 1 --2- 172.21.15.16:0/366824813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3d4158f00 0x7fd3d40cc340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40098f0 tx=0x7fd3c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfc494afc6ec80e5 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.484+0000 7fd3d27fc700 1 -- 172.21.15.16:0/366824813 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4004230 con 0x7fd3d4158f00 2023-06-08T04:02:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.484+0000 7fd3d27fc700 1 -- 172.21.15.16:0/366824813 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4004390 con 0x7fd3d4158f00 2023-06-08T04:02:04.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.484+0000 7fd3d27fc700 1 -- 172.21.15.16:0/366824813 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40036a0 con 0x7fd3d4158f00 2023-06-08T04:02:04.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7fd3da1ff700 1 -- 172.21.15.16:0/366824813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3d4158f00 msgr2=0x7fd3d40cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7fd3da1ff700 1 --2- 172.21.15.16:0/366824813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3d4158f00 0x7fd3d40cc340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40098f0 tx=0x7fd3c4009c00 comp rx=0 tx=0).stop 2023-06-08T04:02:04.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7fd3da1ff700 1 -- 172.21.15.16:0/366824813 shutdown_connections 2023-06-08T04:02:04.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7fd3da1ff700 1 --2- 172.21.15.16:0/366824813 >> v2:172.21.15.169:3300/0 conn(0x7fd3d414f560 0x7fd3d41589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7fd3da1ff700 1 --2- 172.21.15.16:0/366824813 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3d4158f00 0x7fd3d40cc340 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7fd3da1ff700 1 -- 172.21.15.16:0/366824813 >> 172.21.15.16:0/366824813 conn(0x7fd3d406aa30 msgr2=0x7fd3d40b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.487+0000 7fd3da1ff700 1 -- 172.21.15.16:0/366824813 shutdown_connections 2023-06-08T04:02:04.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.487+0000 7fd3da1ff700 1 -- 172.21.15.16:0/366824813 wait complete. 2023-06-08T04:02:04.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7f4498bff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f449414f560 0x7f44941589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7f4498bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4494158f00 0x7f44940cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7f4498bff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44940ccce0 con 0x7f44940cc880 2023-06-08T04:02:04.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7f4498bff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44941593f0 con 0x7f449414f560 2023-06-08T04:02:04.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7f4498bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44941596d0 con 0x7f4494158f00 2023-06-08T04:02:04.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7f4492d9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f44940cc880 0x7f4494070280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51554/0 (socket says 172.21.15.16:51554) 2023-06-08T04:02:04.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.486+0000 7f4492d9d700 1 -- 172.21.15.16:0/1080205335 learned_addr learned my addr 172.21.15.16:0/1080205335 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:04.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.487+0000 7f4491d9b700 1 --2- 172.21.15.16:0/1080205335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4494158f00 0x7f44940cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.487+0000 7f449259c700 1 --2- 172.21.15.16:0/1080205335 >> v2:172.21.15.169:3300/0 conn(0x7f449414f560 0x7f44941589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.487+0000 7f4491d9b700 1 -- 172.21.15.16:0/1080205335 >> v2:172.21.15.169:3300/0 conn(0x7f449414f560 msgr2=0x7f44941589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.487+0000 7f4491d9b700 1 --2- 172.21.15.16:0/1080205335 >> v2:172.21.15.169:3300/0 conn(0x7f449414f560 0x7f44941589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.487+0000 7f4491d9b700 1 -- 172.21.15.16:0/1080205335 >> v1:172.21.15.16:6789/0 conn(0x7f44940cc880 legacy=0x7f4494070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.488+0000 7f4491d9b700 1 -- 172.21.15.16:0/1080205335 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449406c650 con 0x7f4494158f00 2023-06-08T04:02:04.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.488+0000 7f4491d9b700 1 --2- 172.21.15.16:0/1080205335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4494158f00 0x7f44940cc340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f447c009840 tx=0x7f447c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43b7726d72966836 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.489+0000 7fd3da1ff700 1 Processor -- start 2023-06-08T04:02:04.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.489+0000 7f449159a700 1 -- 172.21.15.16:0/1080205335 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00f940 con 0x7f4494158f00 2023-06-08T04:02:04.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.489+0000 7f449159a700 1 -- 172.21.15.16:0/1080205335 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c00faa0 con 0x7f4494158f00 2023-06-08T04:02:04.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.489+0000 7f449159a700 1 -- 172.21.15.16:0/1080205335 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00fe30 con 0x7f4494158f00 2023-06-08T04:02:04.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.490+0000 7f4498bff700 1 -- 172.21.15.16:0/1080205335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4494158f00 msgr2=0x7f44940cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.490+0000 7f4498bff700 1 --2- 172.21.15.16:0/1080205335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4494158f00 0x7f44940cc340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f447c009840 tx=0x7f447c009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:04.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.490+0000 7fd3da1ff700 1 -- start start 2023-06-08T04:02:04.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.491+0000 7f4498bff700 1 -- 172.21.15.16:0/1080205335 shutdown_connections 2023-06-08T04:02:04.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.491+0000 7f4498bff700 1 --2- 172.21.15.16:0/1080205335 >> v2:172.21.15.169:3300/0 conn(0x7f449414f560 0x7f44941589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.491+0000 7f4498bff700 1 --2- 172.21.15.16:0/1080205335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4494158f00 0x7f44940cc340 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.491+0000 7f4498bff700 1 -- 172.21.15.16:0/1080205335 >> 172.21.15.16:0/1080205335 conn(0x7f449406aa30 msgr2=0x7f44940b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.491+0000 7fd3da1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3d40cc880 0x7fd3d40b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.491+0000 7fd3da1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3d414f560 0x7fd3d414bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.491+0000 7fd3da1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3d4158f00 0x7fd3d40b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.491+0000 7fd3da1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40b30c0 con 0x7fd3d4158f00 2023-06-08T04:02:04.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.491+0000 7fd3da1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40b33a0 con 0x7fd3d414f560 2023-06-08T04:02:04.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.491+0000 7fd3da1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40b3680 con 0x7fd3d40cc880 2023-06-08T04:02:04.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.491+0000 7f5aed3ff700 1 Processor -- start 2023-06-08T04:02:04.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.492+0000 7f4498bff700 1 -- 172.21.15.16:0/1080205335 shutdown_connections 2023-06-08T04:02:04.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.492+0000 7f5aed3ff700 1 -- start start 2023-06-08T04:02:04.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.492+0000 7fd3d2ffd700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3d414f560 0x7fd3d414bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.492+0000 7fd3d2ffd700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3d414f560 0x7fd3d414bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56198/0 (socket says 172.21.15.16:56198) 2023-06-08T04:02:04.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.492+0000 7fd3d2ffd700 1 -- 172.21.15.16:0/3376723465 learned_addr learned my addr 172.21.15.16:0/3376723465 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:04.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.493+0000 7fd3d37fe700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3d40cc880 0x7fd3d40b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.492+0000 7f4498bff700 1 -- 172.21.15.16:0/1080205335 wait complete. 2023-06-08T04:02:04.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.493+0000 7fd3d2ffd700 1 -- 172.21.15.16:0/3376723465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3d40cc880 msgr2=0x7fd3d40b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.493+0000 7fd3d2ffd700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3d40cc880 0x7fd3d40b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.493+0000 7fd3d2ffd700 1 -- 172.21.15.16:0/3376723465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3d4158f00 msgr2=0x7fd3d40b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.493+0000 7fd3d2ffd700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3d4158f00 0x7fd3d40b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.493+0000 7fd3d2ffd700 1 -- 172.21.15.16:0/3376723465 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4009550 con 0x7fd3d414f560 2023-06-08T04:02:04.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.494+0000 7fd3d2ffd700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3d414f560 0x7fd3d414bc50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4004000 tx=0x7fd3c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.494+0000 7fd3bbfff700 1 -- 172.21.15.16:0/3376723465 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4003de0 con 0x7fd3d414f560 2023-06-08T04:02:04.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.495+0000 7fd3bbfff700 1 -- 172.21.15.16:0/3376723465 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4020860 con 0x7fd3d414f560 2023-06-08T04:02:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.495+0000 7fd3bbfff700 1 -- 172.21.15.16:0/3376723465 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4020bd0 con 0x7fd3d414f560 2023-06-08T04:02:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.494+0000 7f5aed3ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ae815c550 0x7f5ae80cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.494+0000 7f5aed3ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae80ab8d0 con 0x7f5ae80cb860 2023-06-08T04:02:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.494+0000 7f5aed3ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae806c000 con 0x7f5ae815c180 2023-06-08T04:02:04.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.494+0000 7f5aed3ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae80cca00 con 0x7f5ae815c550 2023-06-08T04:02:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.495+0000 7fd3da1ff700 1 -- 172.21.15.16:0/3376723465 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d40b3960 con 0x7fd3d414f560 2023-06-08T04:02:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.495+0000 7fd3da1ff700 1 -- 172.21.15.16:0/3376723465 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d40b43c0 con 0x7fd3d414f560 2023-06-08T04:02:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.495+0000 7f4498bff700 1 Processor -- start 2023-06-08T04:02:04.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.495+0000 7f4498bff700 1 -- start start 2023-06-08T04:02:04.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.495+0000 7f5ae6ffd700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f5ae815c180 0x7f5ae80cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:43070/0 (socket says 172.21.15.16:43070) 2023-06-08T04:02:04.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.495+0000 7f5ae6ffd700 1 -- 172.21.15.16:0/1932095558 learned_addr learned my addr 172.21.15.16:0/1932095558 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:04.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.497+0000 7fd3da1ff700 1 -- 172.21.15.16:0/3376723465 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3d40b3230 con 0x7fd3d414f560 2023-06-08T04:02:04.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.497+0000 7f4498bff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44940cc880 0x7f44940cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.497+0000 7f4498bff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f449414f560 0x7f449414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.497+0000 7f4498bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4494158f00 0x7f449414fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.497+0000 7f4498bff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494152780 con 0x7f449414f560 2023-06-08T04:02:04.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.497+0000 7f4498bff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940b1700 con 0x7f44940cc880 2023-06-08T04:02:04.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.497+0000 7f4498bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44940b19e0 con 0x7f4494158f00 2023-06-08T04:02:04.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.498+0000 7f4492d9d700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4494158f00 0x7f449414fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.498+0000 7f4492d9d700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4494158f00 0x7f449414fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:54970/0 (socket says 172.21.15.16:54970) 2023-06-08T04:02:04.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.498+0000 7f4492d9d700 1 -- 172.21.15.16:0/3507733263 learned_addr learned my addr 172.21.15.16:0/3507733263 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:04.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.498+0000 7f4491d9b700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f449414f560 0x7f449414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.499+0000 7f4491d9b700 1 -- 172.21.15.16:0/3507733263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4494158f00 msgr2=0x7f449414fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.499+0000 7f4491d9b700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4494158f00 0x7f449414fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.499+0000 7f4491d9b700 1 -- 172.21.15.16:0/3507733263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44940cc880 msgr2=0x7f44940cee80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T04:02:04.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.499+0000 7f4491d9b700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44940cc880 0x7f44940cee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.499+0000 7f4491d9b700 1 -- 172.21.15.16:0/3507733263 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0094a0 con 0x7f449414f560 2023-06-08T04:02:04.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.498+0000 7fda011ff700 1 Processor -- start 2023-06-08T04:02:04.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.498+0000 7fda011ff700 1 -- start start 2023-06-08T04:02:04.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.499+0000 7fd3bbfff700 1 -- 172.21.15.16:0/3376723465 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd3c4026070 con 0x7fd3d414f560 2023-06-08T04:02:04.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f4491d9b700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f449414f560 0x7f449414f930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f447c018000 tx=0x7f447c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.497+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157991240 0 0) 0x7f5ae806c000 con 0x7f5ae815c180 2023-06-08T04:02:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.497+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ad00035b0 con 0x7f5ae815c180 2023-06-08T04:02:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.497+0000 7f5ae77fe700 1 --2- 172.21.15.16:0/1932095558 >> v2:172.21.15.16:3300/0 conn(0x7f5ae815c550 0x7f5ae80cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.498+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147085399 0 0) 0x7f5ae80ab8d0 con 0x7f5ae80cb860 2023-06-08T04:02:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.498+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae806c000 con 0x7f5ae80cb860 2023-06-08T04:02:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f448affd700 1 -- 172.21.15.16:0/3507733263 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0038a0 con 0x7f449414f560 2023-06-08T04:02:04.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f448affd700 1 -- 172.21.15.16:0/3507733263 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c003a40 con 0x7f449414f560 2023-06-08T04:02:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f448affd700 1 -- 172.21.15.16:0/3507733263 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c003df0 con 0x7f449414f560 2023-06-08T04:02:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7fda011ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd9fc0b0a70 0x7fd9fc0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7fda011ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd9fc14f560 0x7fd9fc0cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7fda011ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc1593f0 con 0x7fd9fc070280 2023-06-08T04:02:04.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7fda011ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc1596d0 con 0x7fd9fc14f560 2023-06-08T04:02:04.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7fda011ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc06c650 con 0x7fd9fc0b0a70 2023-06-08T04:02:04.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779506419 0 0) 0x7f5ad00035b0 con 0x7f5ae815c180 2023-06-08T04:02:04.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 >> v2:172.21.15.16:3300/0 conn(0x7f5ae815c550 msgr2=0x7f5ae80cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 --2- 172.21.15.16:0/1932095558 >> v2:172.21.15.16:3300/0 conn(0x7f5ae815c550 0x7f5ae80cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 >> v1:172.21.15.16:6789/0 conn(0x7f5ae80cb860 legacy=0x7f5ae806cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae806c2c0 con 0x7f5ae815c180 2023-06-08T04:02:04.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7f5ad8001670 con 0x7f5ae815c180 2023-06-08T04:02:04.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 >> v1:172.21.15.169:6789/0 conn(0x7f5ae815c180 legacy=0x7f5ae80cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 --2- 172.21.15.16:0/1932095558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad0003b90 0x7f5ad0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 --2- 172.21.15.16:0/1932095558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad0004850 0x7f5ad0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 --2- 172.21.15.16:0/1932095558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ad0005270 0x7f5ad0014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80cca00 con 0x7f5ad0004850 2023-06-08T04:02:04.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00149c0 con 0x7f5ad0003b90 2023-06-08T04:02:04.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0014b80 con 0x7f5ad0005270 2023-06-08T04:02:04.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.501+0000 7fd3bbfff700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd3c006adb0 0x7fd3c006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.501+0000 7fd3bbfff700 1 -- 172.21.15.16:0/3376723465 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd3c408f4b0 con 0x7fd3d414f560 2023-06-08T04:02:04.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.501+0000 7fd3bbfff700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.16:6800/704029040,v1:172.21.15.16:6801/704029040] conn(0x7fd3c0073660 0x7fd3c0075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.501+0000 7fd3bbfff700 1 -- 172.21.15.16:0/3376723465 --> [v2:172.21.15.16:6800/704029040,v1:172.21.15.16:6801/704029040] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3c0076120 con 0x7fd3c0073660 2023-06-08T04:02:04.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.501+0000 7fd3bbfff700 1 -- 172.21.15.16:0/3376723465 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3c4091ad0 con 0x7fd3d414f560 2023-06-08T04:02:04.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.500+0000 7f4498bff700 1 -- 172.21.15.16:0/3507733263 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44940b1cc0 con 0x7f449414f560 2023-06-08T04:02:04.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.501+0000 7f4498bff700 1 -- 172.21.15.16:0/3507733263 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940b2280 con 0x7f449414f560 2023-06-08T04:02:04.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd3d37fe700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd3c006adb0 0x7fd3c006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7fd3d3fff700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.16:6800/704029040,v1:172.21.15.16:6801/704029040] conn(0x7fd3c0073660 0x7fd3c0075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.504+0000 7fd3d37fe700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd3c006adb0 0x7fd3c006d260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc003c10 tx=0x7fd3cc0098d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.501+0000 7fd9fb59e700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd9fc070280 0x7fd9fc070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:43086/0 (socket says 172.21.15.16:43086) 2023-06-08T04:02:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.501+0000 7fd9fb59e700 1 -- 172.21.15.16:0/3570414136 learned_addr learned my addr 172.21.15.16:0/3570414136 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.501+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725746134 0 0) 0x7fd9fc1593f0 con 0x7fd9fc070280 2023-06-08T04:02:04.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9e4003590 con 0x7fd9fc070280 2023-06-08T04:02:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 582538634 0 0) 0x7fd9e4003590 con 0x7fd9fc070280 2023-06-08T04:02:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 >> v2:172.21.15.169:3300/0 conn(0x7fd9fc0b0a70 msgr2=0x7fd9fc0cc340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-08T04:02:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 --2- 172.21.15.16:0/3570414136 >> v2:172.21.15.169:3300/0 conn(0x7fd9fc0b0a70 0x7fd9fc0cc340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 >> v2:172.21.15.16:3300/0 conn(0x7fd9fc14f560 msgr2=0x7fd9fc0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 --2- 172.21.15.16:0/3570414136 >> v2:172.21.15.16:3300/0 conn(0x7fd9fc14f560 0x7fd9fc0cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc06c930 con 0x7fd9fc070280 2023-06-08T04:02:04.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7fd9f40019f0 con 0x7fd9fc070280 2023-06-08T04:02:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 >> v1:172.21.15.169:6789/0 conn(0x7fd9fc070280 legacy=0x7fd9fc070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 --2- 172.21.15.16:0/3570414136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e4003bb0 0x7fd9e4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 --2- 172.21.15.16:0/3570414136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e4006890 0x7fd9e4008d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 --2- 172.21.15.16:0/3570414136 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e40095b0 0x7fd9e4009a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1596d0 con 0x7fd9e4006890 2023-06-08T04:02:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc06c650 con 0x7fd9e4003bb0 2023-06-08T04:02:04.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e400a3b0 con 0x7fd9e40095b0 2023-06-08T04:02:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7fd9fb59e700 1 --2- 172.21.15.16:0/3570414136 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e40095b0 0x7fd9e4009a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7fd9fb59e700 1 -- 172.21.15.16:0/3570414136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e4003bb0 msgr2=0x7fd9e4003fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T04:02:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7fd9fb59e700 1 --2- 172.21.15.16:0/3570414136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e4003bb0 0x7fd9e4003fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7fd9fb59e700 1 -- 172.21.15.16:0/3570414136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e4006890 msgr2=0x7fd9e4008d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7fd9fb59e700 1 --2- 172.21.15.16:0/3570414136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9e4006890 0x7fd9e4008d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7fd9fb59e700 1 -- 172.21.15.16:0/3570414136 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc06c930 con 0x7fd9e40095b0 2023-06-08T04:02:04.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.504+0000 7fd9fb59e700 1 -- 172.21.15.16:0/3570414136 reap_dead start 2023-06-08T04:02:04.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.504+0000 7fd9fb59e700 1 --2- 172.21.15.16:0/3570414136 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e40095b0 0x7fd9e4009a50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400a8c0 tx=0x7fd9e4003840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=771ae831b29a76df server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.501+0000 7f5ae77fe700 1 --2- 172.21.15.16:0/1932095558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ad0005270 0x7f5ad0014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.502+0000 7f5ae6ffd700 1 --2- 172.21.15.16:0/1932095558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad0003b90 0x7f5ad0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7f5ae77fe700 1 -- 172.21.15.16:0/1932095558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad0003b90 msgr2=0x7f5ad0003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7f5ae77fe700 1 --2- 172.21.15.16:0/1932095558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ad0003b90 0x7f5ad0003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7f5ae77fe700 1 -- 172.21.15.16:0/1932095558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad0004850 msgr2=0x7f5ad0004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T04:02:04.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7f5ae77fe700 1 --2- 172.21.15.16:0/1932095558 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ad0004850 0x7f5ad0004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7f5ae77fe700 1 -- 172.21.15.16:0/1932095558 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae806c2c0 con 0x7f5ad0005270 2023-06-08T04:02:04.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.503+0000 7f5ae77fe700 1 -- 172.21.15.16:0/1932095558 reap_dead start 2023-06-08T04:02:04.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.504+0000 7f5ae77fe700 1 --2- 172.21.15.16:0/1932095558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ad0005270 0x7f5ad0014220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0007330 tx=0x7f5ad0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deeb256bc4228a5e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.504+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0007e50 con 0x7f5ad0005270 2023-06-08T04:02:04.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.504+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae0003a20 con 0x7f5ad0005270 2023-06-08T04:02:04.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.504+0000 7f5ae5ffb700 1 -- 172.21.15.16:0/1932095558 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0003db0 con 0x7f5ad0005270 2023-06-08T04:02:04.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.504+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4012600 con 0x7fd9e40095b0 2023-06-08T04:02:04.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.504+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f40127a0 con 0x7fd9e40095b0 2023-06-08T04:02:04.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.504+0000 7fd9f9d9b700 1 -- 172.21.15.16:0/3570414136 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4012b50 con 0x7fd9e40095b0 2023-06-08T04:02:04.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.504+0000 7fd3d3fff700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.16:6800/704029040,v1:172.21.15.16:6801/704029040] conn(0x7fd3c0073660 0x7fd3c0075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.505+0000 7fda011ff700 1 -- 172.21.15.16:0/3570414136 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e40095b0 msgr2=0x7fd9e4009a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.505+0000 7fda011ff700 1 --2- 172.21.15.16:0/3570414136 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e40095b0 0x7fd9e4009a50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400a8c0 tx=0x7fd9e4003840 comp rx=0 tx=0).stop 2023-06-08T04:02:04.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.506+0000 7fda011ff700 1 -- 172.21.15.16:0/3570414136 shutdown_connections 2023-06-08T04:02:04.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.506+0000 7fda011ff700 1 --2- 172.21.15.16:0/3570414136 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e40095b0 0x7fd9e4009a50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.506+0000 7fda011ff700 1 -- 172.21.15.16:0/3570414136 >> 172.21.15.16:0/3570414136 conn(0x7fd9fc06aa30 msgr2=0x7fd9fc0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.505+0000 7f5aed3ff700 1 -- 172.21.15.16:0/1932095558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ad0005270 msgr2=0x7f5ad0014220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.505+0000 7f5aed3ff700 1 --2- 172.21.15.16:0/1932095558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ad0005270 0x7f5ad0014220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0007330 tx=0x7f5ad0005880 comp rx=0 tx=0).stop 2023-06-08T04:02:04.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.505+0000 7f5aed3ff700 1 -- 172.21.15.16:0/1932095558 shutdown_connections 2023-06-08T04:02:04.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.505+0000 7f5aed3ff700 1 --2- 172.21.15.16:0/1932095558 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ad0005270 0x7f5ad0014220 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.505+0000 7f5aed3ff700 1 -- 172.21.15.16:0/1932095558 >> 172.21.15.16:0/1932095558 conn(0x7f5ae806aa30 msgr2=0x7f5ae80b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.506+0000 7fd3bbfff700 1 -- 172.21.15.16:0/3376723465 <== osd.0 v2:172.21.15.16:6800/704029040 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd3c0076120 con 0x7fd3c0073660 2023-06-08T04:02:04.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.506+0000 7f4498bff700 1 -- 172.21.15.16:0/3507733263 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4478000fb0 con 0x7f449414f560 2023-06-08T04:02:04.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.506+0000 7fda011ff700 1 -- 172.21.15.16:0/3570414136 shutdown_connections 2023-06-08T04:02:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.506+0000 7f5aed3ff700 1 -- 172.21.15.16:0/1932095558 shutdown_connections 2023-06-08T04:02:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.507+0000 7f448affd700 1 -- 172.21.15.16:0/3507733263 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f447c020440 con 0x7f449414f560 2023-06-08T04:02:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.509+0000 7f448affd700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f447406adb0 0x7f447406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.509+0000 7f448affd700 1 -- 172.21.15.16:0/3507733263 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f447c013070 con 0x7f449414f560 2023-06-08T04:02:04.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.509+0000 7f448affd700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.16:6808/4017547986,v1:172.21.15.16:6809/4017547986] conn(0x7f44740735e0 0x7f44740759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.509+0000 7f448affd700 1 -- 172.21.15.16:0/3507733263 --> [v2:172.21.15.16:6808/4017547986,v1:172.21.15.16:6809/4017547986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44740760a0 con 0x7f44740735e0 2023-06-08T04:02:04.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.506+0000 7fda011ff700 1 -- 172.21.15.16:0/3570414136 wait complete. 2023-06-08T04:02:04.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.509+0000 7fda011ff700 1 Processor -- start 2023-06-08T04:02:04.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.507+0000 7f5aed3ff700 1 -- 172.21.15.16:0/1932095558 wait complete. 2023-06-08T04:02:04.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.509+0000 7f5aed3ff700 1 Processor -- start 2023-06-08T04:02:04.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.510+0000 7f448affd700 1 -- 172.21.15.16:0/3507733263 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f447c0566a0 con 0x7f449414f560 2023-06-08T04:02:04.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.510+0000 7f5aed3ff700 1 -- start start 2023-06-08T04:02:04.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7ff8debff700 1 Processor -- start 2023-06-08T04:02:04.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7f5aed3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ad0005270 0x7f5ae8154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7f5aed3ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ae8153bf0 0x7f5ae80b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7f5aed3ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae80b3eb0 0x7f5ae815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7f5aed3ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae8154950 con 0x7f5ae8153bf0 2023-06-08T04:02:04.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7f5aed3ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80b46f0 con 0x7f5ae80b3eb0 2023-06-08T04:02:04.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7f5aed3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80b4410 con 0x7f5ad0005270 2023-06-08T04:02:04.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7ff8debff700 1 -- start start 2023-06-08T04:02:04.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.510+0000 7fda011ff700 1 -- start start 2023-06-08T04:02:04.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7fda011ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e40095b0 0x7fd9fc144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7fda011ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9fc150c20 0x7fd9fc151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7fda011ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9fc1418d0 0x7fd9fc141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7fda011ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1525d0 con 0x7fd9fc1418d0 2023-06-08T04:02:04.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7fda011ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1449b0 con 0x7fd9fc150c20 2023-06-08T04:02:04.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.511+0000 7fda011ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1529f0 con 0x7fd9e40095b0 2023-06-08T04:02:04.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.512+0000 7f5ae6ffd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ad0005270 0x7f5ae8154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.512+0000 7f5ae6ffd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ad0005270 0x7f5ae8154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:55004/0 (socket says 172.21.15.16:55004) 2023-06-08T04:02:04.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.512+0000 7f5ae6ffd700 1 -- 172.21.15.16:0/844481291 learned_addr learned my addr 172.21.15.16:0/844481291 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:04.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.512+0000 7f5ae67fc700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ae8153bf0 0x7f5ae80b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.512+0000 7f4492d9d700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.16:6808/4017547986,v1:172.21.15.16:6809/4017547986] conn(0x7f44740735e0 0x7f44740759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.512+0000 7fd9fb59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9fc1418d0 0x7fd9fc141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.512+0000 7fd9fb59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9fc1418d0 0x7fd9fc141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41962/0 (socket says 172.21.15.16:41962) 2023-06-08T04:02:04.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.512+0000 7fd9fb59e700 1 -- 172.21.15.16:0/2342411910 learned_addr learned my addr 172.21.15.16:0/2342411910 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:04.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.512+0000 7f18e77ff700 1 Processor -- start 2023-06-08T04:02:04.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7f449259c700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f447406adb0 0x7f447406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7f4492d9d700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.16:6808/4017547986,v1:172.21.15.16:6809/4017547986] conn(0x7f44740735e0 0x7f44740759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7f5ae67fc700 1 -- 172.21.15.16:0/844481291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ad0005270 msgr2=0x7f5ae8154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7f5ae67fc700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ad0005270 0x7f5ae8154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7f5ae67fc700 1 -- 172.21.15.16:0/844481291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae80b3eb0 msgr2=0x7f5ae815ea90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T04:02:04.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7f5ae67fc700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae80b3eb0 0x7f5ae815ea90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7f5ae67fc700 1 -- 172.21.15.16:0/844481291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae815ca80 con 0x7f5ae8153bf0 2023-06-08T04:02:04.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7f18e77ff700 1 -- start start 2023-06-08T04:02:04.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7fd9fb59e700 1 -- 172.21.15.16:0/2342411910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e40095b0 msgr2=0x7fd9fc144470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T04:02:04.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7fd9fb59e700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd9e40095b0 0x7fd9fc144470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7fd9fb59e700 1 -- 172.21.15.16:0/2342411910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9fc150c20 msgr2=0x7fd9fc151090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T04:02:04.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7fd9fb59e700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9fc150c20 0x7fd9fc151090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.513+0000 7fd9fb59e700 1 -- 172.21.15.16:0/2342411910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc151950 con 0x7fd9fc1418d0 2023-06-08T04:02:04.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7f5ae67fc700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ae8153bf0 0x7f5ae80b3970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80cbc30 tx=0x7f5adc00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7fd9fb59e700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9fc1418d0 0x7fd9fc141d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc06fb60 tx=0x7fd9f4001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7f449259c700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f447406adb0 0x7f447406d260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f449414c040 tx=0x7f448c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7f448affd700 1 -- 172.21.15.16:0/3507733263 <== osd.1 v2:172.21.15.16:6808/4017547986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f44740760a0 con 0x7f44740735e0 2023-06-08T04:02:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7fd9e37fe700 1 -- 172.21.15.16:0/2342411910 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f401e630 con 0x7fd9fc1418d0 2023-06-08T04:02:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7fd9e37fe700 1 -- 172.21.15.16:0/2342411910 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f401e790 con 0x7fd9fc1418d0 2023-06-08T04:02:04.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7fd9e37fe700 1 -- 172.21.15.16:0/2342411910 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f401eb20 con 0x7fd9fc1418d0 2023-06-08T04:02:04.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7f5acf7fe700 1 -- 172.21.15.16:0/844481291 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0052d0 con 0x7f5ae8153bf0 2023-06-08T04:02:04.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7f5acf7fe700 1 -- 172.21.15.16:0/844481291 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc005450 con 0x7f5ae8153bf0 2023-06-08T04:02:04.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7f5acf7fe700 1 -- 172.21.15.16:0/844481291 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0038c0 con 0x7f5ae8153bf0 2023-06-08T04:02:04.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.515+0000 7f5aed3ff700 1 -- 172.21.15.16:0/844481291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae815cd60 con 0x7f5ae8153bf0 2023-06-08T04:02:04.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.515+0000 7f5aed3ff700 1 -- 172.21.15.16:0/844481291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae8154060 con 0x7f5ae8153bf0 2023-06-08T04:02:04.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.515+0000 7f18e77ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f18e00b0a70 0x7f18e01589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.515+0000 7f18e77ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f18e0158f00 0x7f18e00cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.515+0000 7f18e77ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e015f320 con 0x7f18e014f560 2023-06-08T04:02:04.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.515+0000 7f18e77ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e01593f0 con 0x7f18e0158f00 2023-06-08T04:02:04.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.515+0000 7f18e77ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e01596d0 con 0x7f18e00b0a70 2023-06-08T04:02:04.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7ff8debff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8d80b0a70 0x7ff8d80cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7ff8debff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d80710a0 con 0x7ff8d814f560 2023-06-08T04:02:04.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7ff8debff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d81593f0 con 0x7ff8d80cc880 2023-06-08T04:02:04.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.514+0000 7ff8debff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d80ccd00 con 0x7ff8d80b0a70 2023-06-08T04:02:04.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.515+0000 7ff8d7fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff8d814f560 0x7ff8d8070280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51564/0 (socket says 172.21.15.16:51564) 2023-06-08T04:02:04.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.515+0000 7ff8d7fff700 1 -- 172.21.15.16:0/1575501797 learned_addr learned my addr 172.21.15.16:0/1575501797 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:04.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.515+0000 7ff8dc99b700 1 --2- 172.21.15.16:0/1575501797 >> v2:172.21.15.16:3300/0 conn(0x7ff8d80b0a70 0x7ff8d80cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.516+0000 7fda011ff700 1 -- 172.21.15.16:0/2342411910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc151c30 con 0x7fd9fc1418d0 2023-06-08T04:02:04.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.516+0000 7fda011ff700 1 -- 172.21.15.16:0/2342411910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc1521f0 con 0x7fd9fc1418d0 2023-06-08T04:02:04.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.516+0000 7ff8dc99b700 1 -- 172.21.15.16:0/1575501797 >> v1:172.21.15.169:6789/0 conn(0x7ff8d80cc880 legacy=0x7ff8d8070990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T04:02:04.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.516+0000 7ff8dc99b700 1 -- 172.21.15.16:0/1575501797 >> v1:172.21.15.16:6789/0 conn(0x7ff8d814f560 legacy=0x7ff8d8070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.516+0000 7ff8dc99b700 1 -- 172.21.15.16:0/1575501797 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d81596d0 con 0x7ff8d80b0a70 2023-06-08T04:02:04.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.517+0000 7fda011ff700 1 -- 172.21.15.16:0/2342411910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9fc1599b0 con 0x7fd9fc1418d0 2023-06-08T04:02:04.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.518+0000 7f5aed3ff700 1 -- 172.21.15.16:0/844481291 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ae806c880 con 0x7f5ae8153bf0 2023-06-08T04:02:04.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.518+0000 7f18e4d9a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f18e0158f00 0x7f18e00cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.518+0000 7f18e4d9a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f18e0158f00 0x7f18e00cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41992/0 (socket says 172.21.15.16:41992) 2023-06-08T04:02:04.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.518+0000 7f18e4d9a700 1 -- 172.21.15.16:0/2453146955 learned_addr learned my addr 172.21.15.16:0/2453146955 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:04.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.517+0000 7ff8dc99b700 1 --2- 172.21.15.16:0/1575501797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8d80b0a70 0x7ff8d80cc340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009840 tx=0x7ff8cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c326e446d011688b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.519+0000 7f18e559b700 1 --2- 172.21.15.16:0/2453146955 >> v2:172.21.15.169:3300/0 conn(0x7f18e00b0a70 0x7f18e01589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.519+0000 7ff8d77fe700 1 -- 172.21.15.16:0/1575501797 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc004230 con 0x7ff8d80b0a70 2023-06-08T04:02:04.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.519+0000 7ff8d77fe700 1 -- 172.21.15.16:0/1575501797 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc004390 con 0x7ff8d80b0a70 2023-06-08T04:02:04.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.519+0000 7ff8d77fe700 1 -- 172.21.15.16:0/1575501797 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc0036a0 con 0x7ff8d80b0a70 2023-06-08T04:02:04.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.520+0000 7ff8debff700 1 -- 172.21.15.16:0/1575501797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8d80b0a70 msgr2=0x7ff8d80cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.520+0000 7ff8debff700 1 --2- 172.21.15.16:0/1575501797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8d80b0a70 0x7ff8d80cc340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009840 tx=0x7ff8cc009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.520+0000 7f18e4d9a700 1 -- 172.21.15.16:0/2453146955 >> v2:172.21.15.169:3300/0 conn(0x7f18e00b0a70 msgr2=0x7f18e01589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.520+0000 7f18e4d9a700 1 --2- 172.21.15.16:0/2453146955 >> v2:172.21.15.169:3300/0 conn(0x7f18e00b0a70 0x7f18e01589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.520+0000 7f18e4d9a700 1 -- 172.21.15.16:0/2453146955 >> v1:172.21.15.16:6789/0 conn(0x7f18e014f560 legacy=0x7f18e0070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.520+0000 7f18e4d9a700 1 -- 172.21.15.16:0/2453146955 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e006c650 con 0x7f18e0158f00 2023-06-08T04:02:04.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.521+0000 7f18e4d9a700 1 --2- 172.21.15.16:0/2453146955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e0158f00 0x7f18e00cc340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f18e00714d0 tx=0x7f18dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f4ba1a13fd08d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.521+0000 7ff8debff700 1 -- 172.21.15.16:0/1575501797 shutdown_connections 2023-06-08T04:02:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.521+0000 7ff8debff700 1 --2- 172.21.15.16:0/1575501797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8d80b0a70 0x7ff8d80cc340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.521+0000 7ff8debff700 1 -- 172.21.15.16:0/1575501797 >> 172.21.15.16:0/1575501797 conn(0x7ff8d806aa30 msgr2=0x7ff8d80b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.521+0000 7fd9e37fe700 1 -- 172.21.15.16:0/2342411910 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd9f401ec80 con 0x7fd9fc1418d0 2023-06-08T04:02:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.523+0000 7fd9e37fe700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd9e806adb0 0x7fd9e806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.523+0000 7fd9e37fe700 1 -- 172.21.15.16:0/2342411910 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9f408b9f0 con 0x7fd9fc1418d0 2023-06-08T04:02:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.523+0000 7fd9e37fe700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.16:6821/251692641,v1:172.21.15.16:6823/251692641] conn(0x7fd9e8073660 0x7fd9e8075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.523+0000 7fd9e37fe700 1 -- 172.21.15.16:0/2342411910 --> [v2:172.21.15.16:6821/251692641,v1:172.21.15.16:6823/251692641] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9e8076120 con 0x7fd9e8073660 2023-06-08T04:02:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.523+0000 7fd9e37fe700 1 -- 172.21.15.16:0/2342411910 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9f408bda0 con 0x7fd9fc1418d0 2023-06-08T04:02:04.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.521+0000 7f5acf7fe700 1 -- 172.21.15.16:0/844481291 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5adc003a20 con 0x7f5ae8153bf0 2023-06-08T04:02:04.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.523+0000 7f5acf7fe700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5ad406adb0 0x7f5ad406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.523+0000 7f5acf7fe700 1 -- 172.21.15.16:0/844481291 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5adc088b80 con 0x7f5ae8153bf0 2023-06-08T04:02:04.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.523+0000 7f5acf7fe700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.16:6816/1847064506,v1:172.21.15.16:6817/1847064506] conn(0x7f5ad4073660 0x7f5ad4075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.523+0000 7f5acf7fe700 1 -- 172.21.15.16:0/844481291 --> [v2:172.21.15.16:6816/1847064506,v1:172.21.15.16:6817/1847064506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ad4076120 con 0x7f5ad4073660 2023-06-08T04:02:04.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.523+0000 7f5acf7fe700 1 -- 172.21.15.16:0/844481291 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5adc088f30 con 0x7f5ae8153bf0 2023-06-08T04:02:04.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.521+0000 7f18d7fff700 1 -- 172.21.15.16:0/2453146955 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc011830 con 0x7f18e0158f00 2023-06-08T04:02:04.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.521+0000 7f18d7fff700 1 -- 172.21.15.16:0/2453146955 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc011990 con 0x7f18e0158f00 2023-06-08T04:02:04.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.521+0000 7f18d7fff700 1 -- 172.21.15.16:0/2453146955 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc011d20 con 0x7f18e0158f00 2023-06-08T04:02:04.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.522+0000 7f18e77ff700 1 -- 172.21.15.16:0/2453146955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e0158f00 msgr2=0x7f18e00cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.522+0000 7f18e77ff700 1 --2- 172.21.15.16:0/2453146955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e0158f00 0x7f18e00cc340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f18e00714d0 tx=0x7f18dc009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.521+0000 7ff8debff700 1 -- 172.21.15.16:0/1575501797 shutdown_connections 2023-06-08T04:02:04.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.522+0000 7f6d31fff700 1 Processor -- start 2023-06-08T04:02:04.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.522+0000 7f6d31fff700 1 -- start start 2023-06-08T04:02:04.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.521+0000 7ff8debff700 1 -- 172.21.15.16:0/1575501797 wait complete. 2023-06-08T04:02:04.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.524+0000 7f5ae77fe700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.16:6816/1847064506,v1:172.21.15.16:6817/1847064506] conn(0x7f5ad4073660 0x7f5ad4075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.524+0000 7f5ae6ffd700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5ad406adb0 0x7f5ad406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.524+0000 7ff8debff700 1 Processor -- start 2023-06-08T04:02:04.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.525+0000 7ff8debff700 1 -- start start 2023-06-08T04:02:04.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7f5ae77fe700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.16:6816/1847064506,v1:172.21.15.16:6817/1847064506] conn(0x7f5ad4073660 0x7f5ad4075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7f5ae6ffd700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5ad406adb0 0x7f5ad406d260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8000ff0 tx=0x7f5ad8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.525+0000 7f6d31fff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6d2c1606b0 0x7f6d2c070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.525+0000 7f6d31fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6d2c0ce020 0x7f6d2c0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.525+0000 7f6d31fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2c0ccbe0 con 0x7f6d2c0b0e40 2023-06-08T04:02:04.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.525+0000 7f6d31fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2c0cbef0 con 0x7f6d2c0ce020 2023-06-08T04:02:04.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7f6d31fff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2c0c8dc0 con 0x7f6d2c1606b0 2023-06-08T04:02:04.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.524+0000 7fd9fa59c700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.16:6821/251692641,v1:172.21.15.16:6823/251692641] conn(0x7fd9e8073660 0x7fd9e8075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.524+0000 7fd9fad9d700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd9e806adb0 0x7fd9e806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.525+0000 7fd9fa59c700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.16:6821/251692641,v1:172.21.15.16:6823/251692641] conn(0x7fd9e8073660 0x7fd9e8075a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7fd9fad9d700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd9e806adb0 0x7fd9e806d260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0adc50 tx=0x7fd9f0006c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7ff8debff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8d80b0a70 0x7ff8d8158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7ff8debff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8d80cc880 0x7ff8d8155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7ff8debff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8d814f560 0x7ff8d8157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7ff8debff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8152a90 con 0x7ff8d80cc880 2023-06-08T04:02:04.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7ff8debff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d81524d0 con 0x7ff8d80b0a70 2023-06-08T04:02:04.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7ff8debff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d81527b0 con 0x7ff8d814f560 2023-06-08T04:02:04.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7ff8dc99b700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8d80b0a70 0x7ff8d8158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7ff8dc99b700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8d80b0a70 0x7ff8d8158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56266/0 (socket says 172.21.15.16:56266) 2023-06-08T04:02:04.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.526+0000 7ff8dc99b700 1 -- 172.21.15.16:0/2974233956 learned_addr learned my addr 172.21.15.16:0/2974233956 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:04.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7fd9e37fe700 1 -- 172.21.15.16:0/2342411910 <== osd.2 v2:172.21.15.16:6821/251692641 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd9e8076120 con 0x7fd9e8073660 2023-06-08T04:02:04.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7ff8dd19c700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8d814f560 0x7ff8d8157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7ff8d7fff700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8d80cc880 0x7ff8d8155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7f18e77ff700 1 -- 172.21.15.16:0/2453146955 shutdown_connections 2023-06-08T04:02:04.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7f18e77ff700 1 --2- 172.21.15.16:0/2453146955 >> v2:172.21.15.169:3300/0 conn(0x7f18e00b0a70 0x7f18e01589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7f18e77ff700 1 --2- 172.21.15.16:0/2453146955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e0158f00 0x7f18e00cc340 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7f18e77ff700 1 -- 172.21.15.16:0/2453146955 >> 172.21.15.16:0/2453146955 conn(0x7f18e006aa30 msgr2=0x7f18e00b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7f5acf7fe700 1 -- 172.21.15.16:0/844481291 <== osd.3 v2:172.21.15.16:6816/1847064506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5ad4076120 con 0x7f5ad4073660 2023-06-08T04:02:04.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7ff8d7fff700 1 -- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8d814f560 msgr2=0x7ff8d8157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7ff8d7fff700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff8d814f560 0x7ff8d8157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7ff8d7fff700 1 -- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8d80b0a70 msgr2=0x7ff8d8158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7ff8d7fff700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8d80b0a70 0x7ff8d8158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.527+0000 7ff8d7fff700 1 -- 172.21.15.16:0/2974233956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0094a0 con 0x7ff8d80cc880 2023-06-08T04:02:04.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.528+0000 7ff8d7fff700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8d80cc880 0x7ff8d8155660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800b410 tx=0x7ff8c800b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.528+0000 7f6d2b7fe700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6d2c1606b0 0x7f6d2c070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.528+0000 7f6d2bfff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6d2c0b0e40 0x7f6d2c164220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51570/0 (socket says 172.21.15.16:51570) 2023-06-08T04:02:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.528+0000 7f6d2bfff700 1 -- 172.21.15.16:0/1665491119 learned_addr learned my addr 172.21.15.16:0/1665491119 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.528+0000 7f6d23fff700 1 --2- 172.21.15.16:0/1665491119 >> v2:172.21.15.16:3300/0 conn(0x7f6d2c0ce020 0x7f6d2c0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.529+0000 7f6d23fff700 1 -- 172.21.15.16:0/1665491119 >> v2:172.21.15.169:3300/0 conn(0x7f6d2c1606b0 msgr2=0x7f6d2c070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.529+0000 7f6d23fff700 1 --2- 172.21.15.16:0/1665491119 >> v2:172.21.15.169:3300/0 conn(0x7f6d2c1606b0 0x7f6d2c070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.529+0000 7f6d23fff700 1 -- 172.21.15.16:0/1665491119 >> v1:172.21.15.16:6789/0 conn(0x7f6d2c0b0e40 legacy=0x7f6d2c164220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.529+0000 7f6d23fff700 1 -- 172.21.15.16:0/1665491119 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0ce490 con 0x7f6d2c0ce020 2023-06-08T04:02:04.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.529+0000 7f6d2b7fe700 1 --2- 172.21.15.16:0/1665491119 >> v2:172.21.15.169:3300/0 conn(0x7f6d2c1606b0 0x7f6d2c070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:04.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.530+0000 7f18e77ff700 1 -- 172.21.15.16:0/2453146955 shutdown_connections 2023-06-08T04:02:04.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.530+0000 7f18e77ff700 1 -- 172.21.15.16:0/2453146955 wait complete. 2023-06-08T04:02:04.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.533+0000 7f18e77ff700 1 Processor -- start 2023-06-08T04:02:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.533+0000 7f18e77ff700 1 -- start start 2023-06-08T04:02:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.535+0000 7f18e77ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18e00b0a70 0x7f18e00b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.535+0000 7f18e77ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e014f560 0x7f18e0143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.535+0000 7f18e77ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18e0158f00 0x7f18e00c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.535+0000 7f18e77ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0142510 con 0x7f18e014f560 2023-06-08T04:02:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.535+0000 7f18e77ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0143740 con 0x7f18e0158f00 2023-06-08T04:02:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.535+0000 7f18e77ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00b4300 con 0x7f18e00b0a70 2023-06-08T04:02:04.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.530+0000 7ff8d57fa700 1 -- 172.21.15.16:0/2974233956 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8011830 con 0x7ff8d80cc880 2023-06-08T04:02:04.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.530+0000 7ff8d57fa700 1 -- 172.21.15.16:0/2974233956 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c8011990 con 0x7ff8d80cc880 2023-06-08T04:02:04.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.530+0000 7ff8d57fa700 1 -- 172.21.15.16:0/2974233956 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8011d40 con 0x7ff8d80cc880 2023-06-08T04:02:04.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.531+0000 7ff8debff700 1 -- 172.21.15.16:0/2974233956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d8153050 con 0x7ff8d80cc880 2023-06-08T04:02:04.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.531+0000 7ff8debff700 1 -- 172.21.15.16:0/2974233956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d8158640 con 0x7ff8d80cc880 2023-06-08T04:02:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.534+0000 7ff12c1ff700 1 Processor -- start 2023-06-08T04:02:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.534+0000 7ff12c1ff700 1 -- start start 2023-06-08T04:02:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.530+0000 7f6d23fff700 1 --2- 172.21.15.16:0/1665491119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d2c0ce020 0x7f6d2c0707c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c071a80 tx=0x7f6d1c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffa379ec8cbda02 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.530+0000 7f6d2affd700 1 -- 172.21.15.16:0/1665491119 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c011830 con 0x7f6d2c0ce020 2023-06-08T04:02:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.531+0000 7f6d2affd700 1 -- 172.21.15.16:0/1665491119 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c011990 con 0x7f6d2c0ce020 2023-06-08T04:02:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.531+0000 7f6d2affd700 1 -- 172.21.15.16:0/1665491119 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c011d20 con 0x7f6d2c0ce020 2023-06-08T04:02:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.533+0000 7f6d31fff700 1 -- 172.21.15.16:0/1665491119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d2c0ce020 msgr2=0x7f6d2c0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.533+0000 7f6d31fff700 1 --2- 172.21.15.16:0/1665491119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d2c0ce020 0x7f6d2c0707c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c071a80 tx=0x7f6d1c009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.534+0000 7f6d31fff700 1 -- 172.21.15.16:0/1665491119 shutdown_connections 2023-06-08T04:02:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.534+0000 7f6d31fff700 1 --2- 172.21.15.16:0/1665491119 >> v2:172.21.15.169:3300/0 conn(0x7f6d2c1606b0 0x7f6d2c070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.534+0000 7f6d31fff700 1 --2- 172.21.15.16:0/1665491119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d2c0ce020 0x7f6d2c0707c0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c071a80 tx=0x7f6d1c009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.534+0000 7f6d31fff700 1 -- 172.21.15.16:0/1665491119 >> 172.21.15.16:0/1665491119 conn(0x7f6d2c06aa40 msgr2=0x7f6d2c0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.536+0000 7f18e5d9c700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18e0158f00 0x7f18e00c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.536+0000 7f18e5d9c700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18e0158f00 0x7f18e00c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56282/0 (socket says 172.21.15.16:56282) 2023-06-08T04:02:04.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.536+0000 7f18e5d9c700 1 -- 172.21.15.16:0/3118262956 learned_addr learned my addr 172.21.15.16:0/3118262956 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:04.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.536+0000 7f18e559b700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18e00b0a70 0x7f18e00b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.536+0000 7f18e4d9a700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e014f560 0x7f18e0143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.535+0000 7ff8d57fa700 1 -- 172.21.15.16:0/2974233956 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8c801a400 con 0x7ff8d80cc880 2023-06-08T04:02:04.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.536+0000 7f18e559b700 1 -- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18e0158f00 msgr2=0x7f18e00c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.536+0000 7f18e559b700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18e0158f00 0x7f18e00c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.536+0000 7f18e559b700 1 -- 172.21.15.16:0/3118262956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e014f560 msgr2=0x7f18e0143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.537+0000 7f18e559b700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e014f560 0x7f18e0143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.537+0000 7f18e559b700 1 -- 172.21.15.16:0/3118262956 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc009550 con 0x7f18e00b0a70 2023-06-08T04:02:04.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.537+0000 7f18e559b700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18e00b0a70 0x7f18e00b3d20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f18d800efc0 tx=0x7f18d800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.536+0000 7f6d31fff700 1 -- 172.21.15.16:0/1665491119 shutdown_connections 2023-06-08T04:02:04.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.537+0000 7f18d5ffb700 1 -- 172.21.15.16:0/3118262956 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800cdc0 con 0x7f18e00b0a70 2023-06-08T04:02:04.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.538+0000 7f18d5ffb700 1 -- 172.21.15.16:0/3118262956 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d800f040 con 0x7f18e00b0a70 2023-06-08T04:02:04.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.538+0000 7f18d5ffb700 1 -- 172.21.15.16:0/3118262956 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8014680 con 0x7f18e00b0a70 2023-06-08T04:02:04.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.537+0000 7ff8d57fa700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff8c406adb0 0x7ff8c406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.537+0000 7ff8d57fa700 1 -- 172.21.15.16:0/2974233956 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8c8089310 con 0x7ff8d80cc880 2023-06-08T04:02:04.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.539+0000 7ff8debff700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:6816/210051049,v1:172.21.15.169:6817/210051049] conn(0x7ff8d8157640 0x7ff8d8159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.539+0000 7ff8debff700 1 -- 172.21.15.16:0/2974233956 --> [v2:172.21.15.169:6816/210051049,v1:172.21.15.169:6817/210051049] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8d806c650 con 0x7ff8d8157640 2023-06-08T04:02:04.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.539+0000 7ff8dc99b700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff8c406adb0 0x7ff8c406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.538+0000 7ff12c1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1240cc340 0x7ff1240ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.538+0000 7ff12c1ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff124071050 con 0x7ff1241608e0 2023-06-08T04:02:04.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.538+0000 7ff12c1ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1240cc9b0 con 0x7ff124070990 2023-06-08T04:02:04.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.538+0000 7ff12c1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240cc7c0 con 0x7ff1240cc340 2023-06-08T04:02:04.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.539+0000 7ff12979a700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7ff124070990 0x7ff12406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:43090/0 (socket says 172.21.15.16:43090) 2023-06-08T04:02:04.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.539+0000 7ff12979a700 1 -- 172.21.15.16:0/3162376159 learned_addr learned my addr 172.21.15.16:0/3162376159 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:04.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.539+0000 7ff12a79c700 1 --2- 172.21.15.16:0/3162376159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1240cc340 0x7ff1240ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.540+0000 7ff128f99700 1 -- 172.21.15.16:0/3162376159 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867208984 0 0) 0x7ff1240cc9b0 con 0x7ff124070990 2023-06-08T04:02:04.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.540+0000 7ff128f99700 1 -- 172.21.15.16:0/3162376159 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1100035b0 con 0x7ff124070990 2023-06-08T04:02:04.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.538+0000 7f6d31fff700 1 -- 172.21.15.16:0/1665491119 wait complete. 2023-06-08T04:02:04.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.539+0000 7f18e77ff700 1 -- 172.21.15.16:0/3118262956 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e0142720 con 0x7f18e00b0a70 2023-06-08T04:02:04.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.539+0000 7f18e77ff700 1 -- 172.21.15.16:0/3118262956 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e0142ce0 con 0x7f18e00b0a70 2023-06-08T04:02:04.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.540+0000 7ff8dd19c700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:6816/210051049,v1:172.21.15.169:6817/210051049] conn(0x7ff8d8157640 0x7ff8d8159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.540+0000 7ff12a79c700 1 -- 172.21.15.16:0/3162376159 >> v1:172.21.15.169:6789/0 conn(0x7ff124070990 legacy=0x7ff12406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.540+0000 7ff12a79c700 1 -- 172.21.15.16:0/3162376159 >> v1:172.21.15.16:6789/0 conn(0x7ff1241608e0 legacy=0x7ff124070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.540+0000 7ff12a79c700 1 -- 172.21.15.16:0/3162376159 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124160cb0 con 0x7ff1240cc340 2023-06-08T04:02:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.540+0000 7ff8dc99b700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff8c406adb0 0x7ff8c406d260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009b90 tx=0x7ff8cc01a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.541+0000 7ff12a79c700 1 --2- 172.21.15.16:0/3162376159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1240cc340 0x7ff1240ce020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009dc0 tx=0x7ff11c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8da9847631cb08f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.541+0000 7f18e77ff700 1 -- 172.21.15.16:0/3118262956 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18e006de60 con 0x7f18e00b0a70 2023-06-08T04:02:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.541+0000 7f6d31fff700 1 Processor -- start 2023-06-08T04:02:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.541+0000 7fd3da1ff700 1 -- 172.21.15.16:0/3376723465 --> [v2:172.21.15.16:6800/704029040,v1:172.21.15.16:6801/704029040] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd3d406de60 con 0x7fd3c0073660 2023-06-08T04:02:04.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.541+0000 7ff8dd19c700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:6816/210051049,v1:172.21.15.169:6817/210051049] conn(0x7ff8d8157640 0x7ff8d8159910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.541+0000 7ff128f99700 1 -- 172.21.15.16:0/3162376159 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00e070 con 0x7ff1240cc340 2023-06-08T04:02:04.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.541+0000 7ff128f99700 1 -- 172.21.15.16:0/3162376159 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c00bae0 con 0x7ff1240cc340 2023-06-08T04:02:04.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.541+0000 7ff128f99700 1 -- 172.21.15.16:0/3162376159 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00be90 con 0x7ff1240cc340 2023-06-08T04:02:04.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.542+0000 7fd3bbfff700 1 -- 172.21.15.16:0/3376723465 <== osd.0 v2:172.21.15.16:6800/704029040 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd3c8009280 con 0x7fd3c0073660 2023-06-08T04:02:04.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.542+0000 7ff12c1ff700 1 -- 172.21.15.16:0/3162376159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1240cc340 msgr2=0x7ff1240ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.542+0000 7ff12c1ff700 1 --2- 172.21.15.16:0/3162376159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1240cc340 0x7ff1240ce020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009dc0 tx=0x7ff11c00b330 comp rx=0 tx=0).stop 2023-06-08T04:02:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.542+0000 7ff12c1ff700 1 -- 172.21.15.16:0/3162376159 shutdown_connections 2023-06-08T04:02:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.542+0000 7ff12c1ff700 1 --2- 172.21.15.16:0/3162376159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1240cc340 0x7ff1240ce020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.542+0000 7ff12c1ff700 1 -- 172.21.15.16:0/3162376159 >> 172.21.15.16:0/3162376159 conn(0x7ff12406aa30 msgr2=0x7ff1240b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7fd3da1ff700 1 -- 172.21.15.16:0/3376723465 >> [v2:172.21.15.16:6800/704029040,v1:172.21.15.16:6801/704029040] conn(0x7fd3c0073660 msgr2=0x7fd3c0075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7fd3da1ff700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.16:6800/704029040,v1:172.21.15.16:6801/704029040] conn(0x7fd3c0073660 0x7fd3c0075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7ff12c1ff700 1 -- 172.21.15.16:0/3162376159 shutdown_connections 2023-06-08T04:02:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7fd3da1ff700 1 -- 172.21.15.16:0/3376723465 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd3c006adb0 msgr2=0x7fd3c006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7fd3da1ff700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd3c006adb0 0x7fd3c006d260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc003c10 tx=0x7fd3cc0098d0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.541+0000 7f6d31fff700 1 -- start start 2023-06-08T04:02:04.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7f6d31fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d2c0b0e40 0x7f6d2c0c1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7f6d31fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6d2c1606b0 0x7f6d2c0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7fd3da1ff700 1 -- 172.21.15.16:0/3376723465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3d414f560 msgr2=0x7fd3d414bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7fd3da1ff700 1 --2- 172.21.15.16:0/3376723465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3d414f560 0x7fd3d414bc50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4004000 tx=0x7fd3c4004750 comp rx=0 tx=0).stop 2023-06-08T04:02:04.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7fd3d3fff700 1 -- 172.21.15.16:0/3376723465 reap_dead start 2023-06-08T04:02:04.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7f6d31fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d2c0b2890 0x7f6d2c0c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7f6d31fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c0c86e0 con 0x7f6d2c0b2890 2023-06-08T04:02:04.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7f6d31fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c071090 con 0x7f6d2c0b0e40 2023-06-08T04:02:04.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7f6d31fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c0c7210 con 0x7f6d2c1606b0 2023-06-08T04:02:04.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7f6d23fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6d2c1606b0 0x7f6d2c0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7f6d23fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6d2c1606b0 0x7f6d2c0b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:55032/0 (socket says 172.21.15.16:55032) 2023-06-08T04:02:04.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7f6d23fff700 1 -- 172.21.15.16:0/2209563548 learned_addr learned my addr 172.21.15.16:0/2209563548 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:04.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.544+0000 7ff8d57fa700 1 -- 172.21.15.16:0/2974233956 <== osd.5 v2:172.21.15.169:6816/210051049 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff8d0009a90 con 0x7ff8d8157640 2023-06-08T04:02:04.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.544+0000 7f6d2bfff700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d2c0b2890 0x7f6d2c0c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.544+0000 7f6d23fff700 1 -- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d2c0b0e40 msgr2=0x7f6d2c0c1510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T04:02:04.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.544+0000 7f6d23fff700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d2c0b0e40 0x7f6d2c0c1510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.544+0000 7f6d23fff700 1 -- 172.21.15.16:0/2209563548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d2c0b2890 msgr2=0x7f6d2c0c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.544+0000 7f6d23fff700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d2c0b2890 0x7f6d2c0c5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.544+0000 7f6d23fff700 1 -- 172.21.15.16:0/2209563548 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c0094a0 con 0x7f6d2c1606b0 2023-06-08T04:02:04.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.544+0000 7f18d5ffb700 1 -- 172.21.15.16:0/3118262956 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18d80147e0 con 0x7f18e00b0a70 2023-06-08T04:02:04.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.545+0000 7f6d23fff700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6d2c1606b0 0x7f6d2c0b2350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0090b0 tx=0x7f6d1c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.543+0000 7ff12c1ff700 1 -- 172.21.15.16:0/3162376159 wait complete. 2023-06-08T04:02:04.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.545+0000 7f6d28ff9700 1 -- 172.21.15.16:0/2209563548 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0045d0 con 0x7f6d2c1606b0 2023-06-08T04:02:04.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.545+0000 7f6d28ff9700 1 -- 172.21.15.16:0/2209563548 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c01f070 con 0x7f6d2c1606b0 2023-06-08T04:02:04.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.545+0000 7f6d28ff9700 1 -- 172.21.15.16:0/2209563548 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0038c0 con 0x7f6d2c1606b0 2023-06-08T04:02:04.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.546+0000 7f6d31fff700 1 -- 172.21.15.16:0/2209563548 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c0c7f00 con 0x7f6d2c1606b0 2023-06-08T04:02:04.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.546+0000 7f6d31fff700 1 -- 172.21.15.16:0/2209563548 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c070db0 con 0x7f6d2c1606b0 2023-06-08T04:02:04.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.546+0000 7f18d5ffb700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f18c406ade0 0x7f18c406d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.546+0000 7f18d5ffb700 1 -- 172.21.15.16:0/3118262956 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f18d808a290 con 0x7f18e00b0a70 2023-06-08T04:02:04.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.546+0000 7ff12c1ff700 1 Processor -- start 2023-06-08T04:02:04.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.546+0000 7ff12c1ff700 1 -- start start 2023-06-08T04:02:04.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.546+0000 7f18d5ffb700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:6800/3777279651,v1:172.21.15.169:6801/3777279651] conn(0x7f18c4073690 0x7f18c4075aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.546+0000 7f18d5ffb700 1 -- 172.21.15.16:0/3118262956 --> [v2:172.21.15.169:6800/3777279651,v1:172.21.15.169:6801/3777279651] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18c4076150 con 0x7f18c4073690 2023-06-08T04:02:04.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.546+0000 7f18d5ffb700 1 -- 172.21.15.16:0/3118262956 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18d808a640 con 0x7f18e00b0a70 2023-06-08T04:02:04.588 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.547+0000 7f18e5d9c700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:6800/3777279651,v1:172.21.15.169:6801/3777279651] conn(0x7f18c4073690 0x7f18c4075aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.588 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.547+0000 7f18e4d9a700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f18c406ade0 0x7f18c406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.588 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.548+0000 7ff12c1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff124070990 0x7ff12415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.588 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.550+0000 7f4498bff700 1 -- 172.21.15.16:0/3507733263 --> [v2:172.21.15.16:6808/4017547986,v1:172.21.15.16:6809/4017547986] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4478002d30 con 0x7f44740735e0 2023-06-08T04:02:04.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.548+0000 7f18e5d9c700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:6800/3777279651,v1:172.21.15.169:6801/3777279651] conn(0x7f18c4073690 0x7f18c4075aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.549+0000 7f18d5ffb700 1 -- 172.21.15.16:0/3118262956 <== osd.4 v2:172.21.15.169:6800/3777279651 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f18c4076150 con 0x7f18c4073690 2023-06-08T04:02:04.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.549+0000 7f18e4d9a700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f18c406ade0 0x7f18c406d290 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18e00714d0 tx=0x7f18dc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.549+0000 7ff12c1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1240cc340 0x7ff1240cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.549+0000 7ff12c1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1241608e0 0x7ff1240aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.549+0000 7ff12c1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240c4770 con 0x7ff1240cc340 2023-06-08T04:02:04.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.549+0000 7ff12c1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240c4a50 con 0x7ff124070990 2023-06-08T04:02:04.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.549+0000 7ff129f9b700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff124070990 0x7ff12415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.549+0000 7ff129f9b700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff124070990 0x7ff12415c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56298/0 (socket says 172.21.15.16:56298) 2023-06-08T04:02:04.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.549+0000 7ff129f9b700 1 -- 172.21.15.16:0/405889011 learned_addr learned my addr 172.21.15.16:0/405889011 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:04.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.549+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240c4d30 con 0x7ff1241608e0 2023-06-08T04:02:04.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.550+0000 7ff12979a700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1240cc340 0x7ff1240cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.550+0000 7ff129f9b700 1 -- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1241608e0 msgr2=0x7ff1240aed00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T04:02:04.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.550+0000 7ff129f9b700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1241608e0 0x7ff1240aed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.550+0000 7ff129f9b700 1 -- 172.21.15.16:0/405889011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1240cc340 msgr2=0x7ff1240cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.550+0000 7ff129f9b700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1240cc340 0x7ff1240cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.550+0000 7ff129f9b700 1 -- 172.21.15.16:0/405889011 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c009a70 con 0x7ff124070990 2023-06-08T04:02:04.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.550+0000 7ff12979a700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1240cc340 0x7ff1240cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:04.592 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.549+0000 7f6d31fff700 1 -- 172.21.15.16:0/2209563548 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d10000fb0 con 0x7f6d2c1606b0 2023-06-08T04:02:04.592 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.550+0000 7f448affd700 1 -- 172.21.15.16:0/3507733263 <== osd.1 v2:172.21.15.16:6808/4017547986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4478002d30 con 0x7f44740735e0 2023-06-08T04:02:04.592 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.550+0000 7ff129f9b700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff124070990 0x7ff12415c8a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff12000b3f0 tx=0x7ff12000b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.592 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.550+0000 7f6d28ff9700 1 -- 172.21.15.16:0/2209563548 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d1c003a20 con 0x7f6d2c1606b0 2023-06-08T04:02:04.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.551+0000 7fd3da1ff700 1 -- 172.21.15.16:0/3376723465 shutdown_connections 2023-06-08T04:02:04.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.551+0000 7fd3da1ff700 1 -- 172.21.15.16:0/3376723465 >> 172.21.15.16:0/3376723465 conn(0x7fd3d406aa30 msgr2=0x7fd3d4070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.551+0000 7fd3da1ff700 1 -- 172.21.15.16:0/3376723465 shutdown_connections 2023-06-08T04:02:04.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.551+0000 7fd3da1ff700 1 -- 172.21.15.16:0/3376723465 wait complete. 2023-06-08T04:02:04.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.551+0000 7ff11a7fc700 1 -- 172.21.15.16:0/405889011 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120011830 con 0x7ff124070990 2023-06-08T04:02:04.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.551+0000 7ff11a7fc700 1 -- 172.21.15.16:0/405889011 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1200119b0 con 0x7ff124070990 2023-06-08T04:02:04.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.551+0000 7ff11a7fc700 1 -- 172.21.15.16:0/405889011 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120011d60 con 0x7ff124070990 2023-06-08T04:02:04.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f4498bff700 1 -- 172.21.15.16:0/3507733263 >> [v2:172.21.15.16:6808/4017547986,v1:172.21.15.16:6809/4017547986] conn(0x7f44740735e0 msgr2=0x7f44740759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f4498bff700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.16:6808/4017547986,v1:172.21.15.16:6809/4017547986] conn(0x7f44740735e0 0x7f44740759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.551+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1240c5010 con 0x7ff124070990 2023-06-08T04:02:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.551+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1240c43b0 con 0x7ff124070990 2023-06-08T04:02:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f4498bff700 1 -- 172.21.15.16:0/3507733263 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f447406adb0 msgr2=0x7f447406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f4498bff700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f447406adb0 0x7f447406d260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f449414c040 tx=0x7f448c008040 comp rx=0 tx=0).stop 2023-06-08T04:02:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f4498bff700 1 -- 172.21.15.16:0/3507733263 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f449414f560 msgr2=0x7f449414f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f4498bff700 1 --2- 172.21.15.16:0/3507733263 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f449414f560 0x7f449414f930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f447c018000 tx=0x7f447c004750 comp rx=0 tx=0).stop 2023-06-08T04:02:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f4492d9d700 1 -- 172.21.15.16:0/3507733263 reap_dead start 2023-06-08T04:02:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.553+0000 7f4498bff700 1 -- 172.21.15.16:0/3507733263 shutdown_connections 2023-06-08T04:02:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.553+0000 7f4498bff700 1 -- 172.21.15.16:0/3507733263 >> 172.21.15.16:0/3507733263 conn(0x7f449406aa30 msgr2=0x7f44940afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.553+0000 7f4498bff700 1 -- 172.21.15.16:0/3507733263 shutdown_connections 2023-06-08T04:02:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.553+0000 7f4498bff700 1 -- 172.21.15.16:0/3507733263 wait complete. 2023-06-08T04:02:04.597 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f6d28ff9700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6d0c06adb0 0x7f6d0c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.597 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f6d28ff9700 1 -- 172.21.15.16:0/2209563548 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6d1c021070 con 0x7f6d2c1606b0 2023-06-08T04:02:04.597 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f6d28ff9700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:6824/3479195367,v1:172.21.15.169:6825/3479195367] conn(0x7f6d0c073660 0x7f6d0c075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.597 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f6d28ff9700 1 -- 172.21.15.16:0/2209563548 --> [v2:172.21.15.169:6824/3479195367,v1:172.21.15.169:6825/3479195367] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d0c076120 con 0x7f6d0c073660 2023-06-08T04:02:04.597 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.552+0000 7f6d28ff9700 1 -- 172.21.15.16:0/2209563548 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d1c08cea0 con 0x7f6d2c1606b0 2023-06-08T04:02:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.553+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff124161270 con 0x7ff124070990 2023-06-08T04:02:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.553+0000 7f6d2b7fe700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6d0c06adb0 0x7f6d0c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.553+0000 7f6d2bfff700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:6824/3479195367,v1:172.21.15.169:6825/3479195367] conn(0x7f6d0c073660 0x7f6d0c075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.554+0000 7f6d2bfff700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:6824/3479195367,v1:172.21.15.169:6825/3479195367] conn(0x7f6d0c073660 0x7f6d0c075a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.554+0000 7f6d2b7fe700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6d0c06adb0 0x7f6d0c06d260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6d14006fd0 tx=0x7f6d14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.555+0000 7f6d28ff9700 1 -- 172.21.15.16:0/2209563548 <== osd.7 v2:172.21.15.169:6824/3479195367 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6d0c076120 con 0x7f6d0c073660 2023-06-08T04:02:04.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.556+0000 7ff11a7fc700 1 -- 172.21.15.16:0/405889011 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff12001a400 con 0x7ff124070990 2023-06-08T04:02:04.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.557+0000 7ff11a7fc700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff10806adb0 0x7ff10806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.558+0000 7ff11a7fc700 1 -- 172.21.15.16:0/405889011 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff120089600 con 0x7ff124070990 2023-06-08T04:02:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.558+0000 7ff11a7fc700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:6808/2490026649,v1:172.21.15.169:6809/2490026649] conn(0x7ff108073660 0x7ff108075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.558+0000 7ff11a7fc700 1 -- 172.21.15.16:0/405889011 --> [v2:172.21.15.169:6808/2490026649,v1:172.21.15.169:6809/2490026649] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff108076120 con 0x7ff108073660 2023-06-08T04:02:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.558+0000 7ff11a7fc700 1 -- 172.21.15.16:0/405889011 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1200899b0 con 0x7ff124070990 2023-06-08T04:02:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.559+0000 7ff12979a700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff10806adb0 0x7ff10806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.559+0000 7ff12a79c700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:6808/2490026649,v1:172.21.15.169:6809/2490026649] conn(0x7ff108073660 0x7ff108075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.560+0000 7ff12a79c700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:6808/2490026649,v1:172.21.15.169:6809/2490026649] conn(0x7ff108073660 0x7ff108075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.560+0000 7ff12979a700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff10806adb0 0x7ff10806d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff1240adde0 tx=0x7ff114009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.560+0000 7f5aed3ff700 1 -- 172.21.15.16:0/844481291 --> [v2:172.21.15.16:6816/1847064506,v1:172.21.15.16:6817/1847064506] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ae806c5a0 con 0x7f5ad4073660 2023-06-08T04:02:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.561+0000 7f5acf7fe700 1 -- 172.21.15.16:0/844481291 <== osd.3 v2:172.21.15.16:6816/1847064506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ae0007df0 con 0x7f5ad4073660 2023-06-08T04:02:04.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.561+0000 7ff11a7fc700 1 -- 172.21.15.16:0/405889011 <== osd.6 v2:172.21.15.169:6808/2490026649 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff108076120 con 0x7ff108073660 2023-06-08T04:02:04.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.563+0000 7f5aed3ff700 1 -- 172.21.15.16:0/844481291 >> [v2:172.21.15.16:6816/1847064506,v1:172.21.15.16:6817/1847064506] conn(0x7f5ad4073660 msgr2=0x7f5ad4075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.563+0000 7f5aed3ff700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.16:6816/1847064506,v1:172.21.15.16:6817/1847064506] conn(0x7f5ad4073660 0x7f5ad4075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.565+0000 7f5aed3ff700 1 -- 172.21.15.16:0/844481291 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5ad406adb0 msgr2=0x7f5ad406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.565+0000 7f5aed3ff700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5ad406adb0 0x7f5ad406d260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8000ff0 tx=0x7f5ad8009040 comp rx=0 tx=0).stop 2023-06-08T04:02:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.565+0000 7f5aed3ff700 1 -- 172.21.15.16:0/844481291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ae8153bf0 msgr2=0x7f5ae80b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.565+0000 7f5aed3ff700 1 --2- 172.21.15.16:0/844481291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ae8153bf0 0x7f5ae80b3970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80cbc30 tx=0x7f5adc00ca90 comp rx=0 tx=0).stop 2023-06-08T04:02:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.565+0000 7f5ae77fe700 1 -- 172.21.15.16:0/844481291 reap_dead start 2023-06-08T04:02:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.566+0000 7f5aed3ff700 1 -- 172.21.15.16:0/844481291 shutdown_connections 2023-06-08T04:02:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.566+0000 7f5aed3ff700 1 -- 172.21.15.16:0/844481291 >> 172.21.15.16:0/844481291 conn(0x7f5ae806aa30 msgr2=0x7f5ae80aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.566+0000 7f5aed3ff700 1 -- 172.21.15.16:0/844481291 shutdown_connections 2023-06-08T04:02:04.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.566+0000 7f5aed3ff700 1 -- 172.21.15.16:0/844481291 wait complete. 2023-06-08T04:02:04.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.567+0000 7fda011ff700 1 -- 172.21.15.16:0/2342411910 --> [v2:172.21.15.16:6821/251692641,v1:172.21.15.16:6823/251692641] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9fc0b0340 con 0x7fd9e8073660 2023-06-08T04:02:04.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.567+0000 7fd9e37fe700 1 -- 172.21.15.16:0/2342411910 <== osd.2 v2:172.21.15.16:6821/251692641 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd9fc0b0340 con 0x7fd9e8073660 2023-06-08T04:02:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.569+0000 7fda011ff700 1 -- 172.21.15.16:0/2342411910 >> [v2:172.21.15.16:6821/251692641,v1:172.21.15.16:6823/251692641] conn(0x7fd9e8073660 msgr2=0x7fd9e8075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.569+0000 7fda011ff700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.16:6821/251692641,v1:172.21.15.16:6823/251692641] conn(0x7fd9e8073660 0x7fd9e8075a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.570+0000 7fda011ff700 1 -- 172.21.15.16:0/2342411910 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd9e806adb0 msgr2=0x7fd9e806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.570+0000 7fda011ff700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd9e806adb0 0x7fd9e806d260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0adc50 tx=0x7fd9f0006c60 comp rx=0 tx=0).stop 2023-06-08T04:02:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.570+0000 7fda011ff700 1 -- 172.21.15.16:0/2342411910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9fc1418d0 msgr2=0x7fd9fc141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.570+0000 7fda011ff700 1 --2- 172.21.15.16:0/2342411910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9fc1418d0 0x7fd9fc141d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc06fb60 tx=0x7fd9f4001cb0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.570+0000 7fd9fb59e700 1 -- 172.21.15.16:0/2342411910 reap_dead start 2023-06-08T04:02:04.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.571+0000 7fda011ff700 1 -- 172.21.15.16:0/2342411910 shutdown_connections 2023-06-08T04:02:04.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.571+0000 7fda011ff700 1 -- 172.21.15.16:0/2342411910 >> 172.21.15.16:0/2342411910 conn(0x7fd9fc06aa30 msgr2=0x7fd9fc070700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.571+0000 7fda011ff700 1 -- 172.21.15.16:0/2342411910 shutdown_connections 2023-06-08T04:02:04.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.571+0000 7fda011ff700 1 -- 172.21.15.16:0/2342411910 wait complete. 2023-06-08T04:02:04.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.578+0000 7ff8debff700 1 -- 172.21.15.16:0/2974233956 --> [v2:172.21.15.169:6816/210051049,v1:172.21.15.169:6817/210051049] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff8d806de60 con 0x7ff8d8157640 2023-06-08T04:02:04.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.578+0000 7ff8d57fa700 1 -- 172.21.15.16:0/2974233956 <== osd.5 v2:172.21.15.169:6816/210051049 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff8d000b3f0 con 0x7ff8d8157640 2023-06-08T04:02:04.608 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2023-06-08T04:02:04.608 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-08T04:02:04.609 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-06-08T04:02:04.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-08T04:02:04.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.584+0000 7ff8debff700 1 -- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:6816/210051049,v1:172.21.15.169:6817/210051049] conn(0x7ff8d8157640 msgr2=0x7ff8d8159910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.584+0000 7ff8debff700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:6816/210051049,v1:172.21.15.169:6817/210051049] conn(0x7ff8d8157640 0x7ff8d8159910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.585+0000 7ff8debff700 1 -- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff8c406adb0 msgr2=0x7ff8c406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.585+0000 7ff8debff700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff8c406adb0 0x7ff8c406d260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009b90 tx=0x7ff8cc01a040 comp rx=0 tx=0).stop 2023-06-08T04:02:04.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.585+0000 7ff8debff700 1 -- 172.21.15.16:0/2974233956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8d80cc880 msgr2=0x7ff8d8155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.585+0000 7ff8debff700 1 --2- 172.21.15.16:0/2974233956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8d80cc880 0x7ff8d8155660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800b410 tx=0x7ff8c800b720 comp rx=0 tx=0).stop 2023-06-08T04:02:04.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.585+0000 7ff8dd19c700 1 -- 172.21.15.16:0/2974233956 reap_dead start 2023-06-08T04:02:04.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.585+0000 7ff8debff700 1 -- 172.21.15.16:0/2974233956 shutdown_connections 2023-06-08T04:02:04.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.585+0000 7ff8debff700 1 -- 172.21.15.16:0/2974233956 >> 172.21.15.16:0/2974233956 conn(0x7ff8d806aa30 msgr2=0x7ff8d80ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.585+0000 7ff8debff700 1 -- 172.21.15.16:0/2974233956 shutdown_connections 2023-06-08T04:02:04.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.585+0000 7ff8debff700 1 -- 172.21.15.16:0/2974233956 wait complete. 2023-06-08T04:02:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.585+0000 7f18e77ff700 1 -- 172.21.15.16:0/3118262956 --> [v2:172.21.15.169:6800/3777279651,v1:172.21.15.169:6801/3777279651] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18e006c930 con 0x7f18c4073690 2023-06-08T04:02:04.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.586+0000 7f18d5ffb700 1 -- 172.21.15.16:0/3118262956 <== osd.4 v2:172.21.15.169:6800/3777279651 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f18d0001540 con 0x7f18c4073690 2023-06-08T04:02:04.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.587+0000 7f18e77ff700 1 -- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:6800/3777279651,v1:172.21.15.169:6801/3777279651] conn(0x7f18c4073690 msgr2=0x7f18c4075aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.587+0000 7f18e77ff700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:6800/3777279651,v1:172.21.15.169:6801/3777279651] conn(0x7f18c4073690 0x7f18c4075aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.587+0000 7f18e77ff700 1 -- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f18c406ade0 msgr2=0x7f18c406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.587+0000 7f18e77ff700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f18c406ade0 0x7f18c406d290 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18e00714d0 tx=0x7f18dc008030 comp rx=0 tx=0).stop 2023-06-08T04:02:04.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.587+0000 7f18e77ff700 1 -- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18e00b0a70 msgr2=0x7f18e00b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.587+0000 7f18e77ff700 1 --2- 172.21.15.16:0/3118262956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18e00b0a70 0x7f18e00b3d20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f18d800efc0 tx=0x7f18d800c3a0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.587+0000 7f18e5d9c700 1 -- 172.21.15.16:0/3118262956 reap_dead start 2023-06-08T04:02:04.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.587+0000 7f18e77ff700 1 -- 172.21.15.16:0/3118262956 shutdown_connections 2023-06-08T04:02:04.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.587+0000 7f18e77ff700 1 -- 172.21.15.16:0/3118262956 >> 172.21.15.16:0/3118262956 conn(0x7f18e006aa30 msgr2=0x7f18e00afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.588+0000 7f18e77ff700 1 -- 172.21.15.16:0/3118262956 shutdown_connections 2023-06-08T04:02:04.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.588+0000 7f18e77ff700 1 -- 172.21.15.16:0/3118262956 wait complete. 2023-06-08T04:02:04.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.588+0000 7f6d31fff700 1 -- 172.21.15.16:0/2209563548 --> [v2:172.21.15.169:6824/3479195367,v1:172.21.15.169:6825/3479195367] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6d10002d30 con 0x7f6d0c073660 2023-06-08T04:02:04.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.588+0000 7f6d28ff9700 1 -- 172.21.15.16:0/2209563548 <== osd.7 v2:172.21.15.169:6824/3479195367 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6d10002d30 con 0x7f6d0c073660 2023-06-08T04:02:04.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.589+0000 7f6d31fff700 1 -- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:6824/3479195367,v1:172.21.15.169:6825/3479195367] conn(0x7f6d0c073660 msgr2=0x7f6d0c075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.589+0000 7f6d31fff700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:6824/3479195367,v1:172.21.15.169:6825/3479195367] conn(0x7f6d0c073660 0x7f6d0c075a70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.589+0000 7f6d31fff700 1 -- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6d0c06adb0 msgr2=0x7f6d0c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.589+0000 7f6d31fff700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6d0c06adb0 0x7f6d0c06d260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6d14006fd0 tx=0x7f6d14008040 comp rx=0 tx=0).stop 2023-06-08T04:02:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.589+0000 7f6d31fff700 1 -- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6d2c1606b0 msgr2=0x7f6d2c0b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.589+0000 7f6d31fff700 1 --2- 172.21.15.16:0/2209563548 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6d2c1606b0 0x7f6d2c0b2350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0090b0 tx=0x7f6d1c004750 comp rx=0 tx=0).stop 2023-06-08T04:02:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.589+0000 7f6d2bfff700 1 -- 172.21.15.16:0/2209563548 reap_dead start 2023-06-08T04:02:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.590+0000 7f6d31fff700 1 -- 172.21.15.16:0/2209563548 shutdown_connections 2023-06-08T04:02:04.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.590+0000 7f6d31fff700 1 -- 172.21.15.16:0/2209563548 >> 172.21.15.16:0/2209563548 conn(0x7f6d2c06aa40 msgr2=0x7f6d2c0c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.595+0000 7f6d31fff700 1 -- 172.21.15.16:0/2209563548 shutdown_connections 2023-06-08T04:02:04.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.595+0000 7f6d31fff700 1 -- 172.21.15.16:0/2209563548 wait complete. 2023-06-08T04:02:04.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.596+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 --> [v2:172.21.15.169:6808/2490026649,v1:172.21.15.169:6809/2490026649] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff124160f90 con 0x7ff108073660 2023-06-08T04:02:04.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.597+0000 7ff11a7fc700 1 -- 172.21.15.16:0/405889011 <== osd.6 v2:172.21.15.169:6808/2490026649 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff11c003b60 con 0x7ff108073660 2023-06-08T04:02:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.597+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:6808/2490026649,v1:172.21.15.169:6809/2490026649] conn(0x7ff108073660 msgr2=0x7ff108075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.597+0000 7ff12c1ff700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:6808/2490026649,v1:172.21.15.169:6809/2490026649] conn(0x7ff108073660 0x7ff108075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.597+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff10806adb0 msgr2=0x7ff10806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.597+0000 7ff12c1ff700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff10806adb0 0x7ff10806d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff1240adde0 tx=0x7ff114009040 comp rx=0 tx=0).stop 2023-06-08T04:02:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.598+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff124070990 msgr2=0x7ff12415c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.598+0000 7ff12c1ff700 1 --2- 172.21.15.16:0/405889011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff124070990 0x7ff12415c8a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff12000b3f0 tx=0x7ff12000b7b0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.598+0000 7ff12a79c700 1 -- 172.21.15.16:0/405889011 reap_dead start 2023-06-08T04:02:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.598+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 shutdown_connections 2023-06-08T04:02:04.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.598+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 >> 172.21.15.16:0/405889011 conn(0x7ff12406aa30 msgr2=0x7ff1240afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.619 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2023-06-08T04:02:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.598+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 shutdown_connections 2023-06-08T04:02:04.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.598+0000 7ff12c1ff700 1 -- 172.21.15.16:0/405889011 wait complete. 2023-06-08T04:02:04.620 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-08T04:02:04.621 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2023-06-08T04:02:04.622 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-08T04:02:04.622 INFO:teuthology.orchestra.run.smithi016.stdout:55834574855 2023-06-08T04:02:04.623 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-08T04:02:04.624 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-06-08T04:02:04.624 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-08T04:02:04.625 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-06-08T04:02:04.625 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-08T04:02:04.629 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-06-08T04:02:04.630 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-08T04:02:04.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.980+0000 7fb3f39ff700 1 Processor -- start 2023-06-08T04:02:04.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.980+0000 7fb3f39ff700 1 -- start start 2023-06-08T04:02:04.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.982+0000 7fb3f39ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3ec06dba0 0x7fb3ec0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.982+0000 7fb3f39ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb3ec070990 0x7fb3ec06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.982+0000 7fb3f39ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec0891c0 con 0x7fb3ec089650 2023-06-08T04:02:04.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.982+0000 7fb3f39ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec06df70 con 0x7fb3ec070990 2023-06-08T04:02:04.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.982+0000 7fb3f39ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec088f40 con 0x7fb3ec06dba0 2023-06-08T04:02:04.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.983+0000 7fb3f179b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3ec06dba0 0x7fb3ec0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.983+0000 7fb3f179b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3ec06dba0 0x7fb3ec0ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:55044/0 (socket says 172.21.15.16:55044) 2023-06-08T04:02:04.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.983+0000 7fb3f179b700 1 -- 172.21.15.16:0/3146654704 learned_addr learned my addr 172.21.15.16:0/3146654704 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:04.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.984+0000 7fb3f1f9c700 1 --2- 172.21.15.16:0/3146654704 >> v2:172.21.15.169:3300/0 conn(0x7fb3ec070990 0x7fb3ec06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.984+0000 7fb3f179b700 1 -- 172.21.15.16:0/3146654704 >> v2:172.21.15.169:3300/0 conn(0x7fb3ec070990 msgr2=0x7fb3ec06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.984+0000 7fb3f179b700 1 --2- 172.21.15.16:0/3146654704 >> v2:172.21.15.169:3300/0 conn(0x7fb3ec070990 0x7fb3ec06c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.984+0000 7fb3f179b700 1 -- 172.21.15.16:0/3146654704 >> v1:172.21.15.169:6789/0 conn(0x7fb3ec089650 legacy=0x7fb3ec070280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T04:02:04.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.984+0000 7fb3f179b700 1 -- 172.21.15.16:0/3146654704 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec0ccbc0 con 0x7fb3ec06dba0 2023-06-08T04:02:04.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.984+0000 7fb3f179b700 1 --2- 172.21.15.16:0/3146654704 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3ec06dba0 0x7fb3ec0ce020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009e50 tx=0x7fb3e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=870a8a1d6dbb5b17 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:04.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.986+0000 7fb3e3fff700 1 -- 172.21.15.16:0/3146654704 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400e070 con 0x7fb3ec06dba0 2023-06-08T04:02:04.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.986+0000 7fb3e3fff700 1 -- 172.21.15.16:0/3146654704 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e4003a20 con 0x7fb3ec06dba0 2023-06-08T04:02:04.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.986+0000 7fb3e3fff700 1 -- 172.21.15.16:0/3146654704 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4003dd0 con 0x7fb3ec06dba0 2023-06-08T04:02:04.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.987+0000 7fd0555ff700 1 Processor -- start 2023-06-08T04:02:04.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.988+0000 7f3573dff700 1 Processor -- start 2023-06-08T04:02:04.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.988+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3146654704 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3ec06dba0 msgr2=0x7fb3ec0ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.988+0000 7fb3f39ff700 1 --2- 172.21.15.16:0/3146654704 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3ec06dba0 0x7fb3ec0ce020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009e50 tx=0x7fb3e400b330 comp rx=0 tx=0).stop 2023-06-08T04:02:04.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.988+0000 7fd0555ff700 1 -- start start 2023-06-08T04:02:04.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.988+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3146654704 shutdown_connections 2023-06-08T04:02:04.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.988+0000 7fb3f39ff700 1 --2- 172.21.15.16:0/3146654704 >> v2:172.21.15.169:3300/0 conn(0x7fb3ec070990 0x7fb3ec06c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.988+0000 7fb3f39ff700 1 --2- 172.21.15.16:0/3146654704 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3ec06dba0 0x7fb3ec0ce020 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.988+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3146654704 >> 172.21.15.16:0/3146654704 conn(0x7fb3ec06aa30 msgr2=0x7fb3ec0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:04.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.988+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3146654704 shutdown_connections 2023-06-08T04:02:04.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.991+0000 7f01879ff700 1 Processor -- start 2023-06-08T04:02:04.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.989+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3146654704 wait complete. 2023-06-08T04:02:04.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.991+0000 7fb3f39ff700 1 Processor -- start 2023-06-08T04:02:04.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.991+0000 7f01879ff700 1 -- start start 2023-06-08T04:02:04.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.990+0000 7fd0555ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd0500ce020 0x7fd050070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.990+0000 7fd0555ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0500b0e40 0x7fd05006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:04.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.990+0000 7fd0555ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0500ccbe0 con 0x7fd0501606b0 2023-06-08T04:02:04.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.990+0000 7fd0555ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0500cbef0 con 0x7fd0500ce020 2023-06-08T04:02:04.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.990+0000 7fd0555ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0500c8dc0 con 0x7fd0500b0e40 2023-06-08T04:02:04.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.991+0000 7fd04effd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd0501606b0 0x7fd050070280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51590/0 (socket says 172.21.15.16:51590) 2023-06-08T04:02:04.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.991+0000 7fd04effd700 1 -- 172.21.15.16:0/3303279408 learned_addr learned my addr 172.21.15.16:0/3303279408 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:04.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.992+0000 7fd04e7fc700 1 --2- 172.21.15.16:0/3303279408 >> v2:172.21.15.169:3300/0 conn(0x7fd0500ce020 0x7fd050070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.992+0000 7fb3f39ff700 1 -- start start 2023-06-08T04:02:04.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.993+0000 7fd04f7fe700 1 --2- 172.21.15.16:0/3303279408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0500b0e40 0x7fd05006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:04.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.993+0000 7fd04dffb700 1 -- 172.21.15.16:0/3303279408 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638911666 0 0) 0x7fd0500ccbe0 con 0x7fd0501606b0 2023-06-08T04:02:04.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.993+0000 7fd04dffb700 1 -- 172.21.15.16:0/3303279408 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0380035b0 con 0x7fd0501606b0 2023-06-08T04:02:04.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.993+0000 7fd04e7fc700 1 -- 172.21.15.16:0/3303279408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0500b0e40 msgr2=0x7fd05006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:04.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.993+0000 7fd04e7fc700 1 --2- 172.21.15.16:0/3303279408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0500b0e40 0x7fd05006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:04.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.993+0000 7fd04e7fc700 1 -- 172.21.15.16:0/3303279408 >> v1:172.21.15.16:6789/0 conn(0x7fd0501606b0 legacy=0x7fd050070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:04.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.993+0000 7fd04e7fc700 1 -- 172.21.15.16:0/3303279408 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0500ce490 con 0x7fd0500ce020 2023-06-08T04:02:05.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.993+0000 7f01879ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f01800b83f0 0x7f0180160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.993+0000 7f01879ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f01800ced40 0x7f01800b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.994+0000 7f01879ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01800d0800 con 0x7f01800b4b50 2023-06-08T04:02:05.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.994+0000 7f01879ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800b4fd0 con 0x7f01800ced40 2023-06-08T04:02:05.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.994+0000 7f01879ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800cd1e0 con 0x7f01800b83f0 2023-06-08T04:02:05.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.994+0000 7fb3f39ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3ec06dba0 0x7fb3ec0c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.994+0000 7fb3f39ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3ec070990 0x7fb3ec0c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.994+0000 7fb3f39ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3ec089650 0x7fb3ec0c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.994+0000 7fb3f39ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0c3d30 con 0x7fb3ec06dba0 2023-06-08T04:02:05.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.994+0000 7fb3f39ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0c4010 con 0x7fb3ec070990 2023-06-08T04:02:05.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.994+0000 7fb3f39ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0c42f0 con 0x7fb3ec089650 2023-06-08T04:02:05.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.994+0000 7fd04e7fc700 1 --2- 172.21.15.16:0/3303279408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0500ce020 0x7fd050070990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd048009d90 tx=0x7fd04800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27a11559e27de5f7 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7fb3f179b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3ec06dba0 0x7fb3ec0c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7fb3f0f9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3ec070990 0x7fb3ec0c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7fb3f179b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3ec06dba0 0x7fb3ec0c18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42086/0 (socket says 172.21.15.16:42086) 2023-06-08T04:02:05.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7fb3f179b700 1 -- 172.21.15.16:0/3033137462 learned_addr learned my addr 172.21.15.16:0/3033137462 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:05.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7f0185f9c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f01800b4b50 0x7f018006b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51594/0 (socket says 172.21.15.16:51594) 2023-06-08T04:02:05.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7f0185f9c700 1 -- 172.21.15.16:0/3323391978 learned_addr learned my addr 172.21.15.16:0/3323391978 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:05.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7f018579b700 1 --2- 172.21.15.16:0/3323391978 >> v2:172.21.15.169:3300/0 conn(0x7f01800b83f0 0x7f0180160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7f0184f9a700 1 --2- 172.21.15.16:0/3323391978 >> v2:172.21.15.16:3300/0 conn(0x7f01800ced40 0x7f01800b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7fd04dffb700 1 -- 172.21.15.16:0/3303279408 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04800e070 con 0x7fd0500ce020 2023-06-08T04:02:05.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7fd04dffb700 1 -- 172.21.15.16:0/3303279408 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04800bae0 con 0x7fd0500ce020 2023-06-08T04:02:05.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7fd04dffb700 1 -- 172.21.15.16:0/3303279408 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04800be70 con 0x7fd0500ce020 2023-06-08T04:02:05.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7f0177fff700 1 -- 172.21.15.16:0/3323391978 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480113985 0 0) 0x7f01800d0800 con 0x7f01800b4b50 2023-06-08T04:02:05.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7f0177fff700 1 -- 172.21.15.16:0/3323391978 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f016c0035b0 con 0x7f01800b4b50 2023-06-08T04:02:05.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7f018579b700 1 -- 172.21.15.16:0/3323391978 >> v2:172.21.15.16:3300/0 conn(0x7f01800ced40 msgr2=0x7f01800b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:05.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7f018579b700 1 --2- 172.21.15.16:0/3323391978 >> v2:172.21.15.16:3300/0 conn(0x7f01800ced40 0x7f01800b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7f018579b700 1 -- 172.21.15.16:0/3323391978 >> v1:172.21.15.16:6789/0 conn(0x7f01800b4b50 legacy=0x7f018006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7f018579b700 1 -- 172.21.15.16:0/3323391978 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800cd4c0 con 0x7f01800b83f0 2023-06-08T04:02:05.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7fd0555ff700 1 -- 172.21.15.16:0/3303279408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0500ce020 msgr2=0x7fd050070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7fd0555ff700 1 --2- 172.21.15.16:0/3303279408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0500ce020 0x7fd050070990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd048009d90 tx=0x7fd04800b330 comp rx=0 tx=0).stop 2023-06-08T04:02:05.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7fd0555ff700 1 -- 172.21.15.16:0/3303279408 shutdown_connections 2023-06-08T04:02:05.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7fd0555ff700 1 --2- 172.21.15.16:0/3303279408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0500b0e40 0x7fd05006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7fd0555ff700 1 --2- 172.21.15.16:0/3303279408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0500ce020 0x7fd050070990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.996+0000 7fd0555ff700 1 -- 172.21.15.16:0/3303279408 >> 172.21.15.16:0/3303279408 conn(0x7fd05006aa40 msgr2=0x7fd0500b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.995+0000 7f3573dff700 1 -- start start 2023-06-08T04:02:05.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.997+0000 7fb3f0f9a700 1 -- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3ec089650 msgr2=0x7fb3ec0c3620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T04:02:05.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.997+0000 7f018579b700 1 --2- 172.21.15.16:0/3323391978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800b83f0 0x7f0180160a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f018006ca80 tx=0x7f017c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3637c2ce34ceb61b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.997+0000 7fb3f0f9a700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3ec089650 0x7fb3ec0c3620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.997+0000 7fb3f0f9a700 1 -- 172.21.15.16:0/3033137462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3ec06dba0 msgr2=0x7fb3ec0c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.997+0000 7fb3f0f9a700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3ec06dba0 0x7fb3ec0c18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.997+0000 7fb3f0f9a700 1 -- 172.21.15.16:0/3033137462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e4009b30 con 0x7fb3ec070990 2023-06-08T04:02:05.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.997+0000 7fd0555ff700 1 -- 172.21.15.16:0/3303279408 shutdown_connections 2023-06-08T04:02:05.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.997+0000 7f0177fff700 1 -- 172.21.15.16:0/3323391978 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c014e90 con 0x7f01800b83f0 2023-06-08T04:02:05.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.997+0000 7f0177fff700 1 -- 172.21.15.16:0/3323391978 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c01c440 con 0x7f01800b83f0 2023-06-08T04:02:05.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.997+0000 7f0177fff700 1 -- 172.21.15.16:0/3323391978 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c01c7d0 con 0x7f01800b83f0 2023-06-08T04:02:05.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.998+0000 7fb3f0f9a700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3ec070990 0x7fb3ec0c30e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec089a40 tx=0x7fb3e800b750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7fb3e1ffb700 1 -- 172.21.15.16:0/3033137462 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8011830 con 0x7fb3ec070990 2023-06-08T04:02:05.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7fb3e1ffb700 1 -- 172.21.15.16:0/3033137462 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e8011990 con 0x7fb3ec070990 2023-06-08T04:02:05.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7fb3e1ffb700 1 -- 172.21.15.16:0/3033137462 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8011d40 con 0x7fb3ec070990 2023-06-08T04:02:05.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3033137462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec0c45d0 con 0x7fb3ec070990 2023-06-08T04:02:05.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.000+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3033137462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec0c1de0 con 0x7fb3ec070990 2023-06-08T04:02:05.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.998+0000 7f01879ff700 1 -- 172.21.15.16:0/3323391978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800b83f0 msgr2=0x7f0180160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.998+0000 7f01879ff700 1 --2- 172.21.15.16:0/3323391978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800b83f0 0x7f0180160a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f018006ca80 tx=0x7f017c009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:05.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7f01879ff700 1 -- 172.21.15.16:0/3323391978 shutdown_connections 2023-06-08T04:02:05.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7f01879ff700 1 --2- 172.21.15.16:0/3323391978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800b83f0 0x7f0180160a60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7f01879ff700 1 --2- 172.21.15.16:0/3323391978 >> v2:172.21.15.16:3300/0 conn(0x7f01800ced40 0x7f01800b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7f01879ff700 1 -- 172.21.15.16:0/3323391978 >> 172.21.15.16:0/3323391978 conn(0x7f01800cf610 msgr2=0x7f01800cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.997+0000 7fd0555ff700 1 -- 172.21.15.16:0/3303279408 wait complete. 2023-06-08T04:02:05.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.000+0000 7fd0555ff700 1 Processor -- start 2023-06-08T04:02:05.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.998+0000 7f3573dff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f356c14f560 0x7f356c0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.998+0000 7f3573dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f356c0cc880 0x7f356c06ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.998+0000 7f3573dff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c1593f0 con 0x7f356c0b0a70 2023-06-08T04:02:05.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.998+0000 7f3573dff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c0ccd00 con 0x7f356c14f560 2023-06-08T04:02:05.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.998+0000 7f3573dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1596d0 con 0x7f356c0cc880 2023-06-08T04:02:05.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7f357139a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f356c14f560 0x7f356c0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7f357139a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f356c14f560 0x7f356c0cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56338/0 (socket says 172.21.15.16:56338) 2023-06-08T04:02:05.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7f357139a700 1 -- 172.21.15.16:0/240542956 learned_addr learned my addr 172.21.15.16:0/240542956 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:05.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:04.999+0000 7f357239c700 1 --2- 172.21.15.16:0/240542956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f356c0cc880 0x7f356c06ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.000+0000 7f357139a700 1 -- 172.21.15.16:0/240542956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f356c0cc880 msgr2=0x7f356c06ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:05.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.000+0000 7f357139a700 1 --2- 172.21.15.16:0/240542956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f356c0cc880 0x7f356c06ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.000+0000 7f357139a700 1 -- 172.21.15.16:0/240542956 >> v1:172.21.15.169:6789/0 conn(0x7f356c0b0a70 legacy=0x7f356c1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:05.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.000+0000 7f357139a700 1 -- 172.21.15.16:0/240542956 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c06c650 con 0x7f356c14f560 2023-06-08T04:02:05.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.000+0000 7f357139a700 1 --2- 172.21.15.16:0/240542956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f356c14f560 0x7f356c0cc340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f355c0098f0 tx=0x7f355c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1a0e235ec466d20 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.001+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3033137462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec0c4430 con 0x7fb3ec070990 2023-06-08T04:02:05.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.001+0000 7f01879ff700 1 -- 172.21.15.16:0/3323391978 shutdown_connections 2023-06-08T04:02:05.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.001+0000 7f1b329ff700 1 Processor -- start 2023-06-08T04:02:05.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.000+0000 7fd0555ff700 1 -- start start 2023-06-08T04:02:05.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.001+0000 7f3570b99700 1 -- 172.21.15.16:0/240542956 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c004230 con 0x7f356c14f560 2023-06-08T04:02:05.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.001+0000 7f3570b99700 1 -- 172.21.15.16:0/240542956 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c004390 con 0x7f356c14f560 2023-06-08T04:02:05.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.001+0000 7f3570b99700 1 -- 172.21.15.16:0/240542956 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0036a0 con 0x7f356c14f560 2023-06-08T04:02:05.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.002+0000 7f3573dff700 1 -- 172.21.15.16:0/240542956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f356c14f560 msgr2=0x7f356c0cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.002+0000 7f3573dff700 1 --2- 172.21.15.16:0/240542956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f356c14f560 0x7f356c0cc340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f355c0098f0 tx=0x7f355c009c00 comp rx=0 tx=0).stop 2023-06-08T04:02:05.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.002+0000 7fd0555ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0500b0e40 0x7fd05015aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.002+0000 7fd0555ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0500ce020 0x7fd0500c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.002+0000 7fd0555ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0501606b0 0x7fd0500b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.002+0000 7fd0555ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0500b4650 con 0x7fd0500ce020 2023-06-08T04:02:05.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.002+0000 7fd0555ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0500c21d0 con 0x7fd0501606b0 2023-06-08T04:02:05.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.002+0000 7fd0555ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0500b3ad0 con 0x7fd0500b0e40 2023-06-08T04:02:05.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.002+0000 7f01879ff700 1 -- 172.21.15.16:0/3323391978 wait complete. 2023-06-08T04:02:05.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.003+0000 7fd04f7fe700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0501606b0 0x7fd0500b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.003+0000 7fd04f7fe700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0501606b0 0x7fd0500b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56350/0 (socket says 172.21.15.16:56350) 2023-06-08T04:02:05.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.003+0000 7fd04f7fe700 1 -- 172.21.15.16:0/2775350891 learned_addr learned my addr 172.21.15.16:0/2775350891 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:05.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.003+0000 7fd04effd700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0500b0e40 0x7fd05015aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.003+0000 7fd04e7fc700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0500ce020 0x7fd0500c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.003+0000 7fd04f7fe700 1 -- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0500b0e40 msgr2=0x7fd05015aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.003+0000 7fd04f7fe700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0500b0e40 0x7fd05015aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.003+0000 7fd04f7fe700 1 -- 172.21.15.16:0/2775350891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0500ce020 msgr2=0x7fd0500c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.003+0000 7fd04f7fe700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0500ce020 0x7fd0500c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.003+0000 7fd04f7fe700 1 -- 172.21.15.16:0/2775350891 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048009a70 con 0x7fd0501606b0 2023-06-08T04:02:05.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.002+0000 7f1b329ff700 1 -- start start 2023-06-08T04:02:05.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.004+0000 7f1b329ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1b2c156a80 0x7f1b2c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.004+0000 7f1b329ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b2c0d3170 0x7f1b2c0d3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.004+0000 7f1b329ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c0cd270 con 0x7f1b2c0cf030 2023-06-08T04:02:05.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.004+0000 7f1b329ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c15da30 con 0x7f1b2c156a80 2023-06-08T04:02:05.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.004+0000 7f1b329ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0cda80 con 0x7f1b2c0d3170 2023-06-08T04:02:05.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.004+0000 7fd04f7fe700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0501606b0 0x7fd0500b1b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd04000e810 tx=0x7fd04000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f1b2b7fe700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f1b2c0cf030 0x7f1b2c0d07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:43114/0 (socket says 172.21.15.16:43114) 2023-06-08T04:02:05.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f1b2b7fe700 1 -- 172.21.15.16:0/342567160 learned_addr learned my addr 172.21.15.16:0/342567160 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:05.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7fb3e1ffb700 1 -- 172.21.15.16:0/3033137462 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb3e801a400 con 0x7fb3ec070990 2023-06-08T04:02:05.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.006+0000 7fb3e1ffb700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb3d006adb0 0x7fb3d006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.006+0000 7fb3e1ffb700 1 -- 172.21.15.16:0/3033137462 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3e80894c0 con 0x7fb3ec070990 2023-06-08T04:02:05.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f01879ff700 1 Processor -- start 2023-06-08T04:02:05.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f1b30f9c700 1 --2- 172.21.15.16:0/342567160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b2c0d3170 0x7f1b2c0d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f1b2bfff700 1 --2- 172.21.15.16:0/342567160 >> v2:172.21.15.16:3300/0 conn(0x7f1b2c156a80 0x7f1b2c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f1b30f9c700 1 -- 172.21.15.16:0/342567160 >> v2:172.21.15.16:3300/0 conn(0x7f1b2c156a80 msgr2=0x7f1b2c15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:05.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f1b30f9c700 1 --2- 172.21.15.16:0/342567160 >> v2:172.21.15.16:3300/0 conn(0x7f1b2c156a80 0x7f1b2c15d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.006+0000 7f1b30f9c700 1 -- 172.21.15.16:0/342567160 >> v1:172.21.15.169:6789/0 conn(0x7f1b2c0cf030 legacy=0x7f1b2c0d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.006+0000 7f1b30f9c700 1 -- 172.21.15.16:0/342567160 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0cd4c0 con 0x7f1b2c0d3170 2023-06-08T04:02:05.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f3573dff700 1 -- 172.21.15.16:0/240542956 shutdown_connections 2023-06-08T04:02:05.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f3573dff700 1 --2- 172.21.15.16:0/240542956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f356c0cc880 0x7f356c06ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f3573dff700 1 --2- 172.21.15.16:0/240542956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f356c14f560 0x7f356c0cc340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f3573dff700 1 -- 172.21.15.16:0/240542956 >> 172.21.15.16:0/240542956 conn(0x7f356c06aa30 msgr2=0x7f356c0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.006+0000 7f3573dff700 1 -- 172.21.15.16:0/240542956 shutdown_connections 2023-06-08T04:02:05.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7f1b30f9c700 1 --2- 172.21.15.16:0/342567160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b2c0d3170 0x7f1b2c0d3610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009d90 tx=0x7f1b2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3c313236931ca68 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.005+0000 7f01879ff700 1 -- start start 2023-06-08T04:02:05.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7fb3f179b700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb3d006adb0 0x7fb3d006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7f01879ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01800b4b50 0x7f01800cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7f01879ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800b83f0 0x7f0180160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7f01879ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800ced40 0x7f0180160690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7f01879ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0180155a10 con 0x7f01800b4b50 2023-06-08T04:02:05.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7f01879ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0180155f40 con 0x7f01800b83f0 2023-06-08T04:02:05.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7f01879ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018015d4e0 con 0x7f01800ced40 2023-06-08T04:02:05.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7f1b2affd700 1 -- 172.21.15.16:0/342567160 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400e070 con 0x7f1b2c0d3170 2023-06-08T04:02:05.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7f1b2affd700 1 -- 172.21.15.16:0/342567160 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2400bbd0 con 0x7f1b2c0d3170 2023-06-08T04:02:05.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7f1b2affd700 1 -- 172.21.15.16:0/342567160 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24012430 con 0x7f1b2c0d3170 2023-06-08T04:02:05.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.007+0000 7f58f0dff700 1 Processor -- start 2023-06-08T04:02:05.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.008+0000 7f018579b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01800b4b50 0x7f01800cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.008+0000 7f018579b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01800b4b50 0x7f01800cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42108/0 (socket says 172.21.15.16:42108) 2023-06-08T04:02:05.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.008+0000 7f018579b700 1 -- 172.21.15.16:0/2354468990 learned_addr learned my addr 172.21.15.16:0/2354468990 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:05.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.008+0000 7f0185f9c700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800ced40 0x7f0180160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f018579b700 1 -- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800ced40 msgr2=0x7f0180160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f018579b700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800ced40 0x7f0180160690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f018579b700 1 -- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800b83f0 msgr2=0x7f0180160150 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T04:02:05.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f018579b700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800b83f0 0x7f0180160150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f018579b700 1 -- 172.21.15.16:0/2354468990 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c0094a0 con 0x7f01800b4b50 2023-06-08T04:02:05.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.008+0000 7f1b329ff700 1 -- 172.21.15.16:0/342567160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b2c0d3170 msgr2=0x7f1b2c0d3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.008+0000 7f1b329ff700 1 --2- 172.21.15.16:0/342567160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b2c0d3170 0x7f1b2c0d3610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009d90 tx=0x7f1b2400b330 comp rx=0 tx=0).stop 2023-06-08T04:02:05.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f1b329ff700 1 -- 172.21.15.16:0/342567160 shutdown_connections 2023-06-08T04:02:05.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f1b329ff700 1 --2- 172.21.15.16:0/342567160 >> v2:172.21.15.16:3300/0 conn(0x7f1b2c156a80 0x7f1b2c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f1b329ff700 1 --2- 172.21.15.16:0/342567160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b2c0d3170 0x7f1b2c0d3610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f1b329ff700 1 -- 172.21.15.16:0/342567160 >> 172.21.15.16:0/342567160 conn(0x7f1b2c06b2e0 msgr2=0x7f1b2c06b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.008+0000 7f58f0dff700 1 -- start start 2023-06-08T04:02:05.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.006+0000 7f3573dff700 1 -- 172.21.15.16:0/240542956 wait complete. 2023-06-08T04:02:05.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f3573dff700 1 Processor -- start 2023-06-08T04:02:05.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f1b329ff700 1 -- 172.21.15.16:0/342567160 shutdown_connections 2023-06-08T04:02:05.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7fb3e1ffb700 1 -- 172.21.15.16:0/3033137462 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb3e8054550 con 0x7fb3ec070990 2023-06-08T04:02:05.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f1b329ff700 1 -- 172.21.15.16:0/342567160 wait complete. 2023-06-08T04:02:05.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.010+0000 7f018579b700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01800b4b50 0x7f01800cc500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f017c0090b0 tx=0x7f017c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7fd0377fe700 1 -- 172.21.15.16:0/2775350891 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04000c070 con 0x7fd0501606b0 2023-06-08T04:02:05.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7fd0377fe700 1 -- 172.21.15.16:0/2775350891 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd040013650 con 0x7fd0501606b0 2023-06-08T04:02:05.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7fd0377fe700 1 -- 172.21.15.16:0/2775350891 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040013a00 con 0x7fd0501606b0 2023-06-08T04:02:05.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7fd0555ff700 1 -- 172.21.15.16:0/2775350891 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0500b3db0 con 0x7fd0501606b0 2023-06-08T04:02:05.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7fd0555ff700 1 -- 172.21.15.16:0/2775350891 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0500b4370 con 0x7fd0501606b0 2023-06-08T04:02:05.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.011+0000 7f58f0dff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f58ec0b2b20 0x7f58ec06caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.011+0000 7f58f0dff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f58ec070b70 0x7f58ec0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.011+0000 7f58f0dff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ec0d0790 con 0x7f58ec160640 2023-06-08T04:02:05.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.011+0000 7f58f0dff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ec06bfc0 con 0x7f58ec070b70 2023-06-08T04:02:05.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.011+0000 7f58f0dff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ec0d04b0 con 0x7f58ec0b2b20 2023-06-08T04:02:05.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.009+0000 7f3573dff700 1 -- start start 2023-06-08T04:02:05.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.011+0000 7f3573dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f356c0b0a70 0x7f356c14fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.011+0000 7f3573dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f356c0cc880 0x7f356c0c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.011+0000 7f3573dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f356c14f560 0x7f356c0af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.011+0000 7f3573dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1500e0 con 0x7f356c0b0a70 2023-06-08T04:02:05.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.011+0000 7f3573dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1503c0 con 0x7f356c0cc880 2023-06-08T04:02:05.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.011+0000 7f3573dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c1506a0 con 0x7f356c14f560 2023-06-08T04:02:05.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7f1b329ff700 1 Processor -- start 2023-06-08T04:02:05.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7f58ea59c700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f58ec160640 0x7f58ec0b2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:43120/0 (socket says 172.21.15.16:43120) 2023-06-08T04:02:05.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7f58ea59c700 1 -- 172.21.15.16:0/3550860457 learned_addr learned my addr 172.21.15.16:0/3550860457 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:05.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7f58ead9d700 1 --2- 172.21.15.16:0/3550860457 >> v2:172.21.15.16:3300/0 conn(0x7f58ec070b70 0x7f58ec0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7f357239c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f356c14f560 0x7f356c0af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7f357139a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f356c0cc880 0x7f356c0c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7f357139a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f356c0cc880 0x7f356c0c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56378/0 (socket says 172.21.15.16:56378) 2023-06-08T04:02:05.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7f357139a700 1 -- 172.21.15.16:0/411567802 learned_addr learned my addr 172.21.15.16:0/411567802 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:05.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7f3571b9b700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f356c0b0a70 0x7f356c14fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7fb3f179b700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb3d006adb0 0x7fb3d006d260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009440 tx=0x7fb3e4009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7f1b329ff700 1 -- start start 2023-06-08T04:02:05.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7f58ead9d700 1 -- 172.21.15.16:0/3550860457 >> v2:172.21.15.169:3300/0 conn(0x7f58ec0b2b20 msgr2=0x7f58ec06caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:05.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7f58ead9d700 1 --2- 172.21.15.16:0/3550860457 >> v2:172.21.15.169:3300/0 conn(0x7f58ec0b2b20 0x7f58ec06caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7f58ead9d700 1 -- 172.21.15.16:0/3550860457 >> v1:172.21.15.169:6789/0 conn(0x7f58ec160640 legacy=0x7f58ec0b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:05.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7f58ead9d700 1 -- 172.21.15.16:0/3550860457 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec06ba00 con 0x7f58ec070b70 2023-06-08T04:02:05.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.014+0000 7f58ead9d700 1 --2- 172.21.15.16:0/3550860457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ec070b70 0x7f58ec0ce940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0c3d20 tx=0x7f58dc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18174315de0e00b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7fd0555ff700 1 -- 172.21.15.16:0/2775350891 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0300052e0 con 0x7fd0501606b0 2023-06-08T04:02:05.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.012+0000 7f55a5bff700 1 Processor -- start 2023-06-08T04:02:05.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7f55a5bff700 1 -- start start 2023-06-08T04:02:05.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7f3571b9b700 1 -- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f356c14f560 msgr2=0x7f356c0af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7f3571b9b700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f356c14f560 0x7f356c0af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7f3571b9b700 1 -- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f356c0cc880 msgr2=0x7f356c0c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7f3571b9b700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f356c0cc880 0x7f356c0c4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7f3571b9b700 1 -- 172.21.15.16:0/411567802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c009550 con 0x7f356c0b0a70 2023-06-08T04:02:05.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.013+0000 7f3571b9b700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f356c0b0a70 0x7f356c14fa50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f356800b3c0 tx=0x7f356800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.014+0000 7f1b329ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b2c0cf030 0x7f1b2c160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.014+0000 7f1b329ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b2c0d3170 0x7f1b2c155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.014+0000 7f1b329ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b2c156a80 0x7f1b2c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.014+0000 7f1b329ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0c8390 con 0x7f1b2c156a80 2023-06-08T04:02:05.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.014+0000 7f1b329ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0c87b0 con 0x7f1b2c0cf030 2023-06-08T04:02:05.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.014+0000 7f1b329ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0c77a0 con 0x7f1b2c0d3170 2023-06-08T04:02:05.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f0175ffb700 1 -- 172.21.15.16:0/2354468990 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c01c5b0 con 0x7f01800b4b50 2023-06-08T04:02:05.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7fd0377fe700 1 -- 172.21.15.16:0/2775350891 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd040013b60 con 0x7fd0501606b0 2023-06-08T04:02:05.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f0175ffb700 1 -- 172.21.15.16:0/2354468990 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c01c710 con 0x7f01800b4b50 2023-06-08T04:02:05.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f0175ffb700 1 -- 172.21.15.16:0/2354468990 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c01caa0 con 0x7f01800b4b50 2023-06-08T04:02:05.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f01879ff700 1 -- 172.21.15.16:0/2354468990 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018015d7c0 con 0x7f01800b4b50 2023-06-08T04:02:05.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.016+0000 7f01879ff700 1 -- 172.21.15.16:0/2354468990 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01800cca40 con 0x7f01800b4b50 2023-06-08T04:02:05.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f1b30f9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b2c156a80 0x7f1b2c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f1b30f9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b2c156a80 0x7f1b2c1555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42150/0 (socket says 172.21.15.16:42150) 2023-06-08T04:02:05.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f1b30f9c700 1 -- 172.21.15.16:0/3270277974 learned_addr learned my addr 172.21.15.16:0/3270277974 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:05.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f1b2bfff700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b2c0cf030 0x7f1b2c160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f1b30f9c700 1 -- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b2c0d3170 msgr2=0x7f1b2c155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f1b30f9c700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b2c0d3170 0x7f1b2c155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f1b30f9c700 1 -- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b2c0cf030 msgr2=0x7f1b2c160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f1b30f9c700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b2c0cf030 0x7f1b2c160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f1b30f9c700 1 -- 172.21.15.16:0/3270277974 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24009a70 con 0x7f1b2c156a80 2023-06-08T04:02:05.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.016+0000 7f1b30f9c700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b2c156a80 0x7f1b2c1555d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b24014040 tx=0x7f1b24004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f55a5bff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f55a006e370 0x7f55a0158780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f55a5bff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f55a00cc340 0x7f55a00cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f55a5bff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a006dee0 con 0x7f55a015b730 2023-06-08T04:02:05.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f55a5bff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a01598e0 con 0x7f55a00cc340 2023-06-08T04:02:05.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.015+0000 7f55a5bff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a015bbd0 con 0x7f55a006e370 2023-06-08T04:02:05.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.016+0000 7f559effd700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f55a015b730 0x7f55a015c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:43122/0 (socket says 172.21.15.16:43122) 2023-06-08T04:02:05.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.016+0000 7f559effd700 1 -- 172.21.15.16:0/4001190801 learned_addr learned my addr 172.21.15.16:0/4001190801 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:05.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.016+0000 7f1b28ff9700 1 -- 172.21.15.16:0/3270277974 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24003ea0 con 0x7f1b2c156a80 2023-06-08T04:02:05.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.016+0000 7f1b28ff9700 1 -- 172.21.15.16:0/3270277974 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b24020070 con 0x7f1b2c156a80 2023-06-08T04:02:05.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.016+0000 7f1b28ff9700 1 -- 172.21.15.16:0/3270277974 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24004280 con 0x7f1b2c156a80 2023-06-08T04:02:05.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.016+0000 7f559f7fe700 1 --2- 172.21.15.16:0/4001190801 >> v2:172.21.15.169:3300/0 conn(0x7f55a006e370 0x7f55a0158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.016+0000 7f559ffff700 1 --2- 172.21.15.16:0/4001190801 >> v2:172.21.15.16:3300/0 conn(0x7f55a00cc340 0x7f55a00cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.017+0000 7f58e9d9b700 1 -- 172.21.15.16:0/3550860457 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc004230 con 0x7f58ec070b70 2023-06-08T04:02:05.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.017+0000 7f58e9d9b700 1 -- 172.21.15.16:0/3550860457 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc004390 con 0x7f58ec070b70 2023-06-08T04:02:05.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.017+0000 7f58e9d9b700 1 -- 172.21.15.16:0/3550860457 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0036c0 con 0x7f58ec070b70 2023-06-08T04:02:05.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.016+0000 7f1b329ff700 1 -- 172.21.15.16:0/3270277974 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c0c79f0 con 0x7f1b2c156a80 2023-06-08T04:02:05.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.017+0000 7f1b329ff700 1 -- 172.21.15.16:0/3270277974 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c0c7fb0 con 0x7f1b2c156a80 2023-06-08T04:02:05.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.017+0000 7fd0377fe700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd03c06adb0 0x7fd03c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.017+0000 7fd0377fe700 1 -- 172.21.15.16:0/2775350891 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd040088c20 con 0x7fd0501606b0 2023-06-08T04:02:05.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7fd04effd700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd03c06adb0 0x7fd03c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f58f0dff700 1 -- 172.21.15.16:0/3550860457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ec070b70 msgr2=0x7f58ec0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f58f0dff700 1 --2- 172.21.15.16:0/3550860457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ec070b70 0x7f58ec0ce940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0c3d20 tx=0x7f58dc009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:05.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f58f0dff700 1 -- 172.21.15.16:0/3550860457 shutdown_connections 2023-06-08T04:02:05.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f58f0dff700 1 --2- 172.21.15.16:0/3550860457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ec070b70 0x7f58ec0ce940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f58f0dff700 1 --2- 172.21.15.16:0/3550860457 >> v2:172.21.15.169:3300/0 conn(0x7f58ec0b2b20 0x7f58ec06caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f58f0dff700 1 -- 172.21.15.16:0/3550860457 >> 172.21.15.16:0/3550860457 conn(0x7f58ec06e4f0 msgr2=0x7f58ec06e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f35627fc700 1 -- 172.21.15.16:0/411567802 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568011620 con 0x7f356c0b0a70 2023-06-08T04:02:05.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f35627fc700 1 -- 172.21.15.16:0/411567802 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3568011780 con 0x7f356c0b0a70 2023-06-08T04:02:05.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f35627fc700 1 -- 172.21.15.16:0/411567802 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568011b10 con 0x7f356c0b0a70 2023-06-08T04:02:05.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f559ffff700 1 -- 172.21.15.16:0/4001190801 >> v2:172.21.15.169:3300/0 conn(0x7f55a006e370 msgr2=0x7f55a0158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:05.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f559ffff700 1 --2- 172.21.15.16:0/4001190801 >> v2:172.21.15.169:3300/0 conn(0x7f55a006e370 0x7f55a0158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f559ffff700 1 -- 172.21.15.16:0/4001190801 >> v1:172.21.15.169:6789/0 conn(0x7f55a015b730 legacy=0x7f55a015c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f559ffff700 1 -- 172.21.15.16:0/4001190801 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a00ccce0 con 0x7f55a00cc340 2023-06-08T04:02:05.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.019+0000 7f58f0dff700 1 -- 172.21.15.16:0/3550860457 shutdown_connections 2023-06-08T04:02:05.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.018+0000 7f3573dff700 1 -- 172.21.15.16:0/411567802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c150980 con 0x7f356c0b0a70 2023-06-08T04:02:05.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.019+0000 7f3573dff700 1 -- 172.21.15.16:0/411567802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c0c4940 con 0x7f356c0b0a70 2023-06-08T04:02:05.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.019+0000 7f559ffff700 1 --2- 172.21.15.16:0/4001190801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55a00cc340 0x7f55a00cc7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f55a0071ab0 tx=0x7f5590009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6809141ebae9d3 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.020+0000 7f3573dff700 1 -- 172.21.15.16:0/411567802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c0740e0 con 0x7f356c0b0a70 2023-06-08T04:02:05.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.019+0000 7f559e7fc700 1 -- 172.21.15.16:0/4001190801 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590011830 con 0x7f55a00cc340 2023-06-08T04:02:05.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.019+0000 7f559e7fc700 1 -- 172.21.15.16:0/4001190801 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5590011990 con 0x7f55a00cc340 2023-06-08T04:02:05.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.019+0000 7f559e7fc700 1 -- 172.21.15.16:0/4001190801 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590011d20 con 0x7f55a00cc340 2023-06-08T04:02:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.020+0000 7f55a5bff700 1 -- 172.21.15.16:0/4001190801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55a00cc340 msgr2=0x7f55a00cc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.020+0000 7f55a5bff700 1 --2- 172.21.15.16:0/4001190801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55a00cc340 0x7f55a00cc7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f55a0071ab0 tx=0x7f5590009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:05.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.019+0000 7f58f0dff700 1 -- 172.21.15.16:0/3550860457 wait complete. 2023-06-08T04:02:05.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.021+0000 7f0175ffb700 1 -- 172.21.15.16:0/2354468990 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f017c023040 con 0x7f01800b4b50 2023-06-08T04:02:05.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.023+0000 7f0175ffb700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f016406ace0 0x7f016406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.023+0000 7f0175ffb700 1 -- 172.21.15.16:0/2354468990 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f017c093090 con 0x7f01800b4b50 2023-06-08T04:02:05.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.024+0000 7f0184f9a700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f016406ace0 0x7f016406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.022+0000 7f1b28ff9700 1 -- 172.21.15.16:0/3270277974 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b240043e0 con 0x7f1b2c156a80 2023-06-08T04:02:05.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.022+0000 7f1b329ff700 1 -- 172.21.15.16:0/3270277974 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c0ce790 con 0x7f1b2c156a80 2023-06-08T04:02:05.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.023+0000 7f1b28ff9700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1b1806adb0 0x7f1b1806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.023+0000 7f1b28ff9700 1 -- 172.21.15.16:0/3270277974 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b24022070 con 0x7f1b2c156a80 2023-06-08T04:02:05.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.024+0000 7f1b2bfff700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1b1806adb0 0x7f1b1806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.021+0000 7fd04effd700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd03c06adb0 0x7fd03c06d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd044000f60 tx=0x7fd044004a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.024+0000 7fd0377fe700 1 -- 172.21.15.16:0/2775350891 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd040057740 con 0x7fd0501606b0 2023-06-08T04:02:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.022+0000 7f58f0dff700 1 Processor -- start 2023-06-08T04:02:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.022+0000 7f58f0dff700 1 -- start start 2023-06-08T04:02:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.024+0000 7f58f0dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58ec070b70 0x7f58ec156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.024+0000 7f58f0dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ec0b2b20 0x7f58ec0c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.024+0000 7f58f0dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ec160640 0x7f58ec0c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.024+0000 7f58f0dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0b65f0 con 0x7f58ec0b2b20 2023-06-08T04:02:05.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.024+0000 7f58f0dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0b5ad0 con 0x7f58ec160640 2023-06-08T04:02:05.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.024+0000 7f58f0dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec0b5d50 con 0x7f58ec070b70 2023-06-08T04:02:05.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.024+0000 7f35627fc700 1 -- 172.21.15.16:0/411567802 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3568011c70 con 0x7f356c0b0a70 2023-06-08T04:02:05.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.022+0000 7f55a5bff700 1 -- 172.21.15.16:0/4001190801 shutdown_connections 2023-06-08T04:02:05.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.022+0000 7f55a5bff700 1 --2- 172.21.15.16:0/4001190801 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55a00cc340 0x7f55a00cc7a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.022+0000 7f55a5bff700 1 --2- 172.21.15.16:0/4001190801 >> v2:172.21.15.169:3300/0 conn(0x7f55a006e370 0x7f55a0158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.022+0000 7f55a5bff700 1 -- 172.21.15.16:0/4001190801 >> 172.21.15.16:0/4001190801 conn(0x7f55a006aa40 msgr2=0x7f55a00b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.025+0000 7f58e3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ec0b2b20 0x7f58ec0c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.025+0000 7f58e3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ec0b2b20 0x7f58ec0c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42180/0 (socket says 172.21.15.16:42180) 2023-06-08T04:02:05.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.025+0000 7f58e3fff700 1 -- 172.21.15.16:0/3513810140 learned_addr learned my addr 172.21.15.16:0/3513810140 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:05.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.026+0000 7f58ea59c700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58ec070b70 0x7f58ec156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.026+0000 7f58ead9d700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ec160640 0x7f58ec0c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.026+0000 7f01879ff700 1 -- 172.21.15.16:0/2354468990 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018015d9e0 con 0x7f01800b4b50 2023-06-08T04:02:05.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.023+0000 7f55a5bff700 1 -- 172.21.15.16:0/4001190801 shutdown_connections 2023-06-08T04:02:05.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.023+0000 7f55a5bff700 1 -- 172.21.15.16:0/4001190801 wait complete. 2023-06-08T04:02:05.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.025+0000 7f55a5bff700 1 Processor -- start 2023-06-08T04:02:05.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.026+0000 7f55a5bff700 1 -- start start 2023-06-08T04:02:05.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f0184f9a700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f016406ace0 0x7f016406d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0180160e30 tx=0x7f0170009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.026+0000 7f35627fc700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f355006adb0 0x7f355006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.026+0000 7f35627fc700 1 -- 172.21.15.16:0/411567802 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f35680891d0 con 0x7f356c0b0a70 2023-06-08T04:02:05.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f357139a700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f355006adb0 0x7f355006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f58e3fff700 1 -- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58ec070b70 msgr2=0x7f58ec156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f58e3fff700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58ec070b70 0x7f58ec156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f58e3fff700 1 -- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ec160640 msgr2=0x7f58ec0c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f58e3fff700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ec160640 0x7f58ec0c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f58e3fff700 1 -- 172.21.15.16:0/3513810140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc0094a0 con 0x7f58ec0b2b20 2023-06-08T04:02:05.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f55a5bff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55a006e370 0x7f55a00ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f55a5bff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55a00cc340 0x7f55a0146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f55a5bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55a015b730 0x7f55a00c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f55a5bff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0150b50 con 0x7f55a00cc340 2023-06-08T04:02:05.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f55a5bff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0146a60 con 0x7f55a006e370 2023-06-08T04:02:05.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.027+0000 7f55a5bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00ac5a0 con 0x7f55a015b730 2023-06-08T04:02:05.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.028+0000 7f559ffff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55a015b730 0x7f55a00c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.028+0000 7f559f7fe700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55a006e370 0x7f55a00ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.028+0000 7f559ffff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55a015b730 0x7f55a00c4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:55142/0 (socket says 172.21.15.16:55142) 2023-06-08T04:02:05.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.028+0000 7f559ffff700 1 -- 172.21.15.16:0/614490022 learned_addr learned my addr 172.21.15.16:0/614490022 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:05.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.028+0000 7f559effd700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55a00cc340 0x7f55a0146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.028+0000 7f58e3fff700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ec0b2b20 0x7f58ec0c49b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f58d400b4d0 tx=0x7f58d400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.028+0000 7f559ffff700 1 -- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55a006e370 msgr2=0x7f55a00ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.028+0000 7f559ffff700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55a006e370 0x7f55a00ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.028+0000 7f559ffff700 1 -- 172.21.15.16:0/614490022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55a00cc340 msgr2=0x7f55a0146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.028+0000 7f559ffff700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55a00cc340 0x7f55a0146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.028+0000 7f559ffff700 1 -- 172.21.15.16:0/614490022 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55900094a0 con 0x7f55a015b730 2023-06-08T04:02:05.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.029+0000 7f1b2bfff700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1b1806adb0 0x7f1b1806d260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c065d00 tx=0x7f1b20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.029+0000 7f357139a700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f355006adb0 0x7f355006d260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f356c0b48e0 tx=0x7f355c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.029+0000 7f559ffff700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55a015b730 0x7f55a00c4470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5590009b60 tx=0x7f5590004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.029+0000 7f558ffff700 1 -- 172.21.15.16:0/614490022 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55900036a0 con 0x7f55a015b730 2023-06-08T04:02:05.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.029+0000 7f558ffff700 1 -- 172.21.15.16:0/614490022 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559001f070 con 0x7f55a015b730 2023-06-08T04:02:05.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.029+0000 7f558ffff700 1 -- 172.21.15.16:0/614490022 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5590003a60 con 0x7f55a015b730 2023-06-08T04:02:05.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.029+0000 7f55a5bff700 1 -- 172.21.15.16:0/614490022 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a0150870 con 0x7f55a015b730 2023-06-08T04:02:05.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.029+0000 7f55a5bff700 1 -- 172.21.15.16:0/614490022 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a00ace00 con 0x7f55a015b730 2023-06-08T04:02:05.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.031+0000 7f55a5bff700 1 -- 172.21.15.16:0/614490022 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a00ac960 con 0x7f55a015b730 2023-06-08T04:02:05.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.032+0000 7f1b28ff9700 1 -- 172.21.15.16:0/3270277974 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1b24056b20 con 0x7f1b2c156a80 2023-06-08T04:02:05.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.034+0000 7f558ffff700 1 -- 172.21.15.16:0/614490022 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5590003bc0 con 0x7f55a015b730 2023-06-08T04:02:05.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.035+0000 7f558ffff700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f558406ad00 0x7f558406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.035+0000 7f558ffff700 1 -- 172.21.15.16:0/614490022 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5590021070 con 0x7f55a015b730 2023-06-08T04:02:05.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.037+0000 7f58e2ffd700 1 -- 172.21.15.16:0/3513810140 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4011830 con 0x7f58ec0b2b20 2023-06-08T04:02:05.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.037+0000 7f35627fc700 1 -- 172.21.15.16:0/411567802 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f35680542f0 con 0x7f356c0b0a70 2023-06-08T04:02:05.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.037+0000 7f58f0dff700 1 -- 172.21.15.16:0/3513810140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec0b6030 con 0x7f58ec0b2b20 2023-06-08T04:02:05.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.037+0000 7f58f0dff700 1 -- 172.21.15.16:0/3513810140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec1ea4a0 con 0x7f58ec0b2b20 2023-06-08T04:02:05.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.037+0000 7f559f7fe700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f558406ad00 0x7f558406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.039+0000 7f58f0dff700 1 -- 172.21.15.16:0/3513810140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec1ea300 con 0x7f58ec0b2b20 2023-06-08T04:02:05.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.038+0000 7f558ffff700 1 -- 172.21.15.16:0/614490022 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5590056050 con 0x7f55a015b730 2023-06-08T04:02:05.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.040+0000 7f559f7fe700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f558406ad00 0x7f558406d1b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f55980113e0 tx=0x7f559800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.047+0000 7f0175ffb700 1 -- 172.21.15.16:0/2354468990 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f017c05e130 con 0x7f01800b4b50 2023-06-08T04:02:05.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.050+0000 7f58e2ffd700 1 -- 172.21.15.16:0/3513810140 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d4009300 con 0x7f58ec0b2b20 2023-06-08T04:02:05.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.050+0000 7f58e2ffd700 1 -- 172.21.15.16:0/3513810140 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4011bb0 con 0x7f58ec0b2b20 2023-06-08T04:02:05.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.050+0000 7f58e2ffd700 1 -- 172.21.15.16:0/3513810140 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f58d4011d50 con 0x7f58ec0b2b20 2023-06-08T04:02:05.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.054+0000 7f58e2ffd700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f58cc06ad60 0x7f58cc06d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.054+0000 7f58e2ffd700 1 -- 172.21.15.16:0/3513810140 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58d4089830 con 0x7f58ec0b2b20 2023-06-08T04:02:05.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.056+0000 7f58ea59c700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f58cc06ad60 0x7f58cc06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.057+0000 7f58ea59c700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f58cc06ad60 0x7f58cc06d210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f58e40056b0 tx=0x7f58e4005640 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.063+0000 7f58e2ffd700 1 -- 172.21.15.16:0/3513810140 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f58d40548e0 con 0x7f58ec0b2b20 2023-06-08T04:02:05.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.086+0000 7f26c8fff700 1 Processor -- start 2023-06-08T04:02:05.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.097+0000 7f26c8fff700 1 -- start start 2023-06-08T04:02:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.099+0000 7f26c8fff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f26c414f560 0x7f26c41589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.099+0000 7f26c8fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26c4158f00 0x7f26c40cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.099+0000 7f26c8fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f26c40cc880 0x7f26c4070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.099+0000 7f26c8fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c40ccce0 con 0x7f26c40cc880 2023-06-08T04:02:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.099+0000 7f26c8fff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c41593f0 con 0x7f26c414f560 2023-06-08T04:02:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.099+0000 7f26c8fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c41596d0 con 0x7f26c4158f00 2023-06-08T04:02:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.100+0000 7f26c2d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f26c40cc880 0x7f26c4070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.100+0000 7f26c2d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f26c40cc880 0x7f26c4070280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42192/0 (socket says 172.21.15.16:42192) 2023-06-08T04:02:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.100+0000 7f26c2d9d700 1 -- 172.21.15.16:0/361106907 learned_addr learned my addr 172.21.15.16:0/361106907 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.101+0000 7f26c2d9d700 1 -- 172.21.15.16:0/361106907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26c4158f00 msgr2=0x7f26c40cc340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T04:02:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.101+0000 7f26c2d9d700 1 --2- 172.21.15.16:0/361106907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26c4158f00 0x7f26c40cc340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.101+0000 7f26c2d9d700 1 -- 172.21.15.16:0/361106907 >> v2:172.21.15.169:3300/0 conn(0x7f26c414f560 msgr2=0x7f26c41589c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T04:02:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.101+0000 7f26c2d9d700 1 --2- 172.21.15.16:0/361106907 >> v2:172.21.15.169:3300/0 conn(0x7f26c414f560 0x7f26c41589c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.101+0000 7f26c2d9d700 1 -- 172.21.15.16:0/361106907 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c406c650 con 0x7f26c40cc880 2023-06-08T04:02:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.102+0000 7f26c2d9d700 1 --2- 172.21.15.16:0/361106907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26c40cc880 0x7f26c4070280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f26c40714d0 tx=0x7f26b8008bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6868f3cfe70586 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.110+0000 7f26c159a700 1 -- 172.21.15.16:0/361106907 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800b820 con 0x7f26c40cc880 2023-06-08T04:02:05.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.110+0000 7f26c159a700 1 -- 172.21.15.16:0/361106907 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b800b980 con 0x7f26c40cc880 2023-06-08T04:02:05.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.110+0000 7f26c159a700 1 -- 172.21.15.16:0/361106907 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b80126f0 con 0x7f26c40cc880 2023-06-08T04:02:05.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.111+0000 7f26c8fff700 1 -- 172.21.15.16:0/361106907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26c40cc880 msgr2=0x7f26c4070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.111+0000 7f26c8fff700 1 --2- 172.21.15.16:0/361106907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26c40cc880 0x7f26c4070280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f26c40714d0 tx=0x7f26b8008bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.111+0000 7f26c8fff700 1 -- 172.21.15.16:0/361106907 shutdown_connections 2023-06-08T04:02:05.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.111+0000 7f26c8fff700 1 --2- 172.21.15.16:0/361106907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26c40cc880 0x7f26c4070280 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.111+0000 7f26c8fff700 1 --2- 172.21.15.16:0/361106907 >> v2:172.21.15.169:3300/0 conn(0x7f26c414f560 0x7f26c41589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.111+0000 7f26c8fff700 1 --2- 172.21.15.16:0/361106907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26c4158f00 0x7f26c40cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.111+0000 7f26c8fff700 1 -- 172.21.15.16:0/361106907 >> 172.21.15.16:0/361106907 conn(0x7f26c406aa30 msgr2=0x7f26c40b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.112+0000 7f26c8fff700 1 -- 172.21.15.16:0/361106907 shutdown_connections 2023-06-08T04:02:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.112+0000 7f26c8fff700 1 -- 172.21.15.16:0/361106907 wait complete. 2023-06-08T04:02:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.115+0000 7f26c8fff700 1 Processor -- start 2023-06-08T04:02:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.116+0000 7f26c8fff700 1 -- start start 2023-06-08T04:02:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.118+0000 7f26c8fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26c40cc880 0x7f26c40c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.118+0000 7f26c8fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26c414f560 0x7f26c4152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.118+0000 7f26c8fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c4158f00 0x7f26c40c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.118+0000 7f26c8fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40c3890 con 0x7f26c40cc880 2023-06-08T04:02:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.118+0000 7f26c8fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40c4390 con 0x7f26c4158f00 2023-06-08T04:02:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.118+0000 7f26c8fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40c3ad0 con 0x7f26c414f560 2023-06-08T04:02:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.119+0000 7f26c1d9b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26c414f560 0x7f26c4152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.119+0000 7f26c1d9b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26c414f560 0x7f26c4152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:55156/0 (socket says 172.21.15.16:55156) 2023-06-08T04:02:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.119+0000 7f26c1d9b700 1 -- 172.21.15.16:0/2645941213 learned_addr learned my addr 172.21.15.16:0/2645941213 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:05.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.119+0000 7f26c2d9d700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c4158f00 0x7f26c40c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.119+0000 7f26c1d9b700 1 -- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c4158f00 msgr2=0x7f26c40c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.119+0000 7f26c1d9b700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c4158f00 0x7f26c40c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.119+0000 7f26c1d9b700 1 -- 172.21.15.16:0/2645941213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26c40cc880 msgr2=0x7f26c40c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.119+0000 7f26c1d9b700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26c40cc880 0x7f26c40c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.119+0000 7f26c1d9b700 1 -- 172.21.15.16:0/2645941213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b80085d0 con 0x7f26c414f560 2023-06-08T04:02:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.120+0000 7f26c1d9b700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26c414f560 0x7f26c4152fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00b9e0 tx=0x7f26bc00bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.123+0000 7f26b2ffd700 1 -- 172.21.15.16:0/2645941213 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00ca30 con 0x7f26c414f560 2023-06-08T04:02:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.123+0000 7f26b2ffd700 1 -- 172.21.15.16:0/2645941213 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc00cb90 con 0x7f26c414f560 2023-06-08T04:02:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.123+0000 7f26b2ffd700 1 -- 172.21.15.16:0/2645941213 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc014440 con 0x7f26c414f560 2023-06-08T04:02:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.123+0000 7f26c8fff700 1 -- 172.21.15.16:0/2645941213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c40c1600 con 0x7f26c414f560 2023-06-08T04:02:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.124+0000 7f26c8fff700 1 -- 172.21.15.16:0/2645941213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c40c4020 con 0x7f26c414f560 2023-06-08T04:02:05.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.128+0000 7f26b2ffd700 1 -- 172.21.15.16:0/2645941213 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26bc0145a0 con 0x7f26c414f560 2023-06-08T04:02:05.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.130+0000 7f26b2ffd700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f26a406adb0 0x7f26a406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:05.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.130+0000 7f26b2ffd700 1 -- 172.21.15.16:0/2645941213 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26bc0891c0 con 0x7f26c414f560 2023-06-08T04:02:05.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.131+0000 7f26c8fff700 1 -- 172.21.15.16:0/2645941213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a80052e0 con 0x7f26c414f560 2023-06-08T04:02:05.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.131+0000 7f26c259c700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f26a406adb0 0x7f26a406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:05.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.132+0000 7f26c259c700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f26a406adb0 0x7f26a406d260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009770 tx=0x7f26b4006cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:05.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.137+0000 7f26b2ffd700 1 -- 172.21.15.16:0/2645941213 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f26bc054310 con 0x7f26c414f560 2023-06-08T04:02:05.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.458+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3033137462 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb3ec0c4430 con 0x7fb3ec070990 2023-06-08T04:02:05.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.462+0000 7fb3e1ffb700 1 -- 172.21.15.16:0/3033137462 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb3ec0c4430 con 0x7fb3ec070990 2023-06-08T04:02:05.467 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2023-06-08T04:02:05.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.466+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb3d006adb0 msgr2=0x7fb3d006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.466+0000 7fb3f39ff700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb3d006adb0 0x7fb3d006d260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009440 tx=0x7fb3e4009000 comp rx=0 tx=0).stop 2023-06-08T04:02:05.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.466+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3ec070990 msgr2=0x7fb3ec0c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.466+0000 7fb3f39ff700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3ec070990 0x7fb3ec0c30e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec089a40 tx=0x7fb3e800b750 comp rx=0 tx=0).stop 2023-06-08T04:02:05.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.466+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3033137462 shutdown_connections 2023-06-08T04:02:05.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.466+0000 7fb3f39ff700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb3d006adb0 0x7fb3d006d260 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.466+0000 7fb3f39ff700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3ec089650 0x7fb3ec0c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.466+0000 7fb3f39ff700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3ec06dba0 0x7fb3ec0c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.466+0000 7fb3f39ff700 1 --2- 172.21.15.16:0/3033137462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3ec070990 0x7fb3ec0c30e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.466+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3033137462 >> 172.21.15.16:0/3033137462 conn(0x7fb3ec06aa30 msgr2=0x7fb3ec16ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.467+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3033137462 shutdown_connections 2023-06-08T04:02:05.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.467+0000 7fb3f39ff700 1 -- 172.21.15.16:0/3033137462 wait complete. 2023-06-08T04:02:05.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.479+0000 7fd0555ff700 1 -- 172.21.15.16:0/2775350891 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd030005590 con 0x7fd0501606b0 2023-06-08T04:02:05.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.480+0000 7fd0377fe700 1 -- 172.21.15.16:0/2775350891 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd040017090 con 0x7fd0501606b0 2023-06-08T04:02:05.487 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2023-06-08T04:02:05.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7fd0555ff700 1 -- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd03c06adb0 msgr2=0x7fd03c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7fd0555ff700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd03c06adb0 0x7fd03c06d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd044000f60 tx=0x7fd044004a50 comp rx=0 tx=0).stop 2023-06-08T04:02:05.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7fd0555ff700 1 -- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0501606b0 msgr2=0x7fd0500b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7fd0555ff700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0501606b0 0x7fd0500b1b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd04000e810 tx=0x7fd04000eb20 comp rx=0 tx=0).stop 2023-06-08T04:02:05.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7f55a5bff700 1 -- 172.21.15.16:0/614490022 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f55a00740e0 con 0x7f55a015b730 2023-06-08T04:02:05.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7fd0555ff700 1 -- 172.21.15.16:0/2775350891 shutdown_connections 2023-06-08T04:02:05.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7fd0555ff700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd03c06adb0 0x7fd03c06d260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7fd0555ff700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0501606b0 0x7fd0500b1b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7fd0555ff700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0500b0e40 0x7fd05015aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7fd0555ff700 1 --2- 172.21.15.16:0/2775350891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0500ce020 0x7fd0500c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7fd0555ff700 1 -- 172.21.15.16:0/2775350891 >> 172.21.15.16:0/2775350891 conn(0x7fd05006aa40 msgr2=0x7fd0500c8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.485+0000 7fd0555ff700 1 -- 172.21.15.16:0/2775350891 shutdown_connections 2023-06-08T04:02:05.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.485+0000 7fd0555ff700 1 -- 172.21.15.16:0/2775350891 wait complete. 2023-06-08T04:02:05.490 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2023-06-08T04:02:05.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.484+0000 7f558ffff700 1 -- 172.21.15.16:0/614490022 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5590015020 con 0x7f55a015b730 2023-06-08T04:02:05.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.488+0000 7f55a5bff700 1 -- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f558406ad00 msgr2=0x7f558406d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.488+0000 7f55a5bff700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f558406ad00 0x7f558406d1b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f55980113e0 tx=0x7f559800b040 comp rx=0 tx=0).stop 2023-06-08T04:02:05.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.488+0000 7f55a5bff700 1 -- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55a015b730 msgr2=0x7f55a00c4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.488+0000 7f55a5bff700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55a015b730 0x7f55a00c4470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5590009b60 tx=0x7f5590004750 comp rx=0 tx=0).stop 2023-06-08T04:02:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.488+0000 7f55a5bff700 1 -- 172.21.15.16:0/614490022 shutdown_connections 2023-06-08T04:02:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.488+0000 7f55a5bff700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f558406ad00 0x7f558406d1b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.488+0000 7f55a5bff700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55a015b730 0x7f55a00c4470 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.488+0000 7f55a5bff700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55a006e370 0x7f55a00ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.488+0000 7f55a5bff700 1 --2- 172.21.15.16:0/614490022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55a00cc340 0x7f55a0146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.488+0000 7f55a5bff700 1 -- 172.21.15.16:0/614490022 >> 172.21.15.16:0/614490022 conn(0x7f55a006aa40 msgr2=0x7f55a006d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.489+0000 7f55a5bff700 1 -- 172.21.15.16:0/614490022 shutdown_connections 2023-06-08T04:02:05.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.489+0000 7f55a5bff700 1 -- 172.21.15.16:0/614490022 wait complete. 2023-06-08T04:02:05.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.491+0000 7f3573dff700 1 -- 172.21.15.16:0/411567802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f356c0cbf40 con 0x7f356c0b0a70 2023-06-08T04:02:05.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.491+0000 7f35627fc700 1 -- 172.21.15.16:0/411567802 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3568057910 con 0x7f356c0b0a70 2023-06-08T04:02:05.495 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2023-06-08T04:02:05.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.495+0000 7f3573dff700 1 -- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f355006adb0 msgr2=0x7f355006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.495+0000 7f3573dff700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f355006adb0 0x7f355006d260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f356c0b48e0 tx=0x7f355c008030 comp rx=0 tx=0).stop 2023-06-08T04:02:05.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.495+0000 7f3573dff700 1 -- 172.21.15.16:0/411567802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f356c0b0a70 msgr2=0x7f356c14fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.495+0000 7f3573dff700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f356c0b0a70 0x7f356c14fa50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f356800b3c0 tx=0x7f356800b6d0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.495+0000 7f3573dff700 1 -- 172.21.15.16:0/411567802 shutdown_connections 2023-06-08T04:02:05.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.495+0000 7f3573dff700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f355006adb0 0x7f355006d260 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.495+0000 7f3573dff700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f356c14f560 0x7f356c0af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.495+0000 7f3573dff700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f356c0b0a70 0x7f356c14fa50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.495+0000 7f3573dff700 1 --2- 172.21.15.16:0/411567802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f356c0cc880 0x7f356c0c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.495+0000 7f3573dff700 1 -- 172.21.15.16:0/411567802 >> 172.21.15.16:0/411567802 conn(0x7f356c06aa30 msgr2=0x7f356c070180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.0 2023-06-08T04:02:05.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.500+0000 7f3573dff700 1 -- 172.21.15.16:0/411567802 shutdown_connections 2023-06-08T04:02:05.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.501+0000 7f1b329ff700 1 -- 172.21.15.16:0/3270277974 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1b2c0740e0 con 0x7f1b2c156a80 2023-06-08T04:02:05.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.501+0000 7f1b28ff9700 1 -- 172.21.15.16:0/3270277974 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b2405a140 con 0x7f1b2c156a80 2023-06-08T04:02:05.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.500+0000 7f3573dff700 1 -- 172.21.15.16:0/411567802 wait complete. 2023-06-08T04:02:05.506 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2023-06-08T04:02:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.504+0000 7f1b329ff700 1 -- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1b1806adb0 msgr2=0x7f1b1806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.504+0000 7f1b329ff700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1b1806adb0 0x7f1b1806d260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c065d00 tx=0x7f1b20008040 comp rx=0 tx=0).stop 2023-06-08T04:02:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.504+0000 7f1b329ff700 1 -- 172.21.15.16:0/3270277974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b2c156a80 msgr2=0x7f1b2c1555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.504+0000 7f1b329ff700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b2c156a80 0x7f1b2c1555d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b24014040 tx=0x7f1b24004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.504+0000 7f1b329ff700 1 -- 172.21.15.16:0/3270277974 shutdown_connections 2023-06-08T04:02:05.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.504+0000 7f1b329ff700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1b1806adb0 0x7f1b1806d260 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c065d00 tx=0x7f1b20008040 comp rx=0 tx=0).stop 2023-06-08T04:02:05.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.504+0000 7f1b329ff700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b2c156a80 0x7f1b2c1555d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.504+0000 7f1b329ff700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b2c0cf030 0x7f1b2c160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.504+0000 7f1b329ff700 1 --2- 172.21.15.16:0/3270277974 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b2c0d3170 0x7f1b2c155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.504+0000 7f1b329ff700 1 -- 172.21.15.16:0/3270277974 >> 172.21.15.16:0/3270277974 conn(0x7f1b2c06b2e0 msgr2=0x7f1b2c0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.505+0000 7f1b329ff700 1 -- 172.21.15.16:0/3270277974 shutdown_connections 2023-06-08T04:02:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.505+0000 7f1b329ff700 1 -- 172.21.15.16:0/3270277974 wait complete. 2023-06-08T04:02:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.506+0000 7f01879ff700 1 -- 172.21.15.16:0/2354468990 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f01800740e0 con 0x7f01800b4b50 2023-06-08T04:02:05.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.506+0000 7f0175ffb700 1 -- 172.21.15.16:0/2354468990 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f017c021020 con 0x7f01800b4b50 2023-06-08T04:02:05.513 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2023-06-08T04:02:05.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.510+0000 7f01879ff700 1 -- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f016406ace0 msgr2=0x7f016406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.510+0000 7f01879ff700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f016406ace0 0x7f016406d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0180160e30 tx=0x7f0170009210 comp rx=0 tx=0).stop 2023-06-08T04:02:05.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.510+0000 7f01879ff700 1 -- 172.21.15.16:0/2354468990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01800b4b50 msgr2=0x7f01800cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.510+0000 7f01879ff700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01800b4b50 0x7f01800cc500 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f017c0090b0 tx=0x7f017c004750 comp rx=0 tx=0).stop 2023-06-08T04:02:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.511+0000 7f01879ff700 1 -- 172.21.15.16:0/2354468990 shutdown_connections 2023-06-08T04:02:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.511+0000 7f01879ff700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f016406ace0 0x7f016406d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.511+0000 7f01879ff700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800ced40 0x7f0180160690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.511+0000 7f01879ff700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01800b4b50 0x7f01800cc500 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.511+0000 7f01879ff700 1 --2- 172.21.15.16:0/2354468990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800b83f0 0x7f0180160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.511+0000 7f01879ff700 1 -- 172.21.15.16:0/2354468990 >> 172.21.15.16:0/2354468990 conn(0x7f01800cf610 msgr2=0x7f01800cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.511+0000 7f01879ff700 1 -- 172.21.15.16:0/2354468990 shutdown_connections 2023-06-08T04:02:05.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.511+0000 7f01879ff700 1 -- 172.21.15.16:0/2354468990 wait complete. 2023-06-08T04:02:05.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.3 2023-06-08T04:02:05.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.522+0000 7f58f0dff700 1 -- 172.21.15.16:0/3513810140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f58ec1ea300 con 0x7f58ec0b2b20 2023-06-08T04:02:05.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.523+0000 7f58e2ffd700 1 -- 172.21.15.16:0/3513810140 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58ec1ea300 con 0x7f58ec0b2b20 2023-06-08T04:02:05.527 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2023-06-08T04:02:05.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.525+0000 7f58f0dff700 1 -- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f58cc06ad60 msgr2=0x7f58cc06d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.525+0000 7f58f0dff700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f58cc06ad60 0x7f58cc06d210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f58e40056b0 tx=0x7f58e4005640 comp rx=0 tx=0).stop 2023-06-08T04:02:05.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.525+0000 7f58f0dff700 1 -- 172.21.15.16:0/3513810140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ec0b2b20 msgr2=0x7f58ec0c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.525+0000 7f58f0dff700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ec0b2b20 0x7f58ec0c49b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f58d400b4d0 tx=0x7f58d400b7e0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.526+0000 7f58f0dff700 1 -- 172.21.15.16:0/3513810140 shutdown_connections 2023-06-08T04:02:05.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.526+0000 7f58f0dff700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f58cc06ad60 0x7f58cc06d210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.526+0000 7f58f0dff700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ec160640 0x7f58ec0c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.526+0000 7f58f0dff700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f58ec070b70 0x7f58ec156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.526+0000 7f58f0dff700 1 --2- 172.21.15.16:0/3513810140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ec0b2b20 0x7f58ec0c49b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.526+0000 7f58f0dff700 1 -- 172.21.15.16:0/3513810140 >> 172.21.15.16:0/3513810140 conn(0x7f58ec06e4f0 msgr2=0x7f58ec15fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.526+0000 7f58f0dff700 1 -- 172.21.15.16:0/3513810140 shutdown_connections 2023-06-08T04:02:05.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.526+0000 7f58f0dff700 1 -- 172.21.15.16:0/3513810140 wait complete. 2023-06-08T04:02:05.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.5 2023-06-08T04:02:05.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.7 2023-06-08T04:02:05.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.2 2023-06-08T04:02:05.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.1 2023-06-08T04:02:05.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2023-06-08T04:02:05.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.561+0000 7f26c8fff700 1 -- 172.21.15.16:0/2645941213 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f26a8005590 con 0x7f26c414f560 2023-06-08T04:02:05.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.562+0000 7f26b2ffd700 1 -- 172.21.15.16:0/2645941213 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26bc019030 con 0x7f26c414f560 2023-06-08T04:02:05.566 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2023-06-08T04:02:05.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 -- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f26a406adb0 msgr2=0x7f26a406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f26a406adb0 0x7f26a406d260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009770 tx=0x7f26b4006cd0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 -- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26c414f560 msgr2=0x7f26c4152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:05.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26c414f560 0x7f26c4152fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00b9e0 tx=0x7f26bc00bda0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 -- 172.21.15.16:0/2645941213 shutdown_connections 2023-06-08T04:02:05.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f26a406adb0 0x7f26a406d260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c4158f00 0x7f26c40c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26c40cc880 0x7f26c40c10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 --2- 172.21.15.16:0/2645941213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f26c414f560 0x7f26c4152fa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:05.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 -- 172.21.15.16:0/2645941213 >> 172.21.15.16:0/2645941213 conn(0x7f26c406aa30 msgr2=0x7f26c415aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:05.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 -- 172.21.15.16:0/2645941213 shutdown_connections 2023-06-08T04:02:05.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:05.564+0000 7f26c8fff700 1 -- 172.21.15.16:0/2645941213 wait complete. 2023-06-08T04:02:05.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.6 2023-06-08T04:02:06.505 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-08T04:02:06.524 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-08T04:02:06.535 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-08T04:02:06.535 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-08T04:02:06.541 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-08T04:02:06.544 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-08T04:02:06.553 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-08T04:02:06.586 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-08T04:02:06.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.833+0000 7f5da9dff700 1 Processor -- start 2023-06-08T04:02:06.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.833+0000 7f5da9dff700 1 -- start start 2023-06-08T04:02:06.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.835+0000 7f5da9dff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5da41608e0 0x7f5da40cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.835+0000 7f5da9dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5da40ce020 0x7f5da4070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.835+0000 7f5da9dff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5da40707c0 0x7f5da41642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.835+0000 7f5da9dff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da40ce490 con 0x7f5da40707c0 2023-06-08T04:02:06.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.835+0000 7f5da9dff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da4070c40 con 0x7f5da41608e0 2023-06-08T04:02:06.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.835+0000 7f5da9dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4071050 con 0x7f5da40ce020 2023-06-08T04:02:06.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.837+0000 7f5da37fe700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5da41608e0 0x7f5da40cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.838+0000 7f5da2ffd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5da40ce020 0x7f5da4070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.838+0000 7f5da37fe700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5da41608e0 0x7f5da40cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56420/0 (socket says 172.21.15.16:56420) 2023-06-08T04:02:06.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.838+0000 7f5da37fe700 1 -- 172.21.15.16:0/2424906173 learned_addr learned my addr 172.21.15.16:0/2424906173 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:06.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.838+0000 7f5da37fe700 1 -- 172.21.15.16:0/2424906173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5da40ce020 msgr2=0x7f5da4070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:06.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.838+0000 7f5da37fe700 1 --2- 172.21.15.16:0/2424906173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5da40ce020 0x7f5da4070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.838+0000 7f5da37fe700 1 -- 172.21.15.16:0/2424906173 >> v2:172.21.15.16:3300/0 conn(0x7f5da40707c0 msgr2=0x7f5da41642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:06.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.838+0000 7f5da37fe700 1 --2- 172.21.15.16:0/2424906173 >> v2:172.21.15.16:3300/0 conn(0x7f5da40707c0 0x7f5da41642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.838+0000 7f5da37fe700 1 -- 172.21.15.16:0/2424906173 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da40cc9b0 con 0x7f5da41608e0 2023-06-08T04:02:06.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.839+0000 7f5da37fe700 1 --2- 172.21.15.16:0/2424906173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5da41608e0 0x7f5da40cc340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5da40cc2f0 tx=0x7f5d9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9150a64846698b0f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.840+0000 7f5da27fc700 1 -- 172.21.15.16:0/2424906173 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00e070 con 0x7f5da41608e0 2023-06-08T04:02:06.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.840+0000 7f5da27fc700 1 -- 172.21.15.16:0/2424906173 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c00b910 con 0x7f5da41608e0 2023-06-08T04:02:06.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.840+0000 7f5da27fc700 1 -- 172.21.15.16:0/2424906173 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00bcc0 con 0x7f5da41608e0 2023-06-08T04:02:06.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.841+0000 7f5da9dff700 1 -- 172.21.15.16:0/2424906173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5da41608e0 msgr2=0x7f5da40cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.841+0000 7f5da9dff700 1 --2- 172.21.15.16:0/2424906173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5da41608e0 0x7f5da40cc340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5da40cc2f0 tx=0x7f5d9c00b330 comp rx=0 tx=0).stop 2023-06-08T04:02:06.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.845+0000 7f5da9dff700 1 -- 172.21.15.16:0/2424906173 shutdown_connections 2023-06-08T04:02:06.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.845+0000 7f5da9dff700 1 --2- 172.21.15.16:0/2424906173 >> v2:172.21.15.16:3300/0 conn(0x7f5da40707c0 0x7f5da41642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.845+0000 7f5da9dff700 1 --2- 172.21.15.16:0/2424906173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5da41608e0 0x7f5da40cc340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.845+0000 7f5da9dff700 1 --2- 172.21.15.16:0/2424906173 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5da40ce020 0x7f5da4070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.845+0000 7f5da9dff700 1 -- 172.21.15.16:0/2424906173 >> 172.21.15.16:0/2424906173 conn(0x7f5da406aa30 msgr2=0x7f5da40b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:06.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.845+0000 7f5da9dff700 1 -- 172.21.15.16:0/2424906173 shutdown_connections 2023-06-08T04:02:06.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.845+0000 7f5da9dff700 1 -- 172.21.15.16:0/2424906173 wait complete. 2023-06-08T04:02:06.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.848+0000 7f5da9dff700 1 Processor -- start 2023-06-08T04:02:06.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.848+0000 7f5da9dff700 1 -- start start 2023-06-08T04:02:06.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.850+0000 7f5da9dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5da40707c0 0x7f5da40c2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.850+0000 7f5da9dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da40ce020 0x7f5da415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.850+0000 7f5da9dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5da41608e0 0x7f5da40c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.850+0000 7f5da9dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40c37f0 con 0x7f5da40ce020 2023-06-08T04:02:06.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.850+0000 7f5da9dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40c2940 con 0x7f5da40707c0 2023-06-08T04:02:06.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.850+0000 7f5da9dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da40c2be0 con 0x7f5da41608e0 2023-06-08T04:02:06.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.851+0000 7f5da37fe700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5da40707c0 0x7f5da40c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.851+0000 7f5da2ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da40ce020 0x7f5da415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.851+0000 7f5da37fe700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5da40707c0 0x7f5da40c2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56434/0 (socket says 172.21.15.16:56434) 2023-06-08T04:02:06.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.851+0000 7f5da37fe700 1 -- 172.21.15.16:0/1307297957 learned_addr learned my addr 172.21.15.16:0/1307297957 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:06.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.852+0000 7f5da37fe700 1 -- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5da41608e0 msgr2=0x7f5da40c46a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-08T04:02:06.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.852+0000 7f5da37fe700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5da41608e0 0x7f5da40c46a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.852+0000 7f5da37fe700 1 -- 172.21.15.16:0/1307297957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da40ce020 msgr2=0x7f5da415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.852+0000 7f5da37fe700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da40ce020 0x7f5da415f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.852+0000 7f5da37fe700 1 -- 172.21.15.16:0/1307297957 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c009b30 con 0x7f5da40707c0 2023-06-08T04:02:06.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.855+0000 7f5da37fe700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5da40707c0 0x7f5da40c2400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5da40ce5d0 tx=0x7f5d9c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.856+0000 7f5d93fff700 1 -- 172.21.15.16:0/1307297957 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0099b0 con 0x7f5da40707c0 2023-06-08T04:02:06.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.856+0000 7f5d93fff700 1 -- 172.21.15.16:0/1307297957 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c004250 con 0x7f5da40707c0 2023-06-08T04:02:06.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.856+0000 7f5d93fff700 1 -- 172.21.15.16:0/1307297957 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c004600 con 0x7f5da40707c0 2023-06-08T04:02:06.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.856+0000 7f5da9dff700 1 -- 172.21.15.16:0/1307297957 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da40c2ec0 con 0x7f5da40707c0 2023-06-08T04:02:06.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.856+0000 7f5da9dff700 1 -- 172.21.15.16:0/1307297957 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da40c3480 con 0x7f5da40707c0 2023-06-08T04:02:06.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.860+0000 7f5d93fff700 1 -- 172.21.15.16:0/1307297957 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d9c004760 con 0x7f5da40707c0 2023-06-08T04:02:06.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.860+0000 7f5da9dff700 1 -- 172.21.15.16:0/1307297957 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d800052e0 con 0x7f5da40707c0 2023-06-08T04:02:06.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.861+0000 7f5d93fff700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d8806ad80 0x7f5d8806d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.862+0000 7f5d93fff700 1 -- 172.21.15.16:0/1307297957 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d9c0ac970 con 0x7f5da40707c0 2023-06-08T04:02:06.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.862+0000 7f5da2ffd700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d8806ad80 0x7f5d8806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.865+0000 7f5da2ffd700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d8806ad80 0x7f5d8806d230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5da41594c0 tx=0x7f5d98009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.868+0000 7f5d93fff700 1 -- 172.21.15.16:0/1307297957 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5d9c077a10 con 0x7f5da40707c0 2023-06-08T04:02:06.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.902+0000 7fa1549ff700 1 Processor -- start 2023-06-08T04:02:06.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.902+0000 7fa1549ff700 1 -- start start 2023-06-08T04:02:06.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.904+0000 7fa1549ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa150070990 0x7fa1500cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.904+0000 7fa1549ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa1500ce020 0x7fa15006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.905+0000 7fa1549ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1500ce460 con 0x7fa1501608e0 2023-06-08T04:02:06.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.905+0000 7fa1549ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa150071050 con 0x7fa150070990 2023-06-08T04:02:06.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.905+0000 7fa1549ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1500cc9b0 con 0x7fa1500ce020 2023-06-08T04:02:06.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.906+0000 7fa14e59c700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fa1501608e0 0x7fa150070280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:43126/0 (socket says 172.21.15.16:43126) 2023-06-08T04:02:06.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.906+0000 7fa14e59c700 1 -- 172.21.15.16:0/3506603732 learned_addr learned my addr 172.21.15.16:0/3506603732 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:06.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.906+0000 7fa14dd9b700 1 --2- 172.21.15.16:0/3506603732 >> v2:172.21.15.16:3300/0 conn(0x7fa150070990 0x7fa1500cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.906+0000 7fa14ed9d700 1 --2- 172.21.15.16:0/3506603732 >> v2:172.21.15.169:3300/0 conn(0x7fa1500ce020 0x7fa15006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.907+0000 7fa14d59a700 1 -- 172.21.15.16:0/3506603732 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862041832 0 0) 0x7fa148001490 con 0x7fa1501608e0 2023-06-08T04:02:06.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.907+0000 7fa14d59a700 1 -- 172.21.15.16:0/3506603732 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1380035b0 con 0x7fa1501608e0 2023-06-08T04:02:06.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.907+0000 7fa14ed9d700 1 -- 172.21.15.16:0/3506603732 >> v2:172.21.15.16:3300/0 conn(0x7fa150070990 msgr2=0x7fa1500cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:06.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.907+0000 7fa14ed9d700 1 --2- 172.21.15.16:0/3506603732 >> v2:172.21.15.16:3300/0 conn(0x7fa150070990 0x7fa1500cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.907+0000 7fa14ed9d700 1 -- 172.21.15.16:0/3506603732 >> v1:172.21.15.169:6789/0 conn(0x7fa1501608e0 legacy=0x7fa150070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.907+0000 7fa14ed9d700 1 -- 172.21.15.16:0/3506603732 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa150160cb0 con 0x7fa1500ce020 2023-06-08T04:02:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.908+0000 7f49043ff700 1 Processor -- start 2023-06-08T04:02:06.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.908+0000 7f49043ff700 1 -- start start 2023-06-08T04:02:06.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.910+0000 7f49043ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f48fc06e370 0x7f48fc158780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.910+0000 7f49043ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f48fc15b910 0x7f48fc15c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.910+0000 7f49043ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48fc06dee0 con 0x7f48fc0cc340 2023-06-08T04:02:06.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.910+0000 7f49043ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48fc1598e0 con 0x7f48fc06e370 2023-06-08T04:02:06.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.910+0000 7f49043ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48fc159c30 con 0x7f48fc15b910 2023-06-08T04:02:06.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.911+0000 7f490199a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f48fc15b910 0x7f48fc15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.911+0000 7f490199a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f48fc15b910 0x7f48fc15c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56458/0 (socket says 172.21.15.16:56458) 2023-06-08T04:02:06.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.911+0000 7f490199a700 1 -- 172.21.15.16:0/557744580 learned_addr learned my addr 172.21.15.16:0/557744580 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:06.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.911+0000 7f490299c700 1 --1- 172.21.15.16:0/557744580 >> v1:172.21.15.169:6789/0 conn(0x7f48fc0cc340 0x7f48fc070280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:43130/0 (socket says 172.21.15.16:43130) 2023-06-08T04:02:06.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.912+0000 7f490219b700 1 --2- 172.21.15.16:0/557744580 >> v2:172.21.15.16:3300/0 conn(0x7f48fc06e370 0x7f48fc158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.912+0000 7f490199a700 1 -- 172.21.15.16:0/557744580 >> v2:172.21.15.16:3300/0 conn(0x7f48fc06e370 msgr2=0x7f48fc158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:06.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.912+0000 7f490199a700 1 --2- 172.21.15.16:0/557744580 >> v2:172.21.15.16:3300/0 conn(0x7f48fc06e370 0x7f48fc158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.912+0000 7f490199a700 1 -- 172.21.15.16:0/557744580 >> v1:172.21.15.169:6789/0 conn(0x7f48fc0cc340 legacy=0x7f48fc070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.912+0000 7f490199a700 1 -- 172.21.15.16:0/557744580 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc158d60 con 0x7f48fc15b910 2023-06-08T04:02:06.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.912+0000 7f490219b700 1 --2- 172.21.15.16:0/557744580 >> v2:172.21.15.16:3300/0 conn(0x7f48fc06e370 0x7f48fc158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:06.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.912+0000 7f490199a700 1 --2- 172.21.15.16:0/557744580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48fc15b910 0x7f48fc15c800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0cdc00 tx=0x7f48f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a867cba5cb5d70c server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.913+0000 7fa14ed9d700 1 --2- 172.21.15.16:0/3506603732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1500ce020 0x7fa15006c000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1500cc180 tx=0x7fa144009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfbda263f6eceec6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.913+0000 7f4901199700 1 -- 172.21.15.16:0/557744580 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f400e070 con 0x7f48fc15b910 2023-06-08T04:02:06.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.913+0000 7f4901199700 1 -- 172.21.15.16:0/557744580 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f400b9c0 con 0x7f48fc15b910 2023-06-08T04:02:06.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.913+0000 7f4901199700 1 -- 172.21.15.16:0/557744580 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f400bd70 con 0x7f48fc15b910 2023-06-08T04:02:06.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.913+0000 7fa14d59a700 1 -- 172.21.15.16:0/3506603732 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144011830 con 0x7fa1500ce020 2023-06-08T04:02:06.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.913+0000 7fa14d59a700 1 -- 172.21.15.16:0/3506603732 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144011990 con 0x7fa1500ce020 2023-06-08T04:02:06.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.913+0000 7fa14d59a700 1 -- 172.21.15.16:0/3506603732 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144011d20 con 0x7fa1500ce020 2023-06-08T04:02:06.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.914+0000 7f49043ff700 1 -- 172.21.15.16:0/557744580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48fc15b910 msgr2=0x7f48fc15c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.914+0000 7f49043ff700 1 --2- 172.21.15.16:0/557744580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48fc15b910 0x7f48fc15c800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0cdc00 tx=0x7f48f400b330 comp rx=0 tx=0).stop 2023-06-08T04:02:06.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.914+0000 7f49043ff700 1 -- 172.21.15.16:0/557744580 shutdown_connections 2023-06-08T04:02:06.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.914+0000 7f49043ff700 1 --2- 172.21.15.16:0/557744580 >> v2:172.21.15.16:3300/0 conn(0x7f48fc06e370 0x7f48fc158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.914+0000 7f49043ff700 1 --2- 172.21.15.16:0/557744580 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48fc15b910 0x7f48fc15c800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.914+0000 7f49043ff700 1 -- 172.21.15.16:0/557744580 >> 172.21.15.16:0/557744580 conn(0x7f48fc06aa40 msgr2=0x7f48fc0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:06.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.915+0000 7fa1549ff700 1 -- 172.21.15.16:0/3506603732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1500ce020 msgr2=0x7fa15006c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.915+0000 7fa1549ff700 1 --2- 172.21.15.16:0/3506603732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1500ce020 0x7fa15006c000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1500cc180 tx=0x7fa144009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:06.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.915+0000 7f49043ff700 1 -- 172.21.15.16:0/557744580 shutdown_connections 2023-06-08T04:02:06.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.915+0000 7f49043ff700 1 -- 172.21.15.16:0/557744580 wait complete. 2023-06-08T04:02:06.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.915+0000 7fa1549ff700 1 -- 172.21.15.16:0/3506603732 shutdown_connections 2023-06-08T04:02:06.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.915+0000 7fa1549ff700 1 --2- 172.21.15.16:0/3506603732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1500ce020 0x7fa15006c000 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.915+0000 7fa1549ff700 1 --2- 172.21.15.16:0/3506603732 >> v2:172.21.15.16:3300/0 conn(0x7fa150070990 0x7fa1500cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.915+0000 7fa1549ff700 1 -- 172.21.15.16:0/3506603732 >> 172.21.15.16:0/3506603732 conn(0x7fa15006aa30 msgr2=0x7fa1500b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:06.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.917+0000 7f49043ff700 1 Processor -- start 2023-06-08T04:02:06.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.918+0000 7f49043ff700 1 -- start start 2023-06-08T04:02:06.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.919+0000 7f49043ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48fc06e370 0x7f48fc14bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.919+0000 7f49043ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48fc0cc340 0x7f48fc1554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.919+0000 7f49043ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48fc15b910 0x7f48fc1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.919+0000 7f49043ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc151070 con 0x7f48fc0cc340 2023-06-08T04:02:06.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.919+0000 7f49043ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0c4a40 con 0x7f48fc06e370 2023-06-08T04:02:06.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.919+0000 7f49043ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0c4d20 con 0x7f48fc15b910 2023-06-08T04:02:06.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.916+0000 7fa1549ff700 1 -- 172.21.15.16:0/3506603732 shutdown_connections 2023-06-08T04:02:06.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.916+0000 7fa1549ff700 1 -- 172.21.15.16:0/3506603732 wait complete. 2023-06-08T04:02:06.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.918+0000 7fa1549ff700 1 Processor -- start 2023-06-08T04:02:06.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.919+0000 7fa1549ff700 1 -- start start 2023-06-08T04:02:06.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.915+0000 7f17393ff700 1 Processor -- start 2023-06-08T04:02:06.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.916+0000 7f17393ff700 1 -- start start 2023-06-08T04:02:06.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.917+0000 7f17393ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f173415b9a0 0x7f1734158780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.917+0000 7f17393ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f17340cca50 0x7f173406c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.918+0000 7f17393ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173406dee0 con 0x7f173415c800 2023-06-08T04:02:06.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.918+0000 7f17393ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17341598e0 con 0x7f17340cca50 2023-06-08T04:02:06.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.918+0000 7f17393ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1734159c30 con 0x7f173415b9a0 2023-06-08T04:02:06.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.919+0000 7f17337fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f17340cca50 0x7f173406c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.919+0000 7f17337fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f17340cca50 0x7f173406c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42248/0 (socket says 172.21.15.16:42248) 2023-06-08T04:02:06.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.919+0000 7f17337fe700 1 -- 172.21.15.16:0/3208380989 learned_addr learned my addr 172.21.15.16:0/3208380989 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:06.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.920+0000 7f17337fe700 1 -- 172.21.15.16:0/3208380989 >> v2:172.21.15.169:3300/0 conn(0x7f173415b9a0 msgr2=0x7f1734158780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T04:02:06.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.920+0000 7f17337fe700 1 --2- 172.21.15.16:0/3208380989 >> v2:172.21.15.169:3300/0 conn(0x7f173415b9a0 0x7f1734158780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.920+0000 7f17337fe700 1 -- 172.21.15.16:0/3208380989 >> v1:172.21.15.169:6789/0 conn(0x7f173415c800 legacy=0x7f17340cc340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-08T04:02:06.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.920+0000 7f17337fe700 1 -- 172.21.15.16:0/3208380989 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1734158d60 con 0x7f17340cca50 2023-06-08T04:02:06.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.920+0000 7f17337fe700 1 --2- 172.21.15.16:0/3208380989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17340cca50 0x7f173406c8b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1734071ab0 tx=0x7f1724009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d24e8c42fc8ea62 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.920+0000 7f490299c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48fc15b910 0x7f48fc1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.920+0000 7f490219b700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48fc06e370 0x7f48fc14bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.920+0000 7f490199a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48fc0cc340 0x7f48fc1554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.920+0000 7f490199a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48fc0cc340 0x7f48fc1554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42260/0 (socket says 172.21.15.16:42260) 2023-06-08T04:02:06.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.920+0000 7f490199a700 1 -- 172.21.15.16:0/2830014433 learned_addr learned my addr 172.21.15.16:0/2830014433 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:06.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.921+0000 7f1731ffb700 1 -- 172.21.15.16:0/3208380989 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724004230 con 0x7f17340cca50 2023-06-08T04:02:06.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.921+0000 7f1731ffb700 1 -- 172.21.15.16:0/3208380989 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1724004390 con 0x7f17340cca50 2023-06-08T04:02:06.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.921+0000 7f1731ffb700 1 -- 172.21.15.16:0/3208380989 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17240036a0 con 0x7f17340cca50 2023-06-08T04:02:06.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.922+0000 7f17393ff700 1 -- 172.21.15.16:0/3208380989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17340cca50 msgr2=0x7f173406c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.922+0000 7f17393ff700 1 --2- 172.21.15.16:0/3208380989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17340cca50 0x7f173406c8b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1734071ab0 tx=0x7f1724009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.923+0000 7f17393ff700 1 -- 172.21.15.16:0/3208380989 shutdown_connections 2023-06-08T04:02:06.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.923+0000 7f17393ff700 1 --2- 172.21.15.16:0/3208380989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17340cca50 0x7f173406c8b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.923+0000 7f17393ff700 1 --2- 172.21.15.16:0/3208380989 >> v2:172.21.15.169:3300/0 conn(0x7f173415b9a0 0x7f1734158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.923+0000 7f17393ff700 1 -- 172.21.15.16:0/3208380989 >> 172.21.15.16:0/3208380989 conn(0x7f173406aa40 msgr2=0x7f17340b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:06.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.921+0000 7f05f49ff700 1 Processor -- start 2023-06-08T04:02:06.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.921+0000 7f490199a700 1 -- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48fc15b910 msgr2=0x7f48fc1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.921+0000 7f490199a700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48fc15b910 0x7f48fc1559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.921+0000 7f490199a700 1 -- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48fc06e370 msgr2=0x7f48fc14bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.921+0000 7f490199a700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48fc06e370 0x7f48fc14bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.921+0000 7f490199a700 1 -- 172.21.15.16:0/2830014433 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f4009b30 con 0x7f48fc0cc340 2023-06-08T04:02:06.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.922+0000 7f490199a700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48fc0cc340 0x7f48fc1554b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f48f4012000 tx=0x7f48f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.923+0000 7f48f2ffd700 1 -- 172.21.15.16:0/2830014433 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4004390 con 0x7f48fc0cc340 2023-06-08T04:02:06.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.923+0000 7f48f2ffd700 1 -- 172.21.15.16:0/2830014433 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f40044f0 con 0x7f48fc0cc340 2023-06-08T04:02:06.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.923+0000 7f48f2ffd700 1 -- 172.21.15.16:0/2830014433 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f40048a0 con 0x7f48fc0cc340 2023-06-08T04:02:06.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.923+0000 7f49043ff700 1 -- 172.21.15.16:0/2830014433 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48fc152e30 con 0x7f48fc0cc340 2023-06-08T04:02:06.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.922+0000 7f05f49ff700 1 -- start start 2023-06-08T04:02:06.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.924+0000 7f05f49ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f05f014f560 0x7f05f01589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.924+0000 7f05f49ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 0x7f05f00cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.924+0000 7f05f49ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f00ccce0 con 0x7f05f00cc880 2023-06-08T04:02:06.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.924+0000 7f05f49ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f01593f0 con 0x7f05f014f560 2023-06-08T04:02:06.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.924+0000 7f05f49ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f01596d0 con 0x7f05f0158f00 2023-06-08T04:02:06.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.923+0000 7f49043ff700 1 -- 172.21.15.16:0/2830014433 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48fc1533f0 con 0x7f48fc0cc340 2023-06-08T04:02:06.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.925+0000 7f49043ff700 1 -- 172.21.15.16:0/2830014433 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48fc153610 con 0x7f48fc0cc340 2023-06-08T04:02:06.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.925+0000 7f05edd9b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 0x7f05f00cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.925+0000 7f05eed9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f05f00cc880 0x7f05f0070280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51596/0 (socket says 172.21.15.16:51596) 2023-06-08T04:02:06.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.925+0000 7f05eed9d700 1 -- 172.21.15.16:0/782652193 learned_addr learned my addr 172.21.15.16:0/782652193 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:06.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.926+0000 7fa1549ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa150070990 0x7fa1500899c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.926+0000 7fa1549ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1500ce020 0x7fa1500880c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.926+0000 7fa1549ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1501608e0 0x7fa150088600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.926+0000 7fa1549ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa150089530 con 0x7fa1500ce020 2023-06-08T04:02:06.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.926+0000 7fa1549ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500c4300 con 0x7fa150070990 2023-06-08T04:02:06.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.926+0000 7fa1549ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa150088c00 con 0x7fa1501608e0 2023-06-08T04:02:06.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.926+0000 7f05ee59c700 1 --2- 172.21.15.16:0/782652193 >> v2:172.21.15.16:3300/0 conn(0x7f05f014f560 0x7f05f01589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.927+0000 7f05ee59c700 1 -- 172.21.15.16:0/782652193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 msgr2=0x7f05f00cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:06.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.927+0000 7f05ee59c700 1 --2- 172.21.15.16:0/782652193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 0x7f05f00cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.927+0000 7f05ee59c700 1 -- 172.21.15.16:0/782652193 >> v1:172.21.15.16:6789/0 conn(0x7f05f00cc880 legacy=0x7f05f0070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.927+0000 7f05ee59c700 1 -- 172.21.15.16:0/782652193 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f006c650 con 0x7f05f014f560 2023-06-08T04:02:06.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.927+0000 7f17393ff700 1 -- 172.21.15.16:0/3208380989 shutdown_connections 2023-06-08T04:02:06.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.927+0000 7fa14e59c700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa150070990 0x7fa1500899c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.927+0000 7f05ee59c700 1 --2- 172.21.15.16:0/782652193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05f014f560 0x7f05f01589c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009840 tx=0x7f05e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f382e01e5ecab8 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.927+0000 7fa14ed9d700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1501608e0 0x7fa150088600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.927+0000 7fa14e59c700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa150070990 0x7fa1500899c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56482/0 (socket says 172.21.15.16:56482) 2023-06-08T04:02:06.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.927+0000 7fa14e59c700 1 -- 172.21.15.16:0/2993777143 learned_addr learned my addr 172.21.15.16:0/2993777143 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:06.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.928+0000 7fa14dd9b700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1500ce020 0x7fa1500880c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.929+0000 7fa14dd9b700 1 -- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1501608e0 msgr2=0x7fa150088600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.929+0000 7fa14dd9b700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1501608e0 0x7fa150088600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.929+0000 7fa14dd9b700 1 -- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa150070990 msgr2=0x7fa1500899c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.929+0000 7fa14dd9b700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa150070990 0x7fa1500899c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.929+0000 7fa14dd9b700 1 -- 172.21.15.16:0/2993777143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1440094a0 con 0x7fa1500ce020 2023-06-08T04:02:06.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.930+0000 7fa14dd9b700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1500ce020 0x7fa1500880c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa150070d80 tx=0x7fa14000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.928+0000 7f17393ff700 1 -- 172.21.15.16:0/3208380989 wait complete. 2023-06-08T04:02:06.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.931+0000 7f17393ff700 1 Processor -- start 2023-06-08T04:02:06.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.929+0000 7f48f2ffd700 1 -- 172.21.15.16:0/2830014433 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f48f402d430 con 0x7f48fc0cc340 2023-06-08T04:02:06.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.931+0000 7f48f2ffd700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f48e006adb0 0x7f48e006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.931+0000 7f48f2ffd700 1 -- 172.21.15.16:0/2830014433 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48f408abd0 con 0x7f48fc0cc340 2023-06-08T04:02:06.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.931+0000 7f17393ff700 1 -- start start 2023-06-08T04:02:06.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.932+0000 7f490219b700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f48e006adb0 0x7f48e006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.933+0000 7f17393ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17340cca50 0x7f17341f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.933+0000 7f17393ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f173415b9a0 0x7f173406c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.933+0000 7f17393ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f173415c800 0x7f173406cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.933+0000 7f17393ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17340c5630 con 0x7f173415b9a0 2023-06-08T04:02:06.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.933+0000 7f17393ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17341f5c20 con 0x7f17340cca50 2023-06-08T04:02:06.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.933+0000 7f17393ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17340c45d0 con 0x7f173415c800 2023-06-08T04:02:06.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.933+0000 7f17337fe700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f173415c800 0x7f173406cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.933+0000 7f17337fe700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f173415c800 0x7f173406cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:55198/0 (socket says 172.21.15.16:55198) 2023-06-08T04:02:06.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.933+0000 7f17337fe700 1 -- 172.21.15.16:0/4022068895 learned_addr learned my addr 172.21.15.16:0/4022068895 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:06.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.934+0000 7f1732ffd700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17340cca50 0x7f17341f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.934+0000 7f17327fc700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f173415b9a0 0x7f173406c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.934+0000 7f86251ff700 1 Processor -- start 2023-06-08T04:02:06.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.934+0000 7f1732ffd700 1 -- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f173415c800 msgr2=0x7f173406cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.934+0000 7f1732ffd700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f173415c800 0x7f173406cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.934+0000 7f1732ffd700 1 -- 172.21.15.16:0/4022068895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f173415b9a0 msgr2=0x7f173406c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.934+0000 7f1732ffd700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f173415b9a0 0x7f173406c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.934+0000 7f86251ff700 1 -- start start 2023-06-08T04:02:06.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.934+0000 7f1732ffd700 1 -- 172.21.15.16:0/4022068895 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1724009550 con 0x7f17340cca50 2023-06-08T04:02:06.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.935+0000 7f1732ffd700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17340cca50 0x7f17341f56e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f172c00bd50 tx=0x7f172c00bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.935+0000 7f490219b700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f48e006adb0 0x7f48e006d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48ec006fd0 tx=0x7f48ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.935+0000 7f171b7fe700 1 -- 172.21.15.16:0/4022068895 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c00cc90 con 0x7f17340cca50 2023-06-08T04:02:06.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.935+0000 7f171b7fe700 1 -- 172.21.15.16:0/4022068895 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c00ce30 con 0x7f17340cca50 2023-06-08T04:02:06.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.935+0000 7f171b7fe700 1 -- 172.21.15.16:0/4022068895 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c014680 con 0x7f17340cca50 2023-06-08T04:02:06.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.935+0000 7f17393ff700 1 -- 172.21.15.16:0/4022068895 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17340c4870 con 0x7f17340cca50 2023-06-08T04:02:06.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.935+0000 7f17393ff700 1 -- 172.21.15.16:0/4022068895 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17340c4e30 con 0x7f17340cca50 2023-06-08T04:02:06.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.936+0000 7fa13effd700 1 -- 172.21.15.16:0/2993777143 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000c070 con 0x7fa1500ce020 2023-06-08T04:02:06.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.936+0000 7fa13effd700 1 -- 172.21.15.16:0/2993777143 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa140013610 con 0x7fa1500ce020 2023-06-08T04:02:06.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.936+0000 7fa13effd700 1 -- 172.21.15.16:0/2993777143 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140013980 con 0x7fa1500ce020 2023-06-08T04:02:06.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.936+0000 7fa1549ff700 1 -- 172.21.15.16:0/2993777143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa150088ee0 con 0x7fa1500ce020 2023-06-08T04:02:06.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.936+0000 7fa1549ff700 1 -- 172.21.15.16:0/2993777143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1500ad9c0 con 0x7fa1500ce020 2023-06-08T04:02:06.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.938+0000 7fa1549ff700 1 -- 172.21.15.16:0/2993777143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1500896e0 con 0x7fa1500ce020 2023-06-08T04:02:06.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.937+0000 7f86251ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f862014f560 0x7f86201589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.937+0000 7f86251ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86200cca50 0x7f862006ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.937+0000 7f86251ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86201593f0 con 0x7f8620158f00 2023-06-08T04:02:06.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.937+0000 7f86251ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86201596d0 con 0x7f862014f560 2023-06-08T04:02:06.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.937+0000 7f86251ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862006c650 con 0x7f86200cca50 2023-06-08T04:02:06.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.937+0000 7f861f59e700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86200cca50 0x7f862006ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.937+0000 7f861f59e700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86200cca50 0x7f862006ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:55214/0 (socket says 172.21.15.16:55214) 2023-06-08T04:02:06.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.938+0000 7f861f59e700 1 -- 172.21.15.16:0/698371915 learned_addr learned my addr 172.21.15.16:0/698371915 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:06.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.937+0000 7f17393ff700 1 -- 172.21.15.16:0/4022068895 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17340740e0 con 0x7f17340cca50 2023-06-08T04:02:06.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.938+0000 7f48f2ffd700 1 -- 172.21.15.16:0/2830014433 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f48f4055e10 con 0x7f48fc0cc340 2023-06-08T04:02:06.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.938+0000 7f861ed9d700 1 --2- 172.21.15.16:0/698371915 >> v2:172.21.15.169:3300/0 conn(0x7f862014f560 0x7f86201589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.938+0000 7f861f59e700 1 -- 172.21.15.16:0/698371915 >> v2:172.21.15.169:3300/0 conn(0x7f862014f560 msgr2=0x7f86201589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:06.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.938+0000 7f861f59e700 1 --2- 172.21.15.16:0/698371915 >> v2:172.21.15.169:3300/0 conn(0x7f862014f560 0x7f86201589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.938+0000 7f861f59e700 1 -- 172.21.15.16:0/698371915 >> v1:172.21.15.169:6789/0 conn(0x7f8620158f00 legacy=0x7f86200cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:06.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.938+0000 7f861f59e700 1 -- 172.21.15.16:0/698371915 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862006c930 con 0x7f86200cca50 2023-06-08T04:02:06.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.937+0000 7f05ed59a700 1 -- 172.21.15.16:0/782652193 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0011830 con 0x7f05f014f560 2023-06-08T04:02:06.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.938+0000 7f05ed59a700 1 -- 172.21.15.16:0/782652193 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0011990 con 0x7f05f014f560 2023-06-08T04:02:06.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.938+0000 7f05ed59a700 1 -- 172.21.15.16:0/782652193 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0011d20 con 0x7f05f014f560 2023-06-08T04:02:06.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.939+0000 7f05f49ff700 1 -- 172.21.15.16:0/782652193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05f014f560 msgr2=0x7f05f01589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.939+0000 7f05f49ff700 1 --2- 172.21.15.16:0/782652193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05f014f560 0x7f05f01589c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009840 tx=0x7f05e0009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:06.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.939+0000 7f861f59e700 1 --2- 172.21.15.16:0/698371915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86200cca50 0x7f862006ce50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f861800c770 tx=0x7f861800c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bb3fdb35cdaf0ed server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.940+0000 7f861e59c700 1 -- 172.21.15.16:0/698371915 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618003c20 con 0x7f86200cca50 2023-06-08T04:02:06.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.940+0000 7f861e59c700 1 -- 172.21.15.16:0/698371915 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8618003d80 con 0x7f86200cca50 2023-06-08T04:02:06.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.940+0000 7f861e59c700 1 -- 172.21.15.16:0/698371915 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618004270 con 0x7f86200cca50 2023-06-08T04:02:06.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.941+0000 7f86251ff700 1 -- 172.21.15.16:0/698371915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86200cca50 msgr2=0x7f862006ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.941+0000 7f86251ff700 1 --2- 172.21.15.16:0/698371915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86200cca50 0x7f862006ce50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f861800c770 tx=0x7f861800c7a0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.942+0000 7f86251ff700 1 -- 172.21.15.16:0/698371915 shutdown_connections 2023-06-08T04:02:06.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.942+0000 7f86251ff700 1 --2- 172.21.15.16:0/698371915 >> v2:172.21.15.169:3300/0 conn(0x7f862014f560 0x7f86201589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.942+0000 7f86251ff700 1 --2- 172.21.15.16:0/698371915 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f86200cca50 0x7f862006ce50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.942+0000 7f86251ff700 1 -- 172.21.15.16:0/698371915 >> 172.21.15.16:0/698371915 conn(0x7f862006aa30 msgr2=0x7f86200b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:06.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.941+0000 7f171b7fe700 1 -- 172.21.15.16:0/4022068895 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f172c003ac0 con 0x7f17340cca50 2023-06-08T04:02:06.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.942+0000 7f171b7fe700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f172006ade0 0x7f172006d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.942+0000 7f171b7fe700 1 -- 172.21.15.16:0/4022068895 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f172c089450 con 0x7f17340cca50 2023-06-08T04:02:06.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.943+0000 7f86251ff700 1 -- 172.21.15.16:0/698371915 shutdown_connections 2023-06-08T04:02:06.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.943+0000 7f86251ff700 1 -- 172.21.15.16:0/698371915 wait complete. 2023-06-08T04:02:06.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.943+0000 7fa13effd700 1 -- 172.21.15.16:0/2993777143 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa140013ae0 con 0x7fa1500ce020 2023-06-08T04:02:06.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.945+0000 7f171b7fe700 1 -- 172.21.15.16:0/4022068895 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f172c0544e0 con 0x7f17340cca50 2023-06-08T04:02:06.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.945+0000 7fa13effd700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa13006adb0 0x7fa13006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.945+0000 7fa13effd700 1 -- 172.21.15.16:0/2993777143 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa140089530 con 0x7fa1500ce020 2023-06-08T04:02:06.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.949+0000 7fa14e59c700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa13006adb0 0x7fa13006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.943+0000 7f05f49ff700 1 -- 172.21.15.16:0/782652193 shutdown_connections 2023-06-08T04:02:06.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.943+0000 7f05f49ff700 1 --2- 172.21.15.16:0/782652193 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05f014f560 0x7f05f01589c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.943+0000 7f05f49ff700 1 --2- 172.21.15.16:0/782652193 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 0x7f05f00cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.943+0000 7f05f49ff700 1 -- 172.21.15.16:0/782652193 >> 172.21.15.16:0/782652193 conn(0x7f05f006aa30 msgr2=0x7f05f00b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:06.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.945+0000 7f05f49ff700 1 -- 172.21.15.16:0/782652193 shutdown_connections 2023-06-08T04:02:06.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.946+0000 7f05f49ff700 1 -- 172.21.15.16:0/782652193 wait complete. 2023-06-08T04:02:06.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.948+0000 7f05f49ff700 1 Processor -- start 2023-06-08T04:02:06.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.949+0000 7f05f49ff700 1 -- start start 2023-06-08T04:02:06.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.945+0000 7f86251ff700 1 Processor -- start 2023-06-08T04:02:06.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.946+0000 7f86251ff700 1 -- start start 2023-06-08T04:02:06.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.947+0000 7f86251ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86200cca50 0x7f86200c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.947+0000 7f86251ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862014f560 0x7f862014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.947+0000 7f86251ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8620158f00 0x7f862014e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.947+0000 7f86251ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86200c5520 con 0x7f86200cca50 2023-06-08T04:02:06.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.947+0000 7f86251ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862014e090 con 0x7f8620158f00 2023-06-08T04:02:06.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.947+0000 7f86251ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86201f35f0 con 0x7f862014f560 2023-06-08T04:02:06.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.948+0000 7f861ed9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86200cca50 0x7f86200c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.948+0000 7f861ed9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86200cca50 0x7f86200c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42290/0 (socket says 172.21.15.16:42290) 2023-06-08T04:02:06.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.948+0000 7f861ed9d700 1 -- 172.21.15.16:0/96828885 learned_addr learned my addr 172.21.15.16:0/96828885 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:06.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.948+0000 7f861f59e700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8620158f00 0x7f862014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.949+0000 7f8617fff700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862014f560 0x7f862014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.949+0000 7f861f59e700 1 -- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862014f560 msgr2=0x7f862014d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.949+0000 7f861f59e700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862014f560 0x7f862014d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.949+0000 7f861f59e700 1 -- 172.21.15.16:0/96828885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86200cca50 msgr2=0x7f86200c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.949+0000 7f861f59e700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86200cca50 0x7f86200c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.949+0000 7f861f59e700 1 -- 172.21.15.16:0/96828885 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861800c3d0 con 0x7f8620158f00 2023-06-08T04:02:06.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.950+0000 7f861f59e700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8620158f00 0x7f862014e660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8618015000 tx=0x7f8618004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.951+0000 7f17327fc700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f172006ade0 0x7f172006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.951+0000 7f05f49ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f00cc880 0x7f05f01577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.951+0000 7f05f49ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05f014f560 0x7f05f0152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.951+0000 7f05f49ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 0x7f05f0152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.951+0000 7f05f49ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f013c2b0 con 0x7f05f014f560 2023-06-08T04:02:06.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.951+0000 7f05f49ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f014bf50 con 0x7f05f00cc880 2023-06-08T04:02:06.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.951+0000 7f05f49ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f00b4020 con 0x7f05f0158f00 2023-06-08T04:02:06.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.951+0000 7f05eed9d700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 0x7f05f0152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.951+0000 7f05eed9d700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 0x7f05f0152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:55242/0 (socket says 172.21.15.16:55242) 2023-06-08T04:02:06.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.951+0000 7f05eed9d700 1 -- 172.21.15.16:0/363305012 learned_addr learned my addr 172.21.15.16:0/363305012 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:06.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.952+0000 7f05ee59c700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f00cc880 0x7f05f01577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.951+0000 7f86177fe700 1 -- 172.21.15.16:0/96828885 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861801e070 con 0x7f8620158f00 2023-06-08T04:02:06.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.952+0000 7f86177fe700 1 -- 172.21.15.16:0/96828885 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86180092e0 con 0x7f8620158f00 2023-06-08T04:02:06.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.952+0000 7f86177fe700 1 -- 172.21.15.16:0/96828885 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618004460 con 0x7f8620158f00 2023-06-08T04:02:06.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.952+0000 7f86251ff700 1 -- 172.21.15.16:0/96828885 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86201f29e0 con 0x7f8620158f00 2023-06-08T04:02:06.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.952+0000 7f86251ff700 1 -- 172.21.15.16:0/96828885 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86201f2fa0 con 0x7f8620158f00 2023-06-08T04:02:06.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.953+0000 7f05eed9d700 1 -- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f00cc880 msgr2=0x7f05f01577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.953+0000 7f05eed9d700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f00cc880 0x7f05f01577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.953+0000 7f05eed9d700 1 -- 172.21.15.16:0/363305012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05f014f560 msgr2=0x7f05f0152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:06.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.953+0000 7f05eed9d700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05f014f560 0x7f05f0152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:06.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.953+0000 7f05eed9d700 1 -- 172.21.15.16:0/363305012 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e00094a0 con 0x7f05f0158f00 2023-06-08T04:02:06.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.953+0000 7fa13effd700 1 -- 172.21.15.16:0/2993777143 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa1400545c0 con 0x7fa1500ce020 2023-06-08T04:02:06.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.953+0000 7fa14e59c700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa13006adb0 0x7fa13006d260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1480016f0 tx=0x7fa148001ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.954+0000 7f05eed9d700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 0x7f05f0152870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05e400c370 tx=0x7f05e400c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.954+0000 7f05deffd700 1 -- 172.21.15.16:0/363305012 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4005d70 con 0x7f05f0158f00 2023-06-08T04:02:06.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.954+0000 7f05deffd700 1 -- 172.21.15.16:0/363305012 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e400ce30 con 0x7f05f0158f00 2023-06-08T04:02:06.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.954+0000 7f05deffd700 1 -- 172.21.15.16:0/363305012 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40072f0 con 0x7f05f0158f00 2023-06-08T04:02:06.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.956+0000 7f05f49ff700 1 -- 172.21.15.16:0/363305012 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f01f4810 con 0x7f05f0158f00 2023-06-08T04:02:06.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.956+0000 7f05f49ff700 1 -- 172.21.15.16:0/363305012 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f013bbf0 con 0x7f05f0158f00 2023-06-08T04:02:06.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.956+0000 7f86177fe700 1 -- 172.21.15.16:0/96828885 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8618004680 con 0x7f8620158f00 2023-06-08T04:02:06.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.958+0000 7f86177fe700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f860006adb0 0x7f860006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.958+0000 7f86177fe700 1 -- 172.21.15.16:0/96828885 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f861808a230 con 0x7f8620158f00 2023-06-08T04:02:06.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.959+0000 7f05f49ff700 1 -- 172.21.15.16:0/363305012 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f013c3f0 con 0x7f05f0158f00 2023-06-08T04:02:06.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.959+0000 7f86251ff700 1 -- 172.21.15.16:0/96828885 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86040052e0 con 0x7f8620158f00 2023-06-08T04:02:06.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.959+0000 7f17327fc700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f172006ade0 0x7f172006d290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17341f5ed0 tx=0x7f1728008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.959+0000 7f861ed9d700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f860006adb0 0x7f860006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.960+0000 7f861ed9d700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f860006adb0 0x7f860006d260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f861000ac10 tx=0x7f8610008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.961+0000 7f05deffd700 1 -- 172.21.15.16:0/363305012 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05e4007450 con 0x7f05f0158f00 2023-06-08T04:02:06.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.962+0000 7f05deffd700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f05d006adb0 0x7f05d006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:06.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.962+0000 7f05deffd700 1 -- 172.21.15.16:0/363305012 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05e4088770 con 0x7f05f0158f00 2023-06-08T04:02:06.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.962+0000 7f05ee59c700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f05d006adb0 0x7f05d006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:06.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.963+0000 7f05ee59c700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f05d006adb0 0x7f05d006d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05e00090b0 tx=0x7f05e0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:06.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.968+0000 7f86177fe700 1 -- 172.21.15.16:0/96828885 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8618055470 con 0x7f8620158f00 2023-06-08T04:02:06.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.970+0000 7f05deffd700 1 -- 172.21.15.16:0/363305012 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f05f013c3f0 con 0x7f05f0158f00 2023-06-08T04:02:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.994+0000 7f761db9d700 1 Processor -- start 2023-06-08T04:02:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.994+0000 7f761db9d700 1 -- start start 2023-06-08T04:02:07.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.996+0000 7f122e9ff700 1 Processor -- start 2023-06-08T04:02:07.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.996+0000 7f122e9ff700 1 -- start start 2023-06-08T04:02:07.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.997+0000 7f761db9d700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 0x7f761806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.997+0000 7f761db9d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761806d710 con 0x7f76180cd0a0 2023-06-08T04:02:07.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.997+0000 7f761db9d700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76180adc00 con 0x7f76180b39e0 2023-06-08T04:02:07.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.997+0000 7f761db9d700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761806d430 con 0x7f76180ad830 2023-06-08T04:02:07.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.998+0000 7f761d39c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f76180cd0a0 0x7f76180c14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51604/0 (socket says 172.21.15.16:51604) 2023-06-08T04:02:07.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.998+0000 7f761d39c700 1 -- 172.21.15.16:0/486851721 learned_addr learned my addr 172.21.15.16:0/486851721 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:07.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.998+0000 7f122e9ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12280b0a70 0x7f12281589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.999+0000 7f122e9ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1228158f00 0x7f12280cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.999+0000 7f122e9ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12281593f0 con 0x7f122814f560 2023-06-08T04:02:07.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.999+0000 7f122e9ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12281596d0 con 0x7f12280b0a70 2023-06-08T04:02:07.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.999+0000 7f122e9ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122806c650 con 0x7f1228158f00 2023-06-08T04:02:07.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:06.999+0000 7f12277fe700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1228158f00 0x7f12280cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.000+0000 7f12277fe700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1228158f00 0x7f12280cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56520/0 (socket says 172.21.15.16:56520) 2023-06-08T04:02:07.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.000+0000 7f12277fe700 1 -- 172.21.15.16:0/2198301632 learned_addr learned my addr 172.21.15.16:0/2198301632 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:07.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.001+0000 7f12277fe700 1 -- 172.21.15.16:0/2198301632 >> v2:172.21.15.16:3300/0 conn(0x7f12280b0a70 msgr2=0x7f12281589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:07.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.001+0000 7f12277fe700 1 --2- 172.21.15.16:0/2198301632 >> v2:172.21.15.16:3300/0 conn(0x7f12280b0a70 0x7f12281589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.001+0000 7f12277fe700 1 -- 172.21.15.16:0/2198301632 >> v1:172.21.15.16:6789/0 conn(0x7f122814f560 legacy=0x7f1228070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:07.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.001+0000 7f12277fe700 1 -- 172.21.15.16:0/2198301632 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122806c930 con 0x7f1228158f00 2023-06-08T04:02:07.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.001+0000 7f761cb9b700 1 --2- 172.21.15.16:0/486851721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 0x7f761806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.001+0000 7f76177fe700 1 -- 172.21.15.16:0/486851721 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435151246 0 0) 0x7f761806d710 con 0x7f76180cd0a0 2023-06-08T04:02:07.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.001+0000 7f761cb9b700 1 -- 172.21.15.16:0/486851721 >> v1:172.21.15.169:6789/0 conn(0x7f76180b39e0 legacy=0x7f7618070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.001+0000 7f12277fe700 1 --2- 172.21.15.16:0/2198301632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1228158f00 0x7f12280cc340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12280adec0 tx=0x7f1218009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68735ecd3ade01a4 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:07.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.002+0000 7f1226ffd700 1 -- 172.21.15.16:0/2198301632 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218004230 con 0x7f1228158f00 2023-06-08T04:02:07.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.002+0000 7f1226ffd700 1 -- 172.21.15.16:0/2198301632 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1218004390 con 0x7f1228158f00 2023-06-08T04:02:07.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.002+0000 7f1226ffd700 1 -- 172.21.15.16:0/2198301632 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12180036a0 con 0x7f1228158f00 2023-06-08T04:02:07.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.003+0000 7f122e9ff700 1 -- 172.21.15.16:0/2198301632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1228158f00 msgr2=0x7f12280cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.003+0000 7f122e9ff700 1 --2- 172.21.15.16:0/2198301632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1228158f00 0x7f12280cc340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12280adec0 tx=0x7f1218009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.003+0000 7f122e9ff700 1 -- 172.21.15.16:0/2198301632 shutdown_connections 2023-06-08T04:02:07.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.003+0000 7f122e9ff700 1 --2- 172.21.15.16:0/2198301632 >> v2:172.21.15.16:3300/0 conn(0x7f12280b0a70 0x7f12281589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.003+0000 7f122e9ff700 1 --2- 172.21.15.16:0/2198301632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1228158f00 0x7f12280cc340 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.003+0000 7f122e9ff700 1 -- 172.21.15.16:0/2198301632 >> 172.21.15.16:0/2198301632 conn(0x7f122806aa30 msgr2=0x7f12280b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.003+0000 7f761cb9b700 1 -- 172.21.15.16:0/486851721 >> v1:172.21.15.16:6789/0 conn(0x7f76180cd0a0 legacy=0x7f76180c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.003+0000 7f761cb9b700 1 -- 172.21.15.16:0/486851721 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180cc5c0 con 0x7f76180ad830 2023-06-08T04:02:07.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.004+0000 7f122e9ff700 1 -- 172.21.15.16:0/2198301632 shutdown_connections 2023-06-08T04:02:07.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.004+0000 7f122e9ff700 1 -- 172.21.15.16:0/2198301632 wait complete. 2023-06-08T04:02:07.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.007+0000 7f761cb9b700 1 --2- 172.21.15.16:0/486851721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 0x7f761806ce20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7608009870 tx=0x7f7608009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d0397169980f65 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:07.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.007+0000 7f122e9ff700 1 Processor -- start 2023-06-08T04:02:07.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.008+0000 7f122e9ff700 1 -- start start 2023-06-08T04:02:07.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.009+0000 7f122e9ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12280b0a70 0x7f12281f6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.009+0000 7f122e9ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f122814f560 0x7f12280c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.009+0000 7f122e9ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1228158f00 0x7f12281476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.009+0000 7f122e9ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228146f00 con 0x7f12280b0a70 2023-06-08T04:02:07.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.009+0000 7f122e9ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12280b2c80 con 0x7f122814f560 2023-06-08T04:02:07.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.009+0000 7f122e9ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12280c46f0 con 0x7f1228158f00 2023-06-08T04:02:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.009+0000 7f76177fe700 1 -- 172.21.15.16:0/486851721 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608011830 con 0x7f76180ad830 2023-06-08T04:02:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.009+0000 7f76177fe700 1 -- 172.21.15.16:0/486851721 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7608011990 con 0x7f76180ad830 2023-06-08T04:02:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.009+0000 7f76177fe700 1 -- 172.21.15.16:0/486851721 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608011d20 con 0x7f76180ad830 2023-06-08T04:02:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.010+0000 7f761db9d700 1 -- 172.21.15.16:0/486851721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 msgr2=0x7f761806ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.010+0000 7f761db9d700 1 --2- 172.21.15.16:0/486851721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 0x7f761806ce20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7608009870 tx=0x7f7608009b80 comp rx=0 tx=0).stop 2023-06-08T04:02:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.010+0000 7f12277fe700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f122814f560 0x7f12280c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.010+0000 7f12277fe700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f122814f560 0x7f12280c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:56524/0 (socket says 172.21.15.16:56524) 2023-06-08T04:02:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.010+0000 7f12277fe700 1 -- 172.21.15.16:0/753236035 learned_addr learned my addr 172.21.15.16:0/753236035 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.010+0000 7f122cf9c700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1228158f00 0x7f12281476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.011+0000 7f12277fe700 1 -- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1228158f00 msgr2=0x7f12281476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.011+0000 7f12277fe700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1228158f00 0x7f12281476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.011+0000 7f12277fe700 1 -- 172.21.15.16:0/753236035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12280b0a70 msgr2=0x7f12281f6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.011+0000 7f12277fe700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12280b0a70 0x7f12281f6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.011+0000 7f12277fe700 1 -- 172.21.15.16:0/753236035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1218009550 con 0x7f122814f560 2023-06-08T04:02:07.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.011+0000 7f761db9d700 1 -- 172.21.15.16:0/486851721 shutdown_connections 2023-06-08T04:02:07.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.011+0000 7f761db9d700 1 --2- 172.21.15.16:0/486851721 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 0x7f761806ce20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.011+0000 7f761db9d700 1 -- 172.21.15.16:0/486851721 >> 172.21.15.16:0/486851721 conn(0x7f76180ce520 msgr2=0x7f76180ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.011+0000 7f12277fe700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f122814f560 0x7f12280c41b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1218009c10 tx=0x7f1218004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:07.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.012+0000 7f1224ff9700 1 -- 172.21.15.16:0/753236035 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218011630 con 0x7f122814f560 2023-06-08T04:02:07.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.012+0000 7f1224ff9700 1 -- 172.21.15.16:0/753236035 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1218011790 con 0x7f122814f560 2023-06-08T04:02:07.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.012+0000 7f1224ff9700 1 -- 172.21.15.16:0/753236035 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218011b20 con 0x7f122814f560 2023-06-08T04:02:07.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.012+0000 7f122e9ff700 1 -- 172.21.15.16:0/753236035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1228146940 con 0x7f122814f560 2023-06-08T04:02:07.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.012+0000 7f122e9ff700 1 -- 172.21.15.16:0/753236035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12280b2910 con 0x7f122814f560 2023-06-08T04:02:07.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.013+0000 7f761db9d700 1 -- 172.21.15.16:0/486851721 shutdown_connections 2023-06-08T04:02:07.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.017+0000 7f1224ff9700 1 -- 172.21.15.16:0/753236035 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1218022070 con 0x7f122814f560 2023-06-08T04:02:07.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.017+0000 7f122e9ff700 1 -- 172.21.15.16:0/753236035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12280b00b0 con 0x7f122814f560 2023-06-08T04:02:07.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.018+0000 7f1224ff9700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f121406adb0 0x7f121406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.018+0000 7f1224ff9700 1 -- 172.21.15.16:0/753236035 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f121808ad30 con 0x7f122814f560 2023-06-08T04:02:07.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.014+0000 7f761db9d700 1 -- 172.21.15.16:0/486851721 wait complete. 2023-06-08T04:02:07.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.017+0000 7f761db9d700 1 Processor -- start 2023-06-08T04:02:07.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.017+0000 7f761db9d700 1 -- start start 2023-06-08T04:02:07.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.018+0000 7f761db9d700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 0x7f7618158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.019+0000 7f761db9d700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76180b39e0 0x7f76180c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.019+0000 7f761db9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76180cd0a0 0x7f76181f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.019+0000 7f761db9d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76180afd10 con 0x7f76180cd0a0 2023-06-08T04:02:07.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.019+0000 7f761db9d700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76180af100 con 0x7f76180b39e0 2023-06-08T04:02:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.019+0000 7f761db9d700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76180af3e0 con 0x7f76180ad830 2023-06-08T04:02:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.019+0000 7f761cb9b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 0x7f7618158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.020+0000 7f761cb9b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 0x7f7618158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:55272/0 (socket says 172.21.15.16:55272) 2023-06-08T04:02:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.020+0000 7f761cb9b700 1 -- 172.21.15.16:0/4190509837 learned_addr learned my addr 172.21.15.16:0/4190509837 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.020+0000 7f761d39c700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76180cd0a0 0x7f76181f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.020+0000 7f7617fff700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76180b39e0 0x7f76180c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.021+0000 7f761cb9b700 1 -- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76180b39e0 msgr2=0x7f76180c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.021+0000 7f761cb9b700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76180b39e0 0x7f76180c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.021+0000 7f761cb9b700 1 -- 172.21.15.16:0/4190509837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76180cd0a0 msgr2=0x7f76181f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.021+0000 7f761cb9b700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76180cd0a0 0x7f76181f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.021+0000 7f761cb9b700 1 -- 172.21.15.16:0/4190509837 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76080094a0 con 0x7f76180ad830 2023-06-08T04:02:07.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.021+0000 7f761cb9b700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 0x7f7618158ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76080090b0 tx=0x7f7608004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:07.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.022+0000 7f76157fa700 1 -- 172.21.15.16:0/4190509837 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76080036a0 con 0x7f76180ad830 2023-06-08T04:02:07.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.022+0000 7f76157fa700 1 -- 172.21.15.16:0/4190509837 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760801f070 con 0x7f76180ad830 2023-06-08T04:02:07.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.022+0000 7f76157fa700 1 -- 172.21.15.16:0/4190509837 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608003a00 con 0x7f76180ad830 2023-06-08T04:02:07.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.022+0000 7f761db9d700 1 -- 172.21.15.16:0/4190509837 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76180af6c0 con 0x7f76180ad830 2023-06-08T04:02:07.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.022+0000 7f761db9d700 1 -- 172.21.15.16:0/4190509837 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76180c8310 con 0x7f76180ad830 2023-06-08T04:02:07.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.025+0000 7f1227fff700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f121406adb0 0x7f121406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.026+0000 7f1224ff9700 1 -- 172.21.15.16:0/753236035 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1218090020 con 0x7f122814f560 2023-06-08T04:02:07.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.026+0000 7f76157fa700 1 -- 172.21.15.16:0/4190509837 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7608003b60 con 0x7f76180ad830 2023-06-08T04:02:07.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.027+0000 7f1227fff700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f121406adb0 0x7f121406d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f122000ab90 tx=0x7f1220009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:07.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.028+0000 7f76157fa700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f760406adb0 0x7f760406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.028+0000 7f76157fa700 1 -- 172.21.15.16:0/4190509837 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7608021070 con 0x7f76180ad830 2023-06-08T04:02:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.029+0000 7f761db9d700 1 -- 172.21.15.16:0/4190509837 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f80052e0 con 0x7f76180ad830 2023-06-08T04:02:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.029+0000 7f7617fff700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f760406adb0 0x7f760406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.030+0000 7f7617fff700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f760406adb0 0x7f760406d260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76180ca830 tx=0x7f7610009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.035+0000 7f76157fa700 1 -- 172.21.15.16:0/4190509837 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7608055f40 con 0x7f76180ad830 2023-06-08T04:02:07.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.315+0000 7f5da9dff700 1 -- 172.21.15.16:0/1307297957 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5d80005590 con 0x7f5da40707c0 2023-06-08T04:02:07.323 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2023-06-08T04:02:07.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.316+0000 7f5d93fff700 1 -- 172.21.15.16:0/1307297957 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d9c042090 con 0x7f5da40707c0 2023-06-08T04:02:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.320+0000 7f5da9dff700 1 -- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d8806ad80 msgr2=0x7f5d8806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.320+0000 7f5da9dff700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d8806ad80 0x7f5d8806d230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5da41594c0 tx=0x7f5d98009210 comp rx=0 tx=0).stop 2023-06-08T04:02:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.320+0000 7f5da9dff700 1 -- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5da40707c0 msgr2=0x7f5da40c2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.320+0000 7f5da9dff700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5da40707c0 0x7f5da40c2400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5da40ce5d0 tx=0x7f5d9c004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.321+0000 7f5da9dff700 1 -- 172.21.15.16:0/1307297957 shutdown_connections 2023-06-08T04:02:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.321+0000 7f5da9dff700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5d8806ad80 0x7f5d8806d230 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.321+0000 7f5da9dff700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5da41608e0 0x7f5da40c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.321+0000 7f5da9dff700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5da40707c0 0x7f5da40c2400 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.321+0000 7f5da9dff700 1 --2- 172.21.15.16:0/1307297957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5da40ce020 0x7f5da415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.321+0000 7f5da9dff700 1 -- 172.21.15.16:0/1307297957 >> 172.21.15.16:0/1307297957 conn(0x7f5da406aa30 msgr2=0x7f5da40b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.321+0000 7f5da9dff700 1 -- 172.21.15.16:0/1307297957 shutdown_connections 2023-06-08T04:02:07.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.322+0000 7f5da9dff700 1 -- 172.21.15.16:0/1307297957 wait complete. 2023-06-08T04:02:07.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-06-08T04:02:07.356 DEBUG:teuthology.parallel:result is None 2023-06-08T04:02:07.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.406+0000 7f49043ff700 1 -- 172.21.15.16:0/2830014433 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f48fc0740e0 con 0x7f48fc0cc340 2023-06-08T04:02:07.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.407+0000 7f48f2ffd700 1 -- 172.21.15.16:0/2830014433 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48f401f020 con 0x7f48fc0cc340 2023-06-08T04:02:07.411 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2023-06-08T04:02:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.411+0000 7f49043ff700 1 -- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f48e006adb0 msgr2=0x7f48e006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.411+0000 7f49043ff700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f48e006adb0 0x7f48e006d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48ec006fd0 tx=0x7f48ec008040 comp rx=0 tx=0).stop 2023-06-08T04:02:07.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.411+0000 7f49043ff700 1 -- 172.21.15.16:0/2830014433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48fc0cc340 msgr2=0x7f48fc1554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.411+0000 7f49043ff700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48fc0cc340 0x7f48fc1554b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f48f4012000 tx=0x7f48f4004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.411+0000 7f49043ff700 1 -- 172.21.15.16:0/2830014433 shutdown_connections 2023-06-08T04:02:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.411+0000 7f49043ff700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f48e006adb0 0x7f48e006d260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.411+0000 7f49043ff700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48fc15b910 0x7f48fc1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.411+0000 7f49043ff700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f48fc06e370 0x7f48fc14bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.411+0000 7f49043ff700 1 --2- 172.21.15.16:0/2830014433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48fc0cc340 0x7f48fc1554b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.411+0000 7f49043ff700 1 -- 172.21.15.16:0/2830014433 >> 172.21.15.16:0/2830014433 conn(0x7f48fc06aa40 msgr2=0x7f48fc0ae2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.412+0000 7f17393ff700 1 -- 172.21.15.16:0/4022068895 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f17340b1230 con 0x7f17340cca50 2023-06-08T04:02:07.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.412+0000 7f49043ff700 1 -- 172.21.15.16:0/2830014433 shutdown_connections 2023-06-08T04:02:07.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.412+0000 7f49043ff700 1 -- 172.21.15.16:0/2830014433 wait complete. 2023-06-08T04:02:07.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.412+0000 7f171b7fe700 1 -- 172.21.15.16:0/4022068895 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f172c019090 con 0x7f17340cca50 2023-06-08T04:02:07.418 INFO:teuthology.orchestra.run.smithi016.stdout:55834574855 2023-06-08T04:02:07.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.415+0000 7f122e9ff700 1 -- 172.21.15.16:0/753236035 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f12280740e0 con 0x7f122814f560 2023-06-08T04:02:07.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.415+0000 7fa1549ff700 1 -- 172.21.15.16:0/2993777143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa1500740e0 con 0x7fa1500ce020 2023-06-08T04:02:07.419 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-06-08T04:02:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.415+0000 7f1224ff9700 1 -- 172.21.15.16:0/753236035 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1218055e50 con 0x7f122814f560 2023-06-08T04:02:07.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.416+0000 7fa13effd700 1 -- 172.21.15.16:0/2993777143 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa140057be0 con 0x7fa1500ce020 2023-06-08T04:02:07.420 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2023-06-08T04:02:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.416+0000 7f17393ff700 1 -- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f172006ade0 msgr2=0x7f172006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.416+0000 7f17393ff700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f172006ade0 0x7f172006d290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17341f5ed0 tx=0x7f1728008040 comp rx=0 tx=0).stop 2023-06-08T04:02:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.416+0000 7f17393ff700 1 -- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17340cca50 msgr2=0x7f17341f56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.416+0000 7f17393ff700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17340cca50 0x7f17341f56e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f172c00bd50 tx=0x7f172c00bd80 comp rx=0 tx=0).stop 2023-06-08T04:02:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.417+0000 7f17393ff700 1 -- 172.21.15.16:0/4022068895 shutdown_connections 2023-06-08T04:02:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.417+0000 7f17393ff700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f172006ade0 0x7f172006d290 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.417+0000 7f17393ff700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f173415c800 0x7f173406cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.417+0000 7f17393ff700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17340cca50 0x7f17341f56e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.417+0000 7f17393ff700 1 --2- 172.21.15.16:0/4022068895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f173415b9a0 0x7f173406c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.417+0000 7f17393ff700 1 -- 172.21.15.16:0/4022068895 >> 172.21.15.16:0/4022068895 conn(0x7f173406aa40 msgr2=0x7f17340cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.417+0000 7f17393ff700 1 -- 172.21.15.16:0/4022068895 shutdown_connections 2023-06-08T04:02:07.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.417+0000 7f17393ff700 1 -- 172.21.15.16:0/4022068895 wait complete. 2023-06-08T04:02:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.419+0000 7f122e9ff700 1 -- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f121406adb0 msgr2=0x7f121406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.419+0000 7f122e9ff700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f121406adb0 0x7f121406d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f122000ab90 tx=0x7f1220009250 comp rx=0 tx=0).stop 2023-06-08T04:02:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.419+0000 7f122e9ff700 1 -- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f122814f560 msgr2=0x7f12280c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.419+0000 7f122e9ff700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f122814f560 0x7f12280c41b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1218009c10 tx=0x7f1218004750 comp rx=0 tx=0).stop 2023-06-08T04:02:07.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.419+0000 7f122e9ff700 1 -- 172.21.15.16:0/753236035 shutdown_connections 2023-06-08T04:02:07.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.419+0000 7f122e9ff700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f121406adb0 0x7f121406d260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.419+0000 7f122e9ff700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1228158f00 0x7f12281476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.419+0000 7f122e9ff700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12280b0a70 0x7f12281f6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.419+0000 7f122e9ff700 1 --2- 172.21.15.16:0/753236035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f122814f560 0x7f12280c41b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.419+0000 7f122e9ff700 1 -- 172.21.15.16:0/753236035 >> 172.21.15.16:0/753236035 conn(0x7f122806aa30 msgr2=0x7f122815b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7fa1549ff700 1 -- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa13006adb0 msgr2=0x7fa13006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7fa1549ff700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa13006adb0 0x7fa13006d260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1480016f0 tx=0x7fa148001ac0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7fa1549ff700 1 -- 172.21.15.16:0/2993777143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1500ce020 msgr2=0x7fa1500880c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7fa1549ff700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1500ce020 0x7fa1500880c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa150070d80 tx=0x7fa14000eac0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7fa1549ff700 1 -- 172.21.15.16:0/2993777143 shutdown_connections 2023-06-08T04:02:07.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7fa1549ff700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa13006adb0 0x7fa13006d260 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7fa1549ff700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa1501608e0 0x7fa150088600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7fa1549ff700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa150070990 0x7fa1500899c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7fa1549ff700 1 --2- 172.21.15.16:0/2993777143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1500ce020 0x7fa1500880c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7fa1549ff700 1 -- 172.21.15.16:0/2993777143 >> 172.21.15.16:0/2993777143 conn(0x7fa15006aa30 msgr2=0x7fa150161a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7fa1549ff700 1 -- 172.21.15.16:0/2993777143 shutdown_connections 2023-06-08T04:02:07.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7f122e9ff700 1 -- 172.21.15.16:0/753236035 shutdown_connections 2023-06-08T04:02:07.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.420+0000 7f122e9ff700 1 -- 172.21.15.16:0/753236035 wait complete. 2023-06-08T04:02:07.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.421+0000 7fa1549ff700 1 -- 172.21.15.16:0/2993777143 wait complete. 2023-06-08T04:02:07.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.424+0000 7f05f49ff700 1 -- 172.21.15.16:0/363305012 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f05f013c3f0 con 0x7f05f0158f00 2023-06-08T04:02:07.432 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-06-08T04:02:07.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.425+0000 7f05deffd700 1 -- 172.21.15.16:0/363305012 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05f013c3f0 con 0x7f05f0158f00 2023-06-08T04:02:07.433 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-06-08T04:02:07.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.427+0000 7f86251ff700 1 -- 172.21.15.16:0/96828885 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8604005590 con 0x7f8620158f00 2023-06-08T04:02:07.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.428+0000 7f86177fe700 1 -- 172.21.15.16:0/96828885 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8618027020 con 0x7f8620158f00 2023-06-08T04:02:07.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.429+0000 7f05f49ff700 1 -- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f05d006adb0 msgr2=0x7f05d006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.429+0000 7f05f49ff700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f05d006adb0 0x7f05d006d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05e00090b0 tx=0x7f05e0008030 comp rx=0 tx=0).stop 2023-06-08T04:02:07.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.429+0000 7f05f49ff700 1 -- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 msgr2=0x7f05f0152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.429+0000 7f05f49ff700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 0x7f05f0152870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05e400c370 tx=0x7f05e400c680 comp rx=0 tx=0).stop 2023-06-08T04:02:07.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.429+0000 7f05f49ff700 1 -- 172.21.15.16:0/363305012 shutdown_connections 2023-06-08T04:02:07.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.429+0000 7f05f49ff700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f05d006adb0 0x7f05d006d260 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.429+0000 7f05f49ff700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f0158f00 0x7f05f0152870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.429+0000 7f05f49ff700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f00cc880 0x7f05f01577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.429+0000 7f05f49ff700 1 --2- 172.21.15.16:0/363305012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05f014f560 0x7f05f0152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.429+0000 7f05f49ff700 1 -- 172.21.15.16:0/363305012 >> 172.21.15.16:0/363305012 conn(0x7f05f006aa30 msgr2=0x7f05f00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.430+0000 7f05f49ff700 1 -- 172.21.15.16:0/363305012 shutdown_connections 2023-06-08T04:02:07.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.430+0000 7f05f49ff700 1 -- 172.21.15.16:0/363305012 wait complete. 2023-06-08T04:02:07.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.432+0000 7f86251ff700 1 -- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f860006adb0 msgr2=0x7f860006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.432+0000 7f86251ff700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f860006adb0 0x7f860006d260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f861000ac10 tx=0x7f8610008040 comp rx=0 tx=0).stop 2023-06-08T04:02:07.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.432+0000 7f86251ff700 1 -- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8620158f00 msgr2=0x7f862014e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.432+0000 7f86251ff700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8620158f00 0x7f862014e660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8618015000 tx=0x7f8618004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.433+0000 7f86251ff700 1 -- 172.21.15.16:0/96828885 shutdown_connections 2023-06-08T04:02:07.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.433+0000 7f86251ff700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f860006adb0 0x7f860006d260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.433+0000 7f86251ff700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8620158f00 0x7f862014e660 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.433+0000 7f86251ff700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86200cca50 0x7f86200c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.433+0000 7f86251ff700 1 --2- 172.21.15.16:0/96828885 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f862014f560 0x7f862014d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.433+0000 7f86251ff700 1 -- 172.21.15.16:0/96828885 >> 172.21.15.16:0/96828885 conn(0x7f862006aa30 msgr2=0x7f86200afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.434+0000 7f86251ff700 1 -- 172.21.15.16:0/96828885 shutdown_connections 2023-06-08T04:02:07.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.434+0000 7f86251ff700 1 -- 172.21.15.16:0/96828885 wait complete. 2023-06-08T04:02:07.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-06-08T04:02:07.449 DEBUG:teuthology.parallel:result is None 2023-06-08T04:02:07.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-06-08T04:02:07.455 DEBUG:teuthology.parallel:result is None 2023-06-08T04:02:07.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-06-08T04:02:07.456 DEBUG:teuthology.parallel:result is None 2023-06-08T04:02:07.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-06-08T04:02:07.459 DEBUG:teuthology.parallel:result is None 2023-06-08T04:02:07.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-06-08T04:02:07.467 DEBUG:teuthology.parallel:result is None 2023-06-08T04:02:07.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-06-08T04:02:07.468 DEBUG:teuthology.parallel:result is None 2023-06-08T04:02:07.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.474+0000 7f761db9d700 1 -- 172.21.15.16:0/4190509837 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f75f8005590 con 0x7f76180ad830 2023-06-08T04:02:07.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.475+0000 7f76157fa700 1 -- 172.21.15.16:0/4190509837 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7608059560 con 0x7f76180ad830 2023-06-08T04:02:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2023-06-08T04:02:07.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 -- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f760406adb0 msgr2=0x7f760406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f760406adb0 0x7f760406d260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f76180ca830 tx=0x7f7610009040 comp rx=0 tx=0).stop 2023-06-08T04:02:07.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 -- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 msgr2=0x7f7618158ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 0x7f7618158ec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76080090b0 tx=0x7f7608004750 comp rx=0 tx=0).stop 2023-06-08T04:02:07.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 -- 172.21.15.16:0/4190509837 shutdown_connections 2023-06-08T04:02:07.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f760406adb0 0x7f760406d260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76180cd0a0 0x7f76181f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76180ad830 0x7f7618158ec0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 --2- 172.21.15.16:0/4190509837 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76180b39e0 0x7f76180c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 -- 172.21.15.16:0/4190509837 >> 172.21.15.16:0/4190509837 conn(0x7f76180ce520 msgr2=0x7f76180c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 -- 172.21.15.16:0/4190509837 shutdown_connections 2023-06-08T04:02:07.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.477+0000 7f761db9d700 1 -- 172.21.15.16:0/4190509837 wait complete. 2023-06-08T04:02:07.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-06-08T04:02:07.499 DEBUG:teuthology.parallel:result is None 2023-06-08T04:02:07.499 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-08T04:02:07.500 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T04:02:07.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.734+0000 7fc010bff700 1 Processor -- start 2023-06-08T04:02:07.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.735+0000 7fc010bff700 1 -- start start 2023-06-08T04:02:07.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.736+0000 7fc010bff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc00c160a60 0x7fc00c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.736+0000 7fc010bff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c0d0800 con 0x7fc00c0b83f0 2023-06-08T04:02:07.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.736+0000 7fc010bff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c0cd1e0 con 0x7fc00c0b4b50 2023-06-08T04:02:07.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.736+0000 7fc010bff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c160ed0 con 0x7fc00c160a60 2023-06-08T04:02:07.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.736+0000 7fc00a59c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc00c0b83f0 0x7fc00c0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51612/0 (socket says 172.21.15.16:51612) 2023-06-08T04:02:07.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.736+0000 7fc00a59c700 1 -- 172.21.15.16:0/2954330255 learned_addr learned my addr 172.21.15.16:0/2954330255 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:07.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.736+0000 7fc003fff700 1 --2- 172.21.15.16:0/2954330255 >> v2:172.21.15.16:3300/0 conn(0x7fc00c160a60 0x7fc00c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.736+0000 7fc009d9b700 1 -- 172.21.15.16:0/2954330255 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694560913 0 0) 0x7fc00c0d0800 con 0x7fc00c0b83f0 2023-06-08T04:02:07.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.737+0000 7fc009d9b700 1 -- 172.21.15.16:0/2954330255 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff80035b0 con 0x7fc00c0b83f0 2023-06-08T04:02:07.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.737+0000 7fc003fff700 1 -- 172.21.15.16:0/2954330255 >> v1:172.21.15.169:6789/0 conn(0x7fc00c0b4b50 legacy=0x7fc00c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.737+0000 7fc003fff700 1 -- 172.21.15.16:0/2954330255 >> v1:172.21.15.16:6789/0 conn(0x7fc00c0b83f0 legacy=0x7fc00c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.737+0000 7fc003fff700 1 -- 172.21.15.16:0/2954330255 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c0cd4c0 con 0x7fc00c160a60 2023-06-08T04:02:07.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.737+0000 7fc003fff700 1 --2- 172.21.15.16:0/2954330255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc00c160a60 0x7fc00c0b4610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009840 tx=0x7fbff4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c426a2a878ff96 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:07.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.737+0000 7fc009d9b700 1 -- 172.21.15.16:0/2954330255 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4011830 con 0x7fc00c160a60 2023-06-08T04:02:07.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.737+0000 7fc009d9b700 1 -- 172.21.15.16:0/2954330255 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4011990 con 0x7fc00c160a60 2023-06-08T04:02:07.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.737+0000 7fc009d9b700 1 -- 172.21.15.16:0/2954330255 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4011d20 con 0x7fc00c160a60 2023-06-08T04:02:07.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.738+0000 7fc010bff700 1 -- 172.21.15.16:0/2954330255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc00c160a60 msgr2=0x7fc00c0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.738+0000 7fc010bff700 1 --2- 172.21.15.16:0/2954330255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc00c160a60 0x7fc00c0b4610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009840 tx=0x7fbff4009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:07.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.738+0000 7fc010bff700 1 -- 172.21.15.16:0/2954330255 shutdown_connections 2023-06-08T04:02:07.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.738+0000 7fc010bff700 1 --2- 172.21.15.16:0/2954330255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc00c160a60 0x7fc00c0b4610 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.738+0000 7fc010bff700 1 -- 172.21.15.16:0/2954330255 >> 172.21.15.16:0/2954330255 conn(0x7fc00c0cf610 msgr2=0x7fc00c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.738+0000 7fc010bff700 1 -- 172.21.15.16:0/2954330255 shutdown_connections 2023-06-08T04:02:07.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.738+0000 7fc010bff700 1 -- 172.21.15.16:0/2954330255 wait complete. 2023-06-08T04:02:07.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.739+0000 7fc010bff700 1 Processor -- start 2023-06-08T04:02:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.740+0000 7fc010bff700 1 -- start start 2023-06-08T04:02:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.740+0000 7fc010bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc00c0b4b50 0x7fc00c1e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.740+0000 7fc010bff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc00c0b83f0 0x7fc00c150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.740+0000 7fc010bff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc00c160a60 0x7fc00c0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.740+0000 7fc010bff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c1511c0 con 0x7fc00c160a60 2023-06-08T04:02:07.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.740+0000 7fc010bff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c150c60 con 0x7fc00c0b83f0 2023-06-08T04:02:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.740+0000 7fc010bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c15dc20 con 0x7fc00c0b4b50 2023-06-08T04:02:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.741+0000 7fc00ad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc00c160a60 0x7fc00c0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.741+0000 7fc00ad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc00c160a60 0x7fc00c0b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42322/0 (socket says 172.21.15.16:42322) 2023-06-08T04:02:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.741+0000 7fc00ad9d700 1 -- 172.21.15.16:0/1430605814 learned_addr learned my addr 172.21.15.16:0/1430605814 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.741+0000 7fc00a59c700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc00c0b4b50 0x7fc00c1e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.741+0000 7fc003fff700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc00c0b83f0 0x7fc00c150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.741+0000 7fc00ad9d700 1 -- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc00c0b4b50 msgr2=0x7fc00c1e5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.741+0000 7fc00ad9d700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc00c0b4b50 0x7fc00c1e5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.741+0000 7fc00ad9d700 1 -- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc00c0b83f0 msgr2=0x7fc00c150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.741+0000 7fc00ad9d700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc00c0b83f0 0x7fc00c150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.741+0000 7fc00ad9d700 1 -- 172.21.15.16:0/1430605814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff40094a0 con 0x7fc00c160a60 2023-06-08T04:02:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.741+0000 7fc00ad9d700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc00c160a60 0x7fc00c0b59c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc00400cb80 tx=0x7fc00400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.742+0000 7fc002ffd700 1 -- 172.21.15.16:0/1430605814 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004003c00 con 0x7fc00c160a60 2023-06-08T04:02:07.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.742+0000 7fc002ffd700 1 -- 172.21.15.16:0/1430605814 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc004003d60 con 0x7fc00c160a60 2023-06-08T04:02:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.742+0000 7fc002ffd700 1 -- 172.21.15.16:0/1430605814 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00400aaa0 con 0x7fc00c160a60 2023-06-08T04:02:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.742+0000 7fc010bff700 1 -- 172.21.15.16:0/1430605814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c15df00 con 0x7fc00c160a60 2023-06-08T04:02:07.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.742+0000 7fc010bff700 1 -- 172.21.15.16:0/1430605814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c15e4c0 con 0x7fc00c160a60 2023-06-08T04:02:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.743+0000 7fc010bff700 1 -- 172.21.15.16:0/1430605814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c0740e0 con 0x7fc00c160a60 2023-06-08T04:02:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.744+0000 7fc002ffd700 1 -- 172.21.15.16:0/1430605814 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc00400ac00 con 0x7fc00c160a60 2023-06-08T04:02:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.745+0000 7fc002ffd700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfec06ace0 0x7fbfec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.745+0000 7fc002ffd700 1 -- 172.21.15.16:0/1430605814 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc004089430 con 0x7fc00c160a60 2023-06-08T04:02:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.745+0000 7fc00a59c700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfec06ace0 0x7fbfec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:07.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.746+0000 7fc00a59c700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfec06ace0 0x7fbfec06d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbffc007fd0 tx=0x7fbffc007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:07.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.749+0000 7fc002ffd700 1 -- 172.21.15.16:0/1430605814 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc004054450 con 0x7fc00c160a60 2023-06-08T04:02:07.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.952+0000 7fc010bff700 1 -- 172.21.15.16:0/1430605814 --> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc00c0d0aa0 con 0x7fbfec06ace0 2023-06-08T04:02:07.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.961+0000 7fc002ffd700 1 -- 172.21.15.16:0/1430605814 <== mgr.4103 v2:172.21.15.169:6832/2339348297 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286891 (secure 0 0 0) 0x7fbffc0058e0 con 0x7fbfec06ace0 2023-06-08T04:02:07.968 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:07.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.965+0000 7fc010bff700 1 -- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfec06ace0 msgr2=0x7fbfec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.965+0000 7fc010bff700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfec06ace0 0x7fbfec06d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbffc007fd0 tx=0x7fbffc007dc0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.965+0000 7fc010bff700 1 -- 172.21.15.16:0/1430605814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc00c160a60 msgr2=0x7fc00c0b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:07.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.965+0000 7fc010bff700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc00c160a60 0x7fc00c0b59c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc00400cb80 tx=0x7fc00400ce90 comp rx=0 tx=0).stop 2023-06-08T04:02:07.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.966+0000 7fc010bff700 1 -- 172.21.15.16:0/1430605814 shutdown_connections 2023-06-08T04:02:07.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.966+0000 7fc010bff700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfec06ace0 0x7fbfec06d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.966+0000 7fc010bff700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc00c160a60 0x7fc00c0b59c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.966+0000 7fc010bff700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc00c0b4b50 0x7fc00c1e5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.966+0000 7fc010bff700 1 --2- 172.21.15.16:0/1430605814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc00c0b83f0 0x7fc00c150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:07.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.966+0000 7fc010bff700 1 -- 172.21.15.16:0/1430605814 >> 172.21.15.16:0/1430605814 conn(0x7fc00c0cf610 msgr2=0x7fc00c0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:07.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.966+0000 7fc010bff700 1 -- 172.21.15.16:0/1430605814 shutdown_connections 2023-06-08T04:02:07.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:07.966+0000 7fc010bff700 1 -- 172.21.15.16:0/1430605814 wait complete. 2023-06-08T04:02:07.972 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-06-08T04:02:07.987 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-06-08T04:02:06.186292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218532,"kb_used_data":2916,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756188,"statfs":{"total":773094113280,"available":772870336512,"internally_reserved":0,"allocated":2985984,"data_stored":1820154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.895839"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294976+0000","last_change":"2023-06-08T04:01:57.299413+0000","last_active":"2023-06-08T04:01:58.294976+0000","last_peered":"2023-06-08T04:01:58.294976+0000","last_clean":"2023-06-08T04:01:58.294976+0000","last_became_active":"2023-06-08T04:01:57.299094+0000","last_became_peered":"2023-06-08T04:01:57.299094+0000","last_unstale":"2023-06-08T04:01:58.294976+0000","last_undegraded":"2023-06-08T04:01:58.294976+0000","last_fullsized":"2023-06-08T04:01:58.294976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:10:14.491590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298272+0000","last_change":"2023-06-08T04:01:57.311826+0000","last_active":"2023-06-08T04:01:58.298272+0000","last_peered":"2023-06-08T04:01:58.298272+0000","last_clean":"2023-06-08T04:01:58.298272+0000","last_became_active":"2023-06-08T04:01:57.311286+0000","last_became_peered":"2023-06-08T04:01:57.311286+0000","last_unstale":"2023-06-08T04:01:58.298272+0000","last_undegraded":"2023-06-08T04:01:58.298272+0000","last_fullsized":"2023-06-08T04:01:58.298272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:17.091490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679534+0000","last_change":"2023-06-08T04:01:57.320078+0000","last_active":"2023-06-08T04:01:58.679534+0000","last_peered":"2023-06-08T04:01:58.679534+0000","last_clean":"2023-06-08T04:01:58.679534+0000","last_became_active":"2023-06-08T04:01:57.319745+0000","last_became_peered":"2023-06-08T04:01:57.319745+0000","last_unstale":"2023-06-08T04:01:58.679534+0000","last_undegraded":"2023-06-08T04:01:58.679534+0000","last_fullsized":"2023-06-08T04:01:58.679534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:13.980384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679647+0000","last_change":"2023-06-08T04:01:57.319387+0000","last_active":"2023-06-08T04:01:58.679647+0000","last_peered":"2023-06-08T04:01:58.679647+0000","last_clean":"2023-06-08T04:01:58.679647+0000","last_became_active":"2023-06-08T04:01:57.319108+0000","last_became_peered":"2023-06-08T04:01:57.319108+0000","last_unstale":"2023-06-08T04:01:58.679647+0000","last_undegraded":"2023-06-08T04:01:58.679647+0000","last_fullsized":"2023-06-08T04:01:58.679647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679228+0000","last_change":"2023-06-08T04:01:57.309338+0000","last_active":"2023-06-08T04:01:58.679228+0000","last_peered":"2023-06-08T04:01:58.679228+0000","last_clean":"2023-06-08T04:01:58.679228+0000","last_became_active":"2023-06-08T04:01:57.308408+0000","last_became_peered":"2023-06-08T04:01:57.308408+0000","last_unstale":"2023-06-08T04:01:58.679228+0000","last_undegraded":"2023-06-08T04:01:58.679228+0000","last_fullsized":"2023-06-08T04:01:58.679228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680027+0000","last_change":"2023-06-08T04:01:57.322730+0000","last_active":"2023-06-08T04:01:58.680027+0000","last_peered":"2023-06-08T04:01:58.680027+0000","last_clean":"2023-06-08T04:01:58.680027+0000","last_became_active":"2023-06-08T04:01:57.322349+0000","last_became_peered":"2023-06-08T04:01:57.322349+0000","last_unstale":"2023-06-08T04:01:58.680027+0000","last_undegraded":"2023-06-08T04:01:58.680027+0000","last_fullsized":"2023-06-08T04:01:58.680027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:51:05.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297855+0000","last_change":"2023-06-08T04:01:57.316863+0000","last_active":"2023-06-08T04:01:58.297855+0000","last_peered":"2023-06-08T04:01:58.297855+0000","last_clean":"2023-06-08T04:01:58.297855+0000","last_became_active":"2023-06-08T04:01:57.315117+0000","last_became_peered":"2023-06-08T04:01:57.315117+0000","last_unstale":"2023-06-08T04:01:58.297855+0000","last_undegraded":"2023-06-08T04:01:58.297855+0000","last_fullsized":"2023-06-08T04:01:58.297855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298377+0000","last_change":"2023-06-08T04:01:57.323352+0000","last_active":"2023-06-08T04:01:58.298377+0000","last_peered":"2023-06-08T04:01:58.298377+0000","last_clean":"2023-06-08T04:01:58.298377+0000","last_became_active":"2023-06-08T04:01:57.323064+0000","last_became_peered":"2023-06-08T04:01:57.323064+0000","last_unstale":"2023-06-08T04:01:58.298377+0000","last_undegraded":"2023-06-08T04:01:58.298377+0000","last_fullsized":"2023-06-08T04:01:58.298377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680108+0000","last_change":"2023-06-08T04:01:57.306101+0000","last_active":"2023-06-08T04:01:58.680108+0000","last_peered":"2023-06-08T04:01:58.680108+0000","last_clean":"2023-06-08T04:01:58.680108+0000","last_became_active":"2023-06-08T04:01:57.305817+0000","last_became_peered":"2023-06-08T04:01:57.305817+0000","last_unstale":"2023-06-08T04:01:58.680108+0000","last_undegraded":"2023-06-08T04:01:58.680108+0000","last_fullsized":"2023-06-08T04:01:58.680108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298566+0000","last_change":"2023-06-08T04:01:57.309420+0000","last_active":"2023-06-08T04:01:58.298566+0000","last_peered":"2023-06-08T04:01:58.298566+0000","last_clean":"2023-06-08T04:01:58.298566+0000","last_became_active":"2023-06-08T04:01:57.309076+0000","last_became_peered":"2023-06-08T04:01:57.309076+0000","last_unstale":"2023-06-08T04:01:58.298566+0000","last_undegraded":"2023-06-08T04:01:58.298566+0000","last_fullsized":"2023-06-08T04:01:58.298566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679683+0000","last_change":"2023-06-08T04:01:57.324575+0000","last_active":"2023-06-08T04:01:58.679683+0000","last_peered":"2023-06-08T04:01:58.679683+0000","last_clean":"2023-06-08T04:01:58.679683+0000","last_became_active":"2023-06-08T04:01:57.323557+0000","last_became_peered":"2023-06-08T04:01:57.323557+0000","last_unstale":"2023-06-08T04:01:58.679683+0000","last_undegraded":"2023-06-08T04:01:58.679683+0000","last_fullsized":"2023-06-08T04:01:58.679683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:47.350874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294799+0000","last_change":"2023-06-08T04:01:57.324310+0000","last_active":"2023-06-08T04:01:58.294799+0000","last_peered":"2023-06-08T04:01:58.294799+0000","last_clean":"2023-06-08T04:01:58.294799+0000","last_became_active":"2023-06-08T04:01:57.324044+0000","last_became_peered":"2023-06-08T04:01:57.324044+0000","last_unstale":"2023-06-08T04:01:58.294799+0000","last_undegraded":"2023-06-08T04:01:58.294799+0000","last_fullsized":"2023-06-08T04:01:58.294799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:15:47.285133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294647+0000","last_change":"2023-06-08T04:01:57.300242+0000","last_active":"2023-06-08T04:01:58.294647+0000","last_peered":"2023-06-08T04:01:58.294647+0000","last_clean":"2023-06-08T04:01:58.294647+0000","last_became_active":"2023-06-08T04:01:57.299927+0000","last_became_peered":"2023-06-08T04:01:57.299927+0000","last_unstale":"2023-06-08T04:01:58.294647+0000","last_undegraded":"2023-06-08T04:01:58.294647+0000","last_fullsized":"2023-06-08T04:01:58.294647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:03:23.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298679+0000","last_change":"2023-06-08T04:01:57.309428+0000","last_active":"2023-06-08T04:01:58.298679+0000","last_peered":"2023-06-08T04:01:58.298679+0000","last_clean":"2023-06-08T04:01:58.298679+0000","last_became_active":"2023-06-08T04:01:57.309107+0000","last_became_peered":"2023-06-08T04:01:57.309107+0000","last_unstale":"2023-06-08T04:01:58.298679+0000","last_undegraded":"2023-06-08T04:01:58.298679+0000","last_fullsized":"2023-06-08T04:01:58.298679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298112+0000","last_change":"2023-06-08T04:01:57.317232+0000","last_active":"2023-06-08T04:01:58.298112+0000","last_peered":"2023-06-08T04:01:58.298112+0000","last_clean":"2023-06-08T04:01:58.298112+0000","last_became_active":"2023-06-08T04:01:57.316821+0000","last_became_peered":"2023-06-08T04:01:57.316821+0000","last_unstale":"2023-06-08T04:01:58.298112+0000","last_undegraded":"2023-06-08T04:01:58.298112+0000","last_fullsized":"2023-06-08T04:01:58.298112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:18.694789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678985+0000","last_change":"2023-06-08T04:01:57.314928+0000","last_active":"2023-06-08T04:01:58.678985+0000","last_peered":"2023-06-08T04:01:58.678985+0000","last_clean":"2023-06-08T04:01:58.678985+0000","last_became_active":"2023-06-08T04:01:57.314630+0000","last_became_peered":"2023-06-08T04:01:57.314630+0000","last_unstale":"2023-06-08T04:01:58.678985+0000","last_undegraded":"2023-06-08T04:01:58.678985+0000","last_fullsized":"2023-06-08T04:01:58.678985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:50.348618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680237+0000","last_change":"2023-06-08T04:01:57.304277+0000","last_active":"2023-06-08T04:01:58.680237+0000","last_peered":"2023-06-08T04:01:58.680237+0000","last_clean":"2023-06-08T04:01:58.680237+0000","last_became_active":"2023-06-08T04:01:57.303959+0000","last_became_peered":"2023-06-08T04:01:57.303959+0000","last_unstale":"2023-06-08T04:01:58.680237+0000","last_undegraded":"2023-06-08T04:01:58.680237+0000","last_fullsized":"2023-06-08T04:01:58.680237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679694+0000","last_change":"2023-06-08T04:01:57.316825+0000","last_active":"2023-06-08T04:01:58.679694+0000","last_peered":"2023-06-08T04:01:58.679694+0000","last_clean":"2023-06-08T04:01:58.679694+0000","last_became_active":"2023-06-08T04:01:57.315505+0000","last_became_peered":"2023-06-08T04:01:57.315505+0000","last_unstale":"2023-06-08T04:01:58.679694+0000","last_undegraded":"2023-06-08T04:01:58.679694+0000","last_fullsized":"2023-06-08T04:01:58.679694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294748+0000","last_change":"2023-06-08T04:01:57.317700+0000","last_active":"2023-06-08T04:01:58.294748+0000","last_peered":"2023-06-08T04:01:58.294748+0000","last_clean":"2023-06-08T04:01:58.294748+0000","last_became_active":"2023-06-08T04:01:57.317409+0000","last_became_peered":"2023-06-08T04:01:57.317409+0000","last_unstale":"2023-06-08T04:01:58.294748+0000","last_undegraded":"2023-06-08T04:01:58.294748+0000","last_fullsized":"2023-06-08T04:01:58.294748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:21:07.937389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680014+0000","last_change":"2023-06-08T04:01:57.327000+0000","last_active":"2023-06-08T04:01:58.680014+0000","last_peered":"2023-06-08T04:01:58.680014+0000","last_clean":"2023-06-08T04:01:58.680014+0000","last_became_active":"2023-06-08T04:01:57.326736+0000","last_became_peered":"2023-06-08T04:01:57.326736+0000","last_unstale":"2023-06-08T04:01:58.680014+0000","last_undegraded":"2023-06-08T04:01:58.680014+0000","last_fullsized":"2023-06-08T04:01:58.680014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:53:41.237371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298091+0000","last_change":"2023-06-08T04:01:57.320374+0000","last_active":"2023-06-08T04:01:58.298091+0000","last_peered":"2023-06-08T04:01:58.298091+0000","last_clean":"2023-06-08T04:01:58.298091+0000","last_became_active":"2023-06-08T04:01:57.320093+0000","last_became_peered":"2023-06-08T04:01:57.320093+0000","last_unstale":"2023-06-08T04:01:58.298091+0000","last_undegraded":"2023-06-08T04:01:58.298091+0000","last_fullsized":"2023-06-08T04:01:58.298091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678990+0000","last_change":"2023-06-08T04:01:57.307041+0000","last_active":"2023-06-08T04:01:58.678990+0000","last_peered":"2023-06-08T04:01:58.678990+0000","last_clean":"2023-06-08T04:01:58.678990+0000","last_became_active":"2023-06-08T04:01:57.306750+0000","last_became_peered":"2023-06-08T04:01:57.306750+0000","last_unstale":"2023-06-08T04:01:58.678990+0000","last_undegraded":"2023-06-08T04:01:58.678990+0000","last_fullsized":"2023-06-08T04:01:58.678990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:20.141121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679647+0000","last_change":"2023-06-08T04:01:57.305284+0000","last_active":"2023-06-08T04:01:58.679647+0000","last_peered":"2023-06-08T04:01:58.679647+0000","last_clean":"2023-06-08T04:01:58.679647+0000","last_became_active":"2023-06-08T04:01:57.304750+0000","last_became_peered":"2023-06-08T04:01:57.304750+0000","last_unstale":"2023-06-08T04:01:58.679647+0000","last_undegraded":"2023-06-08T04:01:58.679647+0000","last_fullsized":"2023-06-08T04:01:58.679647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:21.118831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297864+0000","last_change":"2023-06-08T04:01:57.319635+0000","last_active":"2023-06-08T04:01:58.297864+0000","last_peered":"2023-06-08T04:01:58.297864+0000","last_clean":"2023-06-08T04:01:58.297864+0000","last_became_active":"2023-06-08T04:01:57.319342+0000","last_became_peered":"2023-06-08T04:01:57.319342+0000","last_unstale":"2023-06-08T04:01:58.297864+0000","last_undegraded":"2023-06-08T04:01:58.297864+0000","last_fullsized":"2023-06-08T04:01:58.297864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:54.420632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679843+0000","last_change":"2023-06-08T04:01:57.313530+0000","last_active":"2023-06-08T04:01:58.679843+0000","last_peered":"2023-06-08T04:01:58.679843+0000","last_clean":"2023-06-08T04:01:58.679843+0000","last_became_active":"2023-06-08T04:01:57.313216+0000","last_became_peered":"2023-06-08T04:01:57.313216+0000","last_unstale":"2023-06-08T04:01:58.679843+0000","last_undegraded":"2023-06-08T04:01:58.679843+0000","last_fullsized":"2023-06-08T04:01:58.679843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680049+0000","last_change":"2023-06-08T04:01:57.312444+0000","last_active":"2023-06-08T04:01:58.680049+0000","last_peered":"2023-06-08T04:01:58.680049+0000","last_clean":"2023-06-08T04:01:58.680049+0000","last_became_active":"2023-06-08T04:01:57.312127+0000","last_became_peered":"2023-06-08T04:01:57.312127+0000","last_unstale":"2023-06-08T04:01:58.680049+0000","last_undegraded":"2023-06-08T04:01:58.680049+0000","last_fullsized":"2023-06-08T04:01:58.680049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298912+0000","last_change":"2023-06-08T04:01:57.311749+0000","last_active":"2023-06-08T04:01:58.298912+0000","last_peered":"2023-06-08T04:01:58.298912+0000","last_clean":"2023-06-08T04:01:58.298912+0000","last_became_active":"2023-06-08T04:01:57.311478+0000","last_became_peered":"2023-06-08T04:01:57.311478+0000","last_unstale":"2023-06-08T04:01:58.298912+0000","last_undegraded":"2023-06-08T04:01:58.298912+0000","last_fullsized":"2023-06-08T04:01:58.298912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680117+0000","last_change":"2023-06-08T04:01:56.788030+0000","last_active":"2023-06-08T04:01:58.680117+0000","last_peered":"2023-06-08T04:01:58.680117+0000","last_clean":"2023-06-08T04:01:58.680117+0000","last_became_active":"2023-06-08T04:01:56.787625+0000","last_became_peered":"2023-06-08T04:01:56.787625+0000","last_unstale":"2023-06-08T04:01:58.680117+0000","last_undegraded":"2023-06-08T04:01:58.680117+0000","last_fullsized":"2023-06-08T04:01:58.680117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:19.055855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679624+0000","last_change":"2023-06-08T04:01:57.308473+0000","last_active":"2023-06-08T04:01:58.679624+0000","last_peered":"2023-06-08T04:01:58.679624+0000","last_clean":"2023-06-08T04:01:58.679624+0000","last_became_active":"2023-06-08T04:01:57.307707+0000","last_became_peered":"2023-06-08T04:01:57.307707+0000","last_unstale":"2023-06-08T04:01:58.679624+0000","last_undegraded":"2023-06-08T04:01:58.679624+0000","last_fullsized":"2023-06-08T04:01:58.679624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678826+0000","last_change":"2023-06-08T04:01:56.782915+0000","last_active":"2023-06-08T04:01:58.678826+0000","last_peered":"2023-06-08T04:01:58.678826+0000","last_clean":"2023-06-08T04:01:58.678826+0000","last_became_active":"2023-06-08T04:01:56.782574+0000","last_became_peered":"2023-06-08T04:01:56.782574+0000","last_unstale":"2023-06-08T04:01:58.678826+0000","last_undegraded":"2023-06-08T04:01:58.678826+0000","last_fullsized":"2023-06-08T04:01:58.678826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:19.133778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680505+0000","last_change":"2023-06-08T04:01:57.310946+0000","last_active":"2023-06-08T04:01:58.680505+0000","last_peered":"2023-06-08T04:01:58.680505+0000","last_clean":"2023-06-08T04:01:58.680505+0000","last_became_active":"2023-06-08T04:01:57.310665+0000","last_became_peered":"2023-06-08T04:01:57.310665+0000","last_unstale":"2023-06-08T04:01:58.680505+0000","last_undegraded":"2023-06-08T04:01:58.680505+0000","last_fullsized":"2023-06-08T04:01:58.680505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:54.420632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679960+0000","last_change":"2023-06-08T04:01:56.781278+0000","last_active":"2023-06-08T04:01:58.679960+0000","last_peered":"2023-06-08T04:01:58.679960+0000","last_clean":"2023-06-08T04:01:58.679960+0000","last_became_active":"2023-06-08T04:01:56.780953+0000","last_became_peered":"2023-06-08T04:01:56.780953+0000","last_unstale":"2023-06-08T04:01:58.679960+0000","last_undegraded":"2023-06-08T04:01:58.679960+0000","last_fullsized":"2023-06-08T04:01:58.679960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:12.973041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679890+0000","last_change":"2023-06-08T04:01:57.313256+0000","last_active":"2023-06-08T04:01:58.679890+0000","last_peered":"2023-06-08T04:01:58.679890+0000","last_clean":"2023-06-08T04:01:58.679890+0000","last_became_active":"2023-06-08T04:01:57.312990+0000","last_became_peered":"2023-06-08T04:01:57.312990+0000","last_unstale":"2023-06-08T04:01:58.679890+0000","last_undegraded":"2023-06-08T04:01:58.679890+0000","last_fullsized":"2023-06-08T04:01:58.679890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680347+0000","last_change":"2023-06-08T04:01:56.773826+0000","last_active":"2023-06-08T04:01:58.680347+0000","last_peered":"2023-06-08T04:01:58.680347+0000","last_clean":"2023-06-08T04:01:58.680347+0000","last_became_active":"2023-06-08T04:01:56.773459+0000","last_became_peered":"2023-06-08T04:01:56.773459+0000","last_unstale":"2023-06-08T04:01:58.680347+0000","last_undegraded":"2023-06-08T04:01:58.680347+0000","last_fullsized":"2023-06-08T04:01:58.680347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:24.507881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679843+0000","last_change":"2023-06-08T04:01:57.304560+0000","last_active":"2023-06-08T04:01:58.679843+0000","last_peered":"2023-06-08T04:01:58.679843+0000","last_clean":"2023-06-08T04:01:58.679843+0000","last_became_active":"2023-06-08T04:01:57.304311+0000","last_became_peered":"2023-06-08T04:01:57.304311+0000","last_unstale":"2023-06-08T04:01:58.679843+0000","last_undegraded":"2023-06-08T04:01:58.679843+0000","last_fullsized":"2023-06-08T04:01:58.679843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:12:00.959096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298423+0000","last_change":"2023-06-08T04:01:56.783994+0000","last_active":"2023-06-08T04:01:58.298423+0000","last_peered":"2023-06-08T04:01:58.298423+0000","last_clean":"2023-06-08T04:01:58.298423+0000","last_became_active":"2023-06-08T04:01:56.783344+0000","last_became_peered":"2023-06-08T04:01:56.783344+0000","last_unstale":"2023-06-08T04:01:58.298423+0000","last_undegraded":"2023-06-08T04:01:58.298423+0000","last_fullsized":"2023-06-08T04:01:58.298423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:42.712772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680687+0000","last_change":"2023-06-08T04:01:57.313756+0000","last_active":"2023-06-08T04:01:58.680687+0000","last_peered":"2023-06-08T04:01:58.680687+0000","last_clean":"2023-06-08T04:01:58.680687+0000","last_became_active":"2023-06-08T04:01:57.313436+0000","last_became_peered":"2023-06-08T04:01:57.313436+0000","last_unstale":"2023-06-08T04:01:58.680687+0000","last_undegraded":"2023-06-08T04:01:58.680687+0000","last_fullsized":"2023-06-08T04:01:58.680687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:19:05.998159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299112+0000","last_change":"2023-06-08T04:01:56.788377+0000","last_active":"2023-06-08T04:01:58.299112+0000","last_peered":"2023-06-08T04:01:58.299112+0000","last_clean":"2023-06-08T04:01:58.299112+0000","last_became_active":"2023-06-08T04:01:56.788107+0000","last_became_peered":"2023-06-08T04:01:56.788107+0000","last_unstale":"2023-06-08T04:01:58.299112+0000","last_undegraded":"2023-06-08T04:01:58.299112+0000","last_fullsized":"2023-06-08T04:01:58.299112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:11.801004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679085+0000","last_change":"2023-06-08T04:01:57.313322+0000","last_active":"2023-06-08T04:01:58.679085+0000","last_peered":"2023-06-08T04:01:58.679085+0000","last_clean":"2023-06-08T04:01:58.679085+0000","last_became_active":"2023-06-08T04:01:57.312901+0000","last_became_peered":"2023-06-08T04:01:57.312901+0000","last_unstale":"2023-06-08T04:01:58.679085+0000","last_undegraded":"2023-06-08T04:01:58.679085+0000","last_fullsized":"2023-06-08T04:01:58.679085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679636+0000","last_change":"2023-06-08T04:01:56.787707+0000","last_active":"2023-06-08T04:01:58.679636+0000","last_peered":"2023-06-08T04:01:58.679636+0000","last_clean":"2023-06-08T04:01:58.679636+0000","last_became_active":"2023-06-08T04:01:56.787416+0000","last_became_peered":"2023-06-08T04:01:56.787416+0000","last_unstale":"2023-06-08T04:01:58.679636+0000","last_undegraded":"2023-06-08T04:01:58.679636+0000","last_fullsized":"2023-06-08T04:01:58.679636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:17.687446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679084+0000","last_change":"2023-06-08T04:01:57.330479+0000","last_active":"2023-06-08T04:01:58.679084+0000","last_peered":"2023-06-08T04:01:58.679084+0000","last_clean":"2023-06-08T04:01:58.679084+0000","last_became_active":"2023-06-08T04:01:57.330160+0000","last_became_peered":"2023-06-08T04:01:57.330160+0000","last_unstale":"2023-06-08T04:01:58.679084+0000","last_undegraded":"2023-06-08T04:01:58.679084+0000","last_fullsized":"2023-06-08T04:01:58.679084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298027+0000","last_change":"2023-06-08T04:01:56.784611+0000","last_active":"2023-06-08T04:01:58.298027+0000","last_peered":"2023-06-08T04:01:58.298027+0000","last_clean":"2023-06-08T04:01:58.298027+0000","last_became_active":"2023-06-08T04:01:56.784281+0000","last_became_peered":"2023-06-08T04:01:56.784281+0000","last_unstale":"2023-06-08T04:01:58.298027+0000","last_undegraded":"2023-06-08T04:01:58.298027+0000","last_fullsized":"2023-06-08T04:01:58.298027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:12.973041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679123+0000","last_change":"2023-06-08T04:01:57.308023+0000","last_active":"2023-06-08T04:01:58.679123+0000","last_peered":"2023-06-08T04:01:58.679123+0000","last_clean":"2023-06-08T04:01:58.679123+0000","last_became_active":"2023-06-08T04:01:57.307736+0000","last_became_peered":"2023-06-08T04:01:57.307736+0000","last_unstale":"2023-06-08T04:01:58.679123+0000","last_undegraded":"2023-06-08T04:01:58.679123+0000","last_fullsized":"2023-06-08T04:01:58.679123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679194+0000","last_change":"2023-06-08T04:01:56.785032+0000","last_active":"2023-06-08T04:01:58.679194+0000","last_peered":"2023-06-08T04:01:58.679194+0000","last_clean":"2023-06-08T04:01:58.679194+0000","last_became_active":"2023-06-08T04:01:56.784737+0000","last_became_peered":"2023-06-08T04:01:56.784737+0000","last_unstale":"2023-06-08T04:01:58.679194+0000","last_undegraded":"2023-06-08T04:01:58.679194+0000","last_fullsized":"2023-06-08T04:01:58.679194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:16.084147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298926+0000","last_change":"2023-06-08T04:01:57.311452+0000","last_active":"2023-06-08T04:01:58.298926+0000","last_peered":"2023-06-08T04:01:58.298926+0000","last_clean":"2023-06-08T04:01:58.298926+0000","last_became_active":"2023-06-08T04:01:57.311216+0000","last_became_peered":"2023-06-08T04:01:57.311216+0000","last_unstale":"2023-06-08T04:01:58.298926+0000","last_undegraded":"2023-06-08T04:01:58.298926+0000","last_fullsized":"2023-06-08T04:01:58.298926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:25.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298001+0000","last_change":"2023-06-08T04:01:56.787492+0000","last_active":"2023-06-08T04:01:58.298001+0000","last_peered":"2023-06-08T04:01:58.298001+0000","last_clean":"2023-06-08T04:01:58.298001+0000","last_became_active":"2023-06-08T04:01:56.787212+0000","last_became_peered":"2023-06-08T04:01:56.787212+0000","last_unstale":"2023-06-08T04:01:58.298001+0000","last_undegraded":"2023-06-08T04:01:58.298001+0000","last_fullsized":"2023-06-08T04:01:58.298001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:11:59.951753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680188+0000","last_change":"2023-06-08T04:01:57.307696+0000","last_active":"2023-06-08T04:01:58.680188+0000","last_peered":"2023-06-08T04:01:58.680188+0000","last_clean":"2023-06-08T04:01:58.680188+0000","last_became_active":"2023-06-08T04:01:57.307394+0000","last_became_peered":"2023-06-08T04:01:57.307394+0000","last_unstale":"2023-06-08T04:01:58.680188+0000","last_undegraded":"2023-06-08T04:01:58.680188+0000","last_fullsized":"2023-06-08T04:01:58.680188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679211+0000","last_change":"2023-06-08T04:01:56.792893+0000","last_active":"2023-06-08T04:01:58.679211+0000","last_peered":"2023-06-08T04:01:58.679211+0000","last_clean":"2023-06-08T04:01:58.679211+0000","last_became_active":"2023-06-08T04:01:56.792583+0000","last_became_peered":"2023-06-08T04:01:56.792583+0000","last_unstale":"2023-06-08T04:01:58.679211+0000","last_undegraded":"2023-06-08T04:01:58.679211+0000","last_fullsized":"2023-06-08T04:01:58.679211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:51:11.572500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679629+0000","last_change":"2023-06-08T04:01:57.313638+0000","last_active":"2023-06-08T04:01:58.679629+0000","last_peered":"2023-06-08T04:01:58.679629+0000","last_clean":"2023-06-08T04:01:58.679629+0000","last_became_active":"2023-06-08T04:01:57.313084+0000","last_became_peered":"2023-06-08T04:01:57.313084+0000","last_unstale":"2023-06-08T04:01:58.679629+0000","last_undegraded":"2023-06-08T04:01:58.679629+0000","last_fullsized":"2023-06-08T04:01:58.679629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:23.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298175+0000","last_change":"2023-06-08T04:01:56.786135+0000","last_active":"2023-06-08T04:01:58.298175+0000","last_peered":"2023-06-08T04:01:58.298175+0000","last_clean":"2023-06-08T04:01:58.298175+0000","last_became_active":"2023-06-08T04:01:56.785831+0000","last_became_peered":"2023-06-08T04:01:56.785831+0000","last_unstale":"2023-06-08T04:01:58.298175+0000","last_undegraded":"2023-06-08T04:01:58.298175+0000","last_fullsized":"2023-06-08T04:01:58.298175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:46.343531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298483+0000","last_change":"2023-06-08T04:01:57.311375+0000","last_active":"2023-06-08T04:01:58.298483+0000","last_peered":"2023-06-08T04:01:58.298483+0000","last_clean":"2023-06-08T04:01:58.298483+0000","last_became_active":"2023-06-08T04:01:57.310796+0000","last_became_peered":"2023-06-08T04:01:57.310796+0000","last_unstale":"2023-06-08T04:01:58.298483+0000","last_undegraded":"2023-06-08T04:01:58.298483+0000","last_fullsized":"2023-06-08T04:01:58.298483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:41.897231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298396+0000","last_change":"2023-06-08T04:01:56.786840+0000","last_active":"2023-06-08T04:01:58.298396+0000","last_peered":"2023-06-08T04:01:58.298396+0000","last_clean":"2023-06-08T04:01:58.298396+0000","last_became_active":"2023-06-08T04:01:56.786481+0000","last_became_peered":"2023-06-08T04:01:56.786481+0000","last_unstale":"2023-06-08T04:01:58.298396+0000","last_undegraded":"2023-06-08T04:01:58.298396+0000","last_fullsized":"2023-06-08T04:01:58.298396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:19:04.990816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678894+0000","last_change":"2023-06-08T04:01:57.324051+0000","last_active":"2023-06-08T04:01:58.678894+0000","last_peered":"2023-06-08T04:01:58.678894+0000","last_clean":"2023-06-08T04:01:58.678894+0000","last_became_active":"2023-06-08T04:01:57.323207+0000","last_became_peered":"2023-06-08T04:01:57.323207+0000","last_unstale":"2023-06-08T04:01:58.678894+0000","last_undegraded":"2023-06-08T04:01:58.678894+0000","last_fullsized":"2023-06-08T04:01:58.678894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299059+0000","last_change":"2023-06-08T04:01:56.785385+0000","last_active":"2023-06-08T04:01:58.299059+0000","last_peered":"2023-06-08T04:01:58.299059+0000","last_clean":"2023-06-08T04:01:58.299059+0000","last_became_active":"2023-06-08T04:01:56.785079+0000","last_became_peered":"2023-06-08T04:01:56.785079+0000","last_unstale":"2023-06-08T04:01:58.299059+0000","last_undegraded":"2023-06-08T04:01:58.299059+0000","last_fullsized":"2023-06-08T04:01:58.299059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:56.785165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679791+0000","last_change":"2023-06-08T04:01:57.313448+0000","last_active":"2023-06-08T04:01:58.679791+0000","last_peered":"2023-06-08T04:01:58.679791+0000","last_clean":"2023-06-08T04:01:58.679791+0000","last_became_active":"2023-06-08T04:01:57.312734+0000","last_became_peered":"2023-06-08T04:01:57.312734+0000","last_unstale":"2023-06-08T04:01:58.679791+0000","last_undegraded":"2023-06-08T04:01:58.679791+0000","last_fullsized":"2023-06-08T04:01:58.679791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298787+0000","last_change":"2023-06-08T04:01:56.779903+0000","last_active":"2023-06-08T04:01:58.298787+0000","last_peered":"2023-06-08T04:01:58.298787+0000","last_clean":"2023-06-08T04:01:58.298787+0000","last_became_active":"2023-06-08T04:01:56.779569+0000","last_became_peered":"2023-06-08T04:01:56.779569+0000","last_unstale":"2023-06-08T04:01:58.298787+0000","last_undegraded":"2023-06-08T04:01:58.298787+0000","last_fullsized":"2023-06-08T04:01:58.298787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:52.080071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679025+0000","last_change":"2023-06-08T04:01:57.309781+0000","last_active":"2023-06-08T04:01:58.679025+0000","last_peered":"2023-06-08T04:01:58.679025+0000","last_clean":"2023-06-08T04:01:58.679025+0000","last_became_active":"2023-06-08T04:01:57.309383+0000","last_became_peered":"2023-06-08T04:01:57.309383+0000","last_unstale":"2023-06-08T04:01:58.679025+0000","last_undegraded":"2023-06-08T04:01:58.679025+0000","last_fullsized":"2023-06-08T04:01:58.679025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680127+0000","last_change":"2023-06-08T04:01:56.785855+0000","last_active":"2023-06-08T04:01:58.680127+0000","last_peered":"2023-06-08T04:01:58.680127+0000","last_clean":"2023-06-08T04:01:58.680127+0000","last_became_active":"2023-06-08T04:01:56.785233+0000","last_became_peered":"2023-06-08T04:01:56.785233+0000","last_unstale":"2023-06-08T04:01:58.680127+0000","last_undegraded":"2023-06-08T04:01:58.680127+0000","last_fullsized":"2023-06-08T04:01:58.680127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:17.687446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679452+0000","last_change":"2023-06-08T04:01:57.322184+0000","last_active":"2023-06-08T04:01:58.679452+0000","last_peered":"2023-06-08T04:01:58.679452+0000","last_clean":"2023-06-08T04:01:58.679452+0000","last_became_active":"2023-06-08T04:01:57.321644+0000","last_became_peered":"2023-06-08T04:01:57.321644+0000","last_unstale":"2023-06-08T04:01:58.679452+0000","last_undegraded":"2023-06-08T04:01:58.679452+0000","last_fullsized":"2023-06-08T04:01:58.679452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:12:00.959096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679629+0000","last_change":"2023-06-08T04:01:56.793021+0000","last_active":"2023-06-08T04:01:58.679629+0000","last_peered":"2023-06-08T04:01:58.679629+0000","last_clean":"2023-06-08T04:01:58.679629+0000","last_became_active":"2023-06-08T04:01:56.792695+0000","last_became_peered":"2023-06-08T04:01:56.792695+0000","last_unstale":"2023-06-08T04:01:58.679629+0000","last_undegraded":"2023-06-08T04:01:58.679629+0000","last_fullsized":"2023-06-08T04:01:58.679629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:16.084147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679919+0000","last_change":"2023-06-08T04:01:57.315172+0000","last_active":"2023-06-08T04:01:58.679919+0000","last_peered":"2023-06-08T04:01:58.679919+0000","last_clean":"2023-06-08T04:01:58.679919+0000","last_became_active":"2023-06-08T04:01:57.314816+0000","last_became_peered":"2023-06-08T04:01:57.314816+0000","last_unstale":"2023-06-08T04:01:58.679919+0000","last_undegraded":"2023-06-08T04:01:58.679919+0000","last_fullsized":"2023-06-08T04:01:58.679919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:12.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679033+0000","last_change":"2023-06-08T04:01:56.782841+0000","last_active":"2023-06-08T04:01:58.679033+0000","last_peered":"2023-06-08T04:01:58.679033+0000","last_clean":"2023-06-08T04:01:58.679033+0000","last_became_active":"2023-06-08T04:01:56.782518+0000","last_became_peered":"2023-06-08T04:01:56.782518+0000","last_unstale":"2023-06-08T04:01:58.679033+0000","last_undegraded":"2023-06-08T04:01:58.679033+0000","last_fullsized":"2023-06-08T04:01:58.679033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679866+0000","last_change":"2023-06-08T04:01:57.326388+0000","last_active":"2023-06-08T04:01:58.679866+0000","last_peered":"2023-06-08T04:01:58.679866+0000","last_clean":"2023-06-08T04:01:58.679866+0000","last_became_active":"2023-06-08T04:01:57.326127+0000","last_became_peered":"2023-06-08T04:01:57.326127+0000","last_unstale":"2023-06-08T04:01:58.679866+0000","last_undegraded":"2023-06-08T04:01:58.679866+0000","last_fullsized":"2023-06-08T04:01:58.679866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:57.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679592+0000","last_change":"2023-06-08T04:01:56.789026+0000","last_active":"2023-06-08T04:01:58.679592+0000","last_peered":"2023-06-08T04:01:58.679592+0000","last_clean":"2023-06-08T04:01:58.679592+0000","last_became_active":"2023-06-08T04:01:56.788477+0000","last_became_peered":"2023-06-08T04:01:56.788477+0000","last_unstale":"2023-06-08T04:01:58.679592+0000","last_undegraded":"2023-06-08T04:01:58.679592+0000","last_fullsized":"2023-06-08T04:01:58.679592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680114+0000","last_change":"2023-06-08T04:01:57.305826+0000","last_active":"2023-06-08T04:01:58.680114+0000","last_peered":"2023-06-08T04:01:58.680114+0000","last_clean":"2023-06-08T04:01:58.680114+0000","last_became_active":"2023-06-08T04:01:57.305443+0000","last_became_peered":"2023-06-08T04:01:57.305443+0000","last_unstale":"2023-06-08T04:01:58.680114+0000","last_undegraded":"2023-06-08T04:01:58.680114+0000","last_fullsized":"2023-06-08T04:01:58.680114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679382+0000","last_change":"2023-06-08T04:01:56.789943+0000","last_active":"2023-06-08T04:01:58.679382+0000","last_peered":"2023-06-08T04:01:58.679382+0000","last_clean":"2023-06-08T04:01:58.679382+0000","last_became_active":"2023-06-08T04:01:56.789641+0000","last_became_peered":"2023-06-08T04:01:56.789641+0000","last_unstale":"2023-06-08T04:01:58.679382+0000","last_undegraded":"2023-06-08T04:01:58.679382+0000","last_fullsized":"2023-06-08T04:01:58.679382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:24.507881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679700+0000","last_change":"2023-06-08T04:01:50.999784+0000","last_active":"2023-06-08T04:01:58.679700+0000","last_peered":"2023-06-08T04:01:58.679700+0000","last_clean":"2023-06-08T04:01:58.679700+0000","last_became_active":"2023-06-08T04:01:50.999446+0000","last_became_peered":"2023-06-08T04:01:50.999446+0000","last_unstale":"2023-06-08T04:01:58.679700+0000","last_undegraded":"2023-06-08T04:01:58.679700+0000","last_fullsized":"2023-06-08T04:01:58.679700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:18:58.957649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679453+0000","last_change":"2023-06-08T04:01:57.314412+0000","last_active":"2023-06-08T04:01:58.679453+0000","last_peered":"2023-06-08T04:01:58.679453+0000","last_clean":"2023-06-08T04:01:58.679453+0000","last_became_active":"2023-06-08T04:01:57.314079+0000","last_became_peered":"2023-06-08T04:01:57.314079+0000","last_unstale":"2023-06-08T04:01:58.679453+0000","last_undegraded":"2023-06-08T04:01:58.679453+0000","last_fullsized":"2023-06-08T04:01:58.679453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:50.348618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679209+0000","last_change":"2023-06-08T04:01:50.729188+0000","last_active":"2023-06-08T04:01:58.679209+0000","last_peered":"2023-06-08T04:01:58.679209+0000","last_clean":"2023-06-08T04:01:58.679209+0000","last_became_active":"2023-06-08T04:01:50.728711+0000","last_became_peered":"2023-06-08T04:01:50.728711+0000","last_unstale":"2023-06-08T04:01:58.679209+0000","last_undegraded":"2023-06-08T04:01:58.679209+0000","last_fullsized":"2023-06-08T04:01:58.679209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:46.046903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:59.251695+0000","last_change":"2023-06-08T04:01:56.784336+0000","last_active":"2023-06-08T04:01:59.251695+0000","last_peered":"2023-06-08T04:01:59.251695+0000","last_clean":"2023-06-08T04:01:59.251695+0000","last_became_active":"2023-06-08T04:01:56.783906+0000","last_became_peered":"2023-06-08T04:01:56.783906+0000","last_unstale":"2023-06-08T04:01:59.251695+0000","last_undegraded":"2023-06-08T04:01:59.251695+0000","last_fullsized":"2023-06-08T04:01:59.251695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:48.770281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678949+0000","last_change":"2023-06-08T04:01:57.325405+0000","last_active":"2023-06-08T04:01:58.678949+0000","last_peered":"2023-06-08T04:01:58.678949+0000","last_clean":"2023-06-08T04:01:58.678949+0000","last_became_active":"2023-06-08T04:01:57.325123+0000","last_became_peered":"2023-06-08T04:01:57.325123+0000","last_unstale":"2023-06-08T04:01:58.678949+0000","last_undegraded":"2023-06-08T04:01:58.678949+0000","last_fullsized":"2023-06-08T04:01:58.678949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:25.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678720+0000","last_change":"2023-06-08T04:01:50.734710+0000","last_active":"2023-06-08T04:01:58.678720+0000","last_peered":"2023-06-08T04:01:58.678720+0000","last_clean":"2023-06-08T04:01:58.678720+0000","last_became_active":"2023-06-08T04:01:50.734287+0000","last_became_peered":"2023-06-08T04:01:50.734287+0000","last_unstale":"2023-06-08T04:01:58.678720+0000","last_undegraded":"2023-06-08T04:01:58.678720+0000","last_fullsized":"2023-06-08T04:01:58.678720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:51:05.539333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297919+0000","last_change":"2023-06-08T04:01:51.742803+0000","last_active":"2023-06-08T04:01:58.297919+0000","last_peered":"2023-06-08T04:01:58.297919+0000","last_clean":"2023-06-08T04:01:58.297919+0000","last_became_active":"2023-06-08T04:01:51.742466+0000","last_became_peered":"2023-06-08T04:01:51.742466+0000","last_unstale":"2023-06-08T04:01:58.297919+0000","last_undegraded":"2023-06-08T04:01:58.297919+0000","last_fullsized":"2023-06-08T04:01:58.297919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_clean_scrub_stamp":"2023-06-08T04:01:50.718021+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:17.413272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679950+0000","last_change":"2023-06-08T04:01:56.783919+0000","last_active":"2023-06-08T04:01:58.679950+0000","last_peered":"2023-06-08T04:01:58.679950+0000","last_clean":"2023-06-08T04:01:58.679950+0000","last_became_active":"2023-06-08T04:01:56.783607+0000","last_became_peered":"2023-06-08T04:01:56.783607+0000","last_unstale":"2023-06-08T04:01:58.679950+0000","last_undegraded":"2023-06-08T04:01:58.679950+0000","last_fullsized":"2023-06-08T04:01:58.679950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:27.687219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680318+0000","last_change":"2023-06-08T04:01:57.309149+0000","last_active":"2023-06-08T04:01:58.680318+0000","last_peered":"2023-06-08T04:01:58.680318+0000","last_clean":"2023-06-08T04:01:58.680318+0000","last_became_active":"2023-06-08T04:01:57.308445+0000","last_became_peered":"2023-06-08T04:01:57.308445+0000","last_unstale":"2023-06-08T04:01:58.680318+0000","last_undegraded":"2023-06-08T04:01:58.680318+0000","last_fullsized":"2023-06-08T04:01:58.680318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297951+0000","last_change":"2023-06-08T04:01:51.001331+0000","last_active":"2023-06-08T04:01:58.297951+0000","last_peered":"2023-06-08T04:01:58.297951+0000","last_clean":"2023-06-08T04:01:58.297951+0000","last_became_active":"2023-06-08T04:01:51.001009+0000","last_became_peered":"2023-06-08T04:01:51.001009+0000","last_unstale":"2023-06-08T04:01:58.297951+0000","last_undegraded":"2023-06-08T04:01:58.297951+0000","last_fullsized":"2023-06-08T04:01:58.297951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:14.078321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678533+0000","last_change":"2023-06-08T04:01:56.787400+0000","last_active":"2023-06-08T04:01:58.678533+0000","last_peered":"2023-06-08T04:01:58.678533+0000","last_clean":"2023-06-08T04:01:58.678533+0000","last_became_active":"2023-06-08T04:01:56.785569+0000","last_became_peered":"2023-06-08T04:01:56.785569+0000","last_unstale":"2023-06-08T04:01:58.678533+0000","last_undegraded":"2023-06-08T04:01:58.678533+0000","last_fullsized":"2023-06-08T04:01:58.678533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:44:53.499091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679987+0000","last_change":"2023-06-08T04:01:57.314750+0000","last_active":"2023-06-08T04:01:58.679987+0000","last_peered":"2023-06-08T04:01:58.679987+0000","last_clean":"2023-06-08T04:01:58.679987+0000","last_became_active":"2023-06-08T04:01:57.314472+0000","last_became_peered":"2023-06-08T04:01:57.314472+0000","last_unstale":"2023-06-08T04:01:58.679987+0000","last_undegraded":"2023-06-08T04:01:58.679987+0000","last_fullsized":"2023-06-08T04:01:58.679987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297740+0000","last_change":"2023-06-08T04:01:51.000319+0000","last_active":"2023-06-08T04:01:58.297740+0000","last_peered":"2023-06-08T04:01:58.297740+0000","last_clean":"2023-06-08T04:01:58.297740+0000","last_became_active":"2023-06-08T04:01:50.999943+0000","last_became_peered":"2023-06-08T04:01:50.999943+0000","last_unstale":"2023-06-08T04:01:58.297740+0000","last_undegraded":"2023-06-08T04:01:58.297740+0000","last_fullsized":"2023-06-08T04:01:58.297740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:43.308108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678945+0000","last_change":"2023-06-08T04:01:56.774312+0000","last_active":"2023-06-08T04:01:58.678945+0000","last_peered":"2023-06-08T04:01:58.678945+0000","last_clean":"2023-06-08T04:01:58.678945+0000","last_became_active":"2023-06-08T04:01:56.774005+0000","last_became_peered":"2023-06-08T04:01:56.774005+0000","last_unstale":"2023-06-08T04:01:58.678945+0000","last_undegraded":"2023-06-08T04:01:58.678945+0000","last_fullsized":"2023-06-08T04:01:58.678945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:30.163198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679484+0000","last_change":"2023-06-08T04:01:57.326639+0000","last_active":"2023-06-08T04:01:58.679484+0000","last_peered":"2023-06-08T04:01:58.679484+0000","last_clean":"2023-06-08T04:01:58.679484+0000","last_became_active":"2023-06-08T04:01:57.326373+0000","last_became_peered":"2023-06-08T04:01:57.326373+0000","last_unstale":"2023-06-08T04:01:58.679484+0000","last_undegraded":"2023-06-08T04:01:58.679484+0000","last_fullsized":"2023-06-08T04:01:58.679484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298044+0000","last_change":"2023-06-08T04:01:51.000090+0000","last_active":"2023-06-08T04:01:58.298044+0000","last_peered":"2023-06-08T04:01:58.298044+0000","last_clean":"2023-06-08T04:01:58.298044+0000","last_became_active":"2023-06-08T04:01:50.999789+0000","last_became_peered":"2023-06-08T04:01:50.999789+0000","last_unstale":"2023-06-08T04:01:58.298044+0000","last_undegraded":"2023-06-08T04:01:58.298044+0000","last_fullsized":"2023-06-08T04:01:58.298044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:11:58.206736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679223+0000","last_change":"2023-06-08T04:01:56.778178+0000","last_active":"2023-06-08T04:01:58.679223+0000","last_peered":"2023-06-08T04:01:58.679223+0000","last_clean":"2023-06-08T04:01:58.679223+0000","last_became_active":"2023-06-08T04:01:56.777877+0000","last_became_peered":"2023-06-08T04:01:56.777877+0000","last_unstale":"2023-06-08T04:01:58.679223+0000","last_undegraded":"2023-06-08T04:01:58.679223+0000","last_fullsized":"2023-06-08T04:01:58.679223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:22.443805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679364+0000","last_change":"2023-06-08T04:01:57.312009+0000","last_active":"2023-06-08T04:01:58.679364+0000","last_peered":"2023-06-08T04:01:58.679364+0000","last_clean":"2023-06-08T04:01:58.679364+0000","last_became_active":"2023-06-08T04:01:57.311651+0000","last_became_peered":"2023-06-08T04:01:57.311651+0000","last_unstale":"2023-06-08T04:01:58.679364+0000","last_undegraded":"2023-06-08T04:01:58.679364+0000","last_fullsized":"2023-06-08T04:01:58.679364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:41.897231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679250+0000","last_change":"2023-06-08T04:01:51.000507+0000","last_active":"2023-06-08T04:01:58.679250+0000","last_peered":"2023-06-08T04:01:58.679250+0000","last_clean":"2023-06-08T04:01:58.679250+0000","last_became_active":"2023-06-08T04:01:51.000175+0000","last_became_peered":"2023-06-08T04:01:51.000175+0000","last_unstale":"2023-06-08T04:01:58.679250+0000","last_undegraded":"2023-06-08T04:01:58.679250+0000","last_fullsized":"2023-06-08T04:01:58.679250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:13.100611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679229+0000","last_change":"2023-06-08T04:01:56.785424+0000","last_active":"2023-06-08T04:01:58.679229+0000","last_peered":"2023-06-08T04:01:58.679229+0000","last_clean":"2023-06-08T04:01:58.679229+0000","last_became_active":"2023-06-08T04:01:56.785198+0000","last_became_peered":"2023-06-08T04:01:56.785198+0000","last_unstale":"2023-06-08T04:01:58.679229+0000","last_undegraded":"2023-06-08T04:01:58.679229+0000","last_fullsized":"2023-06-08T04:01:58.679229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:47.851853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679359+0000","last_change":"2023-06-08T04:01:57.315582+0000","last_active":"2023-06-08T04:01:58.679359+0000","last_peered":"2023-06-08T04:01:58.679359+0000","last_clean":"2023-06-08T04:01:58.679359+0000","last_became_active":"2023-06-08T04:01:57.314479+0000","last_became_peered":"2023-06-08T04:01:57.314479+0000","last_unstale":"2023-06-08T04:01:58.679359+0000","last_undegraded":"2023-06-08T04:01:58.679359+0000","last_fullsized":"2023-06-08T04:01:58.679359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679828+0000","last_change":"2023-06-08T04:01:50.734174+0000","last_active":"2023-06-08T04:01:58.679828+0000","last_peered":"2023-06-08T04:01:58.679828+0000","last_clean":"2023-06-08T04:01:58.679828+0000","last_became_active":"2023-06-08T04:01:50.733832+0000","last_became_peered":"2023-06-08T04:01:50.733832+0000","last_unstale":"2023-06-08T04:01:58.679828+0000","last_undegraded":"2023-06-08T04:01:58.679828+0000","last_fullsized":"2023-06-08T04:01:58.679828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:34.856721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299103+0000","last_change":"2023-06-08T04:01:56.782230+0000","last_active":"2023-06-08T04:01:58.299103+0000","last_peered":"2023-06-08T04:01:58.299103+0000","last_clean":"2023-06-08T04:01:58.299103+0000","last_became_active":"2023-06-08T04:01:56.781942+0000","last_became_peered":"2023-06-08T04:01:56.781942+0000","last_unstale":"2023-06-08T04:01:58.299103+0000","last_undegraded":"2023-06-08T04:01:58.299103+0000","last_fullsized":"2023-06-08T04:01:58.299103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679365+0000","last_change":"2023-06-08T04:01:57.314750+0000","last_active":"2023-06-08T04:01:58.679365+0000","last_peered":"2023-06-08T04:01:58.679365+0000","last_clean":"2023-06-08T04:01:58.679365+0000","last_became_active":"2023-06-08T04:01:57.314515+0000","last_became_peered":"2023-06-08T04:01:57.314515+0000","last_unstale":"2023-06-08T04:01:58.679365+0000","last_undegraded":"2023-06-08T04:01:58.679365+0000","last_fullsized":"2023-06-08T04:01:58.679365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679505+0000","last_change":"2023-06-08T04:01:56.784632+0000","last_active":"2023-06-08T04:01:58.679505+0000","last_peered":"2023-06-08T04:01:58.679505+0000","last_clean":"2023-06-08T04:01:58.679505+0000","last_became_active":"2023-06-08T04:01:56.784077+0000","last_became_peered":"2023-06-08T04:01:56.784077+0000","last_unstale":"2023-06-08T04:01:58.679505+0000","last_undegraded":"2023-06-08T04:01:58.679505+0000","last_fullsized":"2023-06-08T04:01:58.679505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:40.889888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294761+0000","last_change":"2023-06-08T04:01:57.306546+0000","last_active":"2023-06-08T04:01:58.294761+0000","last_peered":"2023-06-08T04:01:58.294761+0000","last_clean":"2023-06-08T04:01:58.294761+0000","last_became_active":"2023-06-08T04:01:57.306284+0000","last_became_peered":"2023-06-08T04:01:57.306284+0000","last_unstale":"2023-06-08T04:01:58.294761+0000","last_undegraded":"2023-06-08T04:01:58.294761+0000","last_fullsized":"2023-06-08T04:01:58.294761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:27:15.918495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298675+0000","last_change":"2023-06-08T04:01:56.782619+0000","last_active":"2023-06-08T04:01:58.298675+0000","last_peered":"2023-06-08T04:01:58.298675+0000","last_clean":"2023-06-08T04:01:58.298675+0000","last_became_active":"2023-06-08T04:01:56.782330+0000","last_became_peered":"2023-06-08T04:01:56.782330+0000","last_unstale":"2023-06-08T04:01:58.298675+0000","last_undegraded":"2023-06-08T04:01:58.298675+0000","last_fullsized":"2023-06-08T04:01:58.298675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:30.163198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679246+0000","last_change":"2023-06-08T04:01:57.321947+0000","last_active":"2023-06-08T04:01:58.679246+0000","last_peered":"2023-06-08T04:01:58.679246+0000","last_clean":"2023-06-08T04:01:58.679246+0000","last_became_active":"2023-06-08T04:01:57.321553+0000","last_became_peered":"2023-06-08T04:01:57.321553+0000","last_unstale":"2023-06-08T04:01:58.679246+0000","last_undegraded":"2023-06-08T04:01:58.679246+0000","last_fullsized":"2023-06-08T04:01:58.679246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:21.118831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299053+0000","last_change":"2023-06-08T04:01:56.781610+0000","last_active":"2023-06-08T04:01:58.299053+0000","last_peered":"2023-06-08T04:01:58.299053+0000","last_clean":"2023-06-08T04:01:58.299053+0000","last_became_active":"2023-06-08T04:01:56.781235+0000","last_became_peered":"2023-06-08T04:01:56.781235+0000","last_unstale":"2023-06-08T04:01:58.299053+0000","last_undegraded":"2023-06-08T04:01:58.299053+0000","last_fullsized":"2023-06-08T04:01:58.299053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:49.341275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680212+0000","last_change":"2023-06-08T04:01:57.320898+0000","last_active":"2023-06-08T04:01:58.680212+0000","last_peered":"2023-06-08T04:01:58.680212+0000","last_clean":"2023-06-08T04:01:58.680212+0000","last_became_active":"2023-06-08T04:01:57.320681+0000","last_became_peered":"2023-06-08T04:01:57.320681+0000","last_unstale":"2023-06-08T04:01:58.680212+0000","last_undegraded":"2023-06-08T04:01:58.680212+0000","last_fullsized":"2023-06-08T04:01:58.680212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:34:03.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679303+0000","last_change":"2023-06-08T04:01:56.789740+0000","last_active":"2023-06-08T04:01:58.679303+0000","last_peered":"2023-06-08T04:01:58.679303+0000","last_clean":"2023-06-08T04:01:58.679303+0000","last_became_active":"2023-06-08T04:01:56.789322+0000","last_became_peered":"2023-06-08T04:01:56.789322+0000","last_unstale":"2023-06-08T04:01:58.679303+0000","last_undegraded":"2023-06-08T04:01:58.679303+0000","last_fullsized":"2023-06-08T04:01:58.679303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:49.253411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680786+0000","last_change":"2023-06-08T04:01:57.301738+0000","last_active":"2023-06-08T04:01:58.680786+0000","last_peered":"2023-06-08T04:01:58.680786+0000","last_clean":"2023-06-08T04:01:58.680786+0000","last_became_active":"2023-06-08T04:01:57.301468+0000","last_became_peered":"2023-06-08T04:01:57.301468+0000","last_unstale":"2023-06-08T04:01:58.680786+0000","last_undegraded":"2023-06-08T04:01:58.680786+0000","last_fullsized":"2023-06-08T04:01:58.680786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:57.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680472+0000","last_change":"2023-06-08T04:01:56.774643+0000","last_active":"2023-06-08T04:01:58.680472+0000","last_peered":"2023-06-08T04:01:58.680472+0000","last_clean":"2023-06-08T04:01:58.680472+0000","last_became_active":"2023-06-08T04:01:56.774331+0000","last_became_peered":"2023-06-08T04:01:56.774331+0000","last_unstale":"2023-06-08T04:01:58.680472+0000","last_undegraded":"2023-06-08T04:01:58.680472+0000","last_fullsized":"2023-06-08T04:01:58.680472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:49.341275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678854+0000","last_change":"2023-06-08T04:01:57.325733+0000","last_active":"2023-06-08T04:01:58.678854+0000","last_peered":"2023-06-08T04:01:58.678854+0000","last_clean":"2023-06-08T04:01:58.678854+0000","last_became_active":"2023-06-08T04:01:57.325478+0000","last_became_peered":"2023-06-08T04:01:57.325478+0000","last_unstale":"2023-06-08T04:01:58.678854+0000","last_undegraded":"2023-06-08T04:01:58.678854+0000","last_fullsized":"2023-06-08T04:01:58.678854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679936+0000","last_change":"2023-06-08T04:01:57.316607+0000","last_active":"2023-06-08T04:01:58.679936+0000","last_peered":"2023-06-08T04:01:58.679936+0000","last_clean":"2023-06-08T04:01:58.679936+0000","last_became_active":"2023-06-08T04:01:57.316279+0000","last_became_peered":"2023-06-08T04:01:57.316279+0000","last_unstale":"2023-06-08T04:01:58.679936+0000","last_undegraded":"2023-06-08T04:01:58.679936+0000","last_fullsized":"2023-06-08T04:01:58.679936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680685+0000","last_change":"2023-06-08T04:01:57.307400+0000","last_active":"2023-06-08T04:01:58.680685+0000","last_peered":"2023-06-08T04:01:58.680685+0000","last_clean":"2023-06-08T04:01:58.680685+0000","last_became_active":"2023-06-08T04:01:57.307110+0000","last_became_peered":"2023-06-08T04:01:57.307110+0000","last_unstale":"2023-06-08T04:01:58.680685+0000","last_undegraded":"2023-06-08T04:01:58.680685+0000","last_fullsized":"2023-06-08T04:01:58.680685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:47.350874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680097+0000","last_change":"2023-06-08T04:01:57.328380+0000","last_active":"2023-06-08T04:01:58.680097+0000","last_peered":"2023-06-08T04:01:58.680097+0000","last_clean":"2023-06-08T04:01:58.680097+0000","last_became_active":"2023-06-08T04:01:57.328134+0000","last_became_peered":"2023-06-08T04:01:57.328134+0000","last_unstale":"2023-06-08T04:01:58.680097+0000","last_undegraded":"2023-06-08T04:01:58.680097+0000","last_fullsized":"2023-06-08T04:01:58.680097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:25:34.644774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680126+0000","last_change":"2023-06-08T04:01:57.313801+0000","last_active":"2023-06-08T04:01:58.680126+0000","last_peered":"2023-06-08T04:01:58.680126+0000","last_clean":"2023-06-08T04:01:58.680126+0000","last_became_active":"2023-06-08T04:01:57.313059+0000","last_became_peered":"2023-06-08T04:01:57.313059+0000","last_unstale":"2023-06-08T04:01:58.680126+0000","last_undegraded":"2023-06-08T04:01:58.680126+0000","last_fullsized":"2023-06-08T04:01:58.680126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679109+0000","last_change":"2023-06-08T04:01:57.316784+0000","last_active":"2023-06-08T04:01:58.679109+0000","last_peered":"2023-06-08T04:01:58.679109+0000","last_clean":"2023-06-08T04:01:58.679109+0000","last_became_active":"2023-06-08T04:01:57.316329+0000","last_became_peered":"2023-06-08T04:01:57.316329+0000","last_unstale":"2023-06-08T04:01:58.679109+0000","last_undegraded":"2023-06-08T04:01:58.679109+0000","last_fullsized":"2023-06-08T04:01:58.679109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:17.091490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":671608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8010000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2469999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2189999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":669828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":81080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":80112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.968}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8279999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T04:02:07.994 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T04:02:08.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.223+0000 7fd82a9ff700 1 Processor -- start 2023-06-08T04:02:08.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.223+0000 7fd82a9ff700 1 -- start start 2023-06-08T04:02:08.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.224+0000 7fd82a9ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd8240b83f0 0x7fd824160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.224+0000 7fd82a9ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd8240ced40 0x7fd8240b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.224+0000 7fd82a9ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8240d0800 con 0x7fd8240b4b50 2023-06-08T04:02:08.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.224+0000 7fd82a9ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8240b4fd0 con 0x7fd8240ced40 2023-06-08T04:02:08.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.224+0000 7fd82a9ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8240cd1e0 con 0x7fd8240b83f0 2023-06-08T04:02:08.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.224+0000 7fd8237fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd8240ced40 0x7fd8240b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.224+0000 7fd8237fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd8240ced40 0x7fd8240b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42332/0 (socket says 172.21.15.16:42332) 2023-06-08T04:02:08.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.225+0000 7fd8237fe700 1 -- 172.21.15.16:0/808881987 learned_addr learned my addr 172.21.15.16:0/808881987 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:08.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.225+0000 7fd823fff700 1 --2- 172.21.15.16:0/808881987 >> v2:172.21.15.169:3300/0 conn(0x7fd8240b83f0 0x7fd824160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.225+0000 7fd8237fe700 1 -- 172.21.15.16:0/808881987 >> v2:172.21.15.169:3300/0 conn(0x7fd8240b83f0 msgr2=0x7fd824160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:08.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.225+0000 7fd8237fe700 1 --2- 172.21.15.16:0/808881987 >> v2:172.21.15.169:3300/0 conn(0x7fd8240b83f0 0x7fd824160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.225+0000 7fd8237fe700 1 -- 172.21.15.16:0/808881987 >> v1:172.21.15.169:6789/0 conn(0x7fd8240b4b50 legacy=0x7fd82406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.225+0000 7fd8237fe700 1 -- 172.21.15.16:0/808881987 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8240cd4c0 con 0x7fd8240ced40 2023-06-08T04:02:08.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.225+0000 7fd8237fe700 1 --2- 172.21.15.16:0/808881987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8240ced40 0x7fd8240b4610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd82406ca80 tx=0x7fd818009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b35c6c2627c547 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:08.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.225+0000 7fd822ffd700 1 -- 172.21.15.16:0/808881987 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818011830 con 0x7fd8240ced40 2023-06-08T04:02:08.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.225+0000 7fd822ffd700 1 -- 172.21.15.16:0/808881987 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd818011990 con 0x7fd8240ced40 2023-06-08T04:02:08.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.225+0000 7fd822ffd700 1 -- 172.21.15.16:0/808881987 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818011d20 con 0x7fd8240ced40 2023-06-08T04:02:08.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.226+0000 7fd82a9ff700 1 -- 172.21.15.16:0/808881987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8240ced40 msgr2=0x7fd8240b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.226+0000 7fd82a9ff700 1 --2- 172.21.15.16:0/808881987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8240ced40 0x7fd8240b4610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd82406ca80 tx=0x7fd818009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.226+0000 7fd82a9ff700 1 -- 172.21.15.16:0/808881987 shutdown_connections 2023-06-08T04:02:08.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.226+0000 7fd82a9ff700 1 --2- 172.21.15.16:0/808881987 >> v2:172.21.15.169:3300/0 conn(0x7fd8240b83f0 0x7fd824160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.226+0000 7fd82a9ff700 1 --2- 172.21.15.16:0/808881987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8240ced40 0x7fd8240b4610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.226+0000 7fd82a9ff700 1 -- 172.21.15.16:0/808881987 >> 172.21.15.16:0/808881987 conn(0x7fd8240cf610 msgr2=0x7fd8240cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:08.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.226+0000 7fd82a9ff700 1 -- 172.21.15.16:0/808881987 shutdown_connections 2023-06-08T04:02:08.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.226+0000 7fd82a9ff700 1 -- 172.21.15.16:0/808881987 wait complete. 2023-06-08T04:02:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.228+0000 7fd82a9ff700 1 Processor -- start 2023-06-08T04:02:08.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.228+0000 7fd82a9ff700 1 -- start start 2023-06-08T04:02:08.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.229+0000 7fd82a9ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8240b4b50 0x7fd824154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.229+0000 7fd82a9ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8240b83f0 0x7fd8241539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.229+0000 7fd82a9ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8240ced40 0x7fd8240b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.229+0000 7fd82a9ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd824154a80 con 0x7fd8240ced40 2023-06-08T04:02:08.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.229+0000 7fd82a9ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8240c6850 con 0x7fd8240b4b50 2023-06-08T04:02:08.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.229+0000 7fd82a9ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82415ca30 con 0x7fd8240b83f0 2023-06-08T04:02:08.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.229+0000 7fd828f9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8240ced40 0x7fd8240b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.229+0000 7fd828f9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8240ced40 0x7fd8240b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42334/0 (socket says 172.21.15.16:42334) 2023-06-08T04:02:08.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.229+0000 7fd828f9c700 1 -- 172.21.15.16:0/200220939 learned_addr learned my addr 172.21.15.16:0/200220939 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:08.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.229+0000 7fd823fff700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8240b4b50 0x7fd824154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.229+0000 7fd8237fe700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8240b83f0 0x7fd8241539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd828f9c700 1 -- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8240b83f0 msgr2=0x7fd8241539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd828f9c700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8240b83f0 0x7fd8241539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd828f9c700 1 -- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8240b4b50 msgr2=0x7fd824154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd828f9c700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8240b4b50 0x7fd824154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd828f9c700 1 -- 172.21.15.16:0/200220939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818009550 con 0x7fd8240ced40 2023-06-08T04:02:08.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd8237fe700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8240b83f0 0x7fd8241539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:08.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd828f9c700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8240ced40 0x7fd8240b25c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00cc50 tx=0x7fd81c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:08.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd820ff9700 1 -- 172.21.15.16:0/200220939 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c003c00 con 0x7fd8240ced40 2023-06-08T04:02:08.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd820ff9700 1 -- 172.21.15.16:0/200220939 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81c003d60 con 0x7fd8240ced40 2023-06-08T04:02:08.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd820ff9700 1 -- 172.21.15.16:0/200220939 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c00ab00 con 0x7fd8240ced40 2023-06-08T04:02:08.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd82a9ff700 1 -- 172.21.15.16:0/200220939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8240c6a60 con 0x7fd8240ced40 2023-06-08T04:02:08.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.230+0000 7fd82a9ff700 1 -- 172.21.15.16:0/200220939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82415cc40 con 0x7fd8240ced40 2023-06-08T04:02:08.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.231+0000 7fd82a9ff700 1 -- 172.21.15.16:0/200220939 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8240740e0 con 0x7fd8240ced40 2023-06-08T04:02:08.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.232+0000 7fd820ff9700 1 -- 172.21.15.16:0/200220939 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd81c00ac60 con 0x7fd8240ced40 2023-06-08T04:02:08.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.233+0000 7fd820ff9700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd81006ace0 0x7fd81006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.233+0000 7fd820ff9700 1 -- 172.21.15.16:0/200220939 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd81c089520 con 0x7fd8240ced40 2023-06-08T04:02:08.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.234+0000 7fd823fff700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd81006ace0 0x7fd81006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.234+0000 7fd823fff700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd81006ace0 0x7fd81006d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd814009be0 tx=0x7fd814009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:08.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.238+0000 7fd820ff9700 1 -- 172.21.15.16:0/200220939 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd81c054530 con 0x7fd8240ced40 2023-06-08T04:02:08.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.437+0000 7fd82a9ff700 1 -- 172.21.15.16:0/200220939 --> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8240d0aa0 con 0x7fd81006ace0 2023-06-08T04:02:08.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.447+0000 7fd820ff9700 1 -- 172.21.15.16:0/200220939 <== mgr.4103 v2:172.21.15.169:6832/2339348297 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286892 (secure 0 0 0) 0x7fd814011860 con 0x7fd81006ace0 2023-06-08T04:02:08.453 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:08.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 -- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd81006ace0 msgr2=0x7fd81006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd81006ace0 0x7fd81006d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd814009be0 tx=0x7fd814009210 comp rx=0 tx=0).stop 2023-06-08T04:02:08.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 -- 172.21.15.16:0/200220939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8240ced40 msgr2=0x7fd8240b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8240ced40 0x7fd8240b25c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00cc50 tx=0x7fd81c00cf60 comp rx=0 tx=0).stop 2023-06-08T04:02:08.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 -- 172.21.15.16:0/200220939 shutdown_connections 2023-06-08T04:02:08.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd81006ace0 0x7fd81006d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8240ced40 0x7fd8240b25c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8240b4b50 0x7fd824154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 --2- 172.21.15.16:0/200220939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8240b83f0 0x7fd8241539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 -- 172.21.15.16:0/200220939 >> 172.21.15.16:0/200220939 conn(0x7fd8240cf610 msgr2=0x7fd8240b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:08.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 -- 172.21.15.16:0/200220939 shutdown_connections 2023-06-08T04:02:08.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.451+0000 7fd82a9ff700 1 -- 172.21.15.16:0/200220939 wait complete. 2023-06-08T04:02:08.457 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-06-08T04:02:08.473 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-06-08T04:02:08.186991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218532,"kb_used_data":2916,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756188,"statfs":{"total":773094113280,"available":772870336512,"internally_reserved":0,"allocated":2985984,"data_stored":1820154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002598"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294976+0000","last_change":"2023-06-08T04:01:57.299413+0000","last_active":"2023-06-08T04:01:58.294976+0000","last_peered":"2023-06-08T04:01:58.294976+0000","last_clean":"2023-06-08T04:01:58.294976+0000","last_became_active":"2023-06-08T04:01:57.299094+0000","last_became_peered":"2023-06-08T04:01:57.299094+0000","last_unstale":"2023-06-08T04:01:58.294976+0000","last_undegraded":"2023-06-08T04:01:58.294976+0000","last_fullsized":"2023-06-08T04:01:58.294976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:10:14.491590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298272+0000","last_change":"2023-06-08T04:01:57.311826+0000","last_active":"2023-06-08T04:01:58.298272+0000","last_peered":"2023-06-08T04:01:58.298272+0000","last_clean":"2023-06-08T04:01:58.298272+0000","last_became_active":"2023-06-08T04:01:57.311286+0000","last_became_peered":"2023-06-08T04:01:57.311286+0000","last_unstale":"2023-06-08T04:01:58.298272+0000","last_undegraded":"2023-06-08T04:01:58.298272+0000","last_fullsized":"2023-06-08T04:01:58.298272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:17.091490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679534+0000","last_change":"2023-06-08T04:01:57.320078+0000","last_active":"2023-06-08T04:01:58.679534+0000","last_peered":"2023-06-08T04:01:58.679534+0000","last_clean":"2023-06-08T04:01:58.679534+0000","last_became_active":"2023-06-08T04:01:57.319745+0000","last_became_peered":"2023-06-08T04:01:57.319745+0000","last_unstale":"2023-06-08T04:01:58.679534+0000","last_undegraded":"2023-06-08T04:01:58.679534+0000","last_fullsized":"2023-06-08T04:01:58.679534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:13.980384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679647+0000","last_change":"2023-06-08T04:01:57.319387+0000","last_active":"2023-06-08T04:01:58.679647+0000","last_peered":"2023-06-08T04:01:58.679647+0000","last_clean":"2023-06-08T04:01:58.679647+0000","last_became_active":"2023-06-08T04:01:57.319108+0000","last_became_peered":"2023-06-08T04:01:57.319108+0000","last_unstale":"2023-06-08T04:01:58.679647+0000","last_undegraded":"2023-06-08T04:01:58.679647+0000","last_fullsized":"2023-06-08T04:01:58.679647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679228+0000","last_change":"2023-06-08T04:01:57.309338+0000","last_active":"2023-06-08T04:01:58.679228+0000","last_peered":"2023-06-08T04:01:58.679228+0000","last_clean":"2023-06-08T04:01:58.679228+0000","last_became_active":"2023-06-08T04:01:57.308408+0000","last_became_peered":"2023-06-08T04:01:57.308408+0000","last_unstale":"2023-06-08T04:01:58.679228+0000","last_undegraded":"2023-06-08T04:01:58.679228+0000","last_fullsized":"2023-06-08T04:01:58.679228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680027+0000","last_change":"2023-06-08T04:01:57.322730+0000","last_active":"2023-06-08T04:01:58.680027+0000","last_peered":"2023-06-08T04:01:58.680027+0000","last_clean":"2023-06-08T04:01:58.680027+0000","last_became_active":"2023-06-08T04:01:57.322349+0000","last_became_peered":"2023-06-08T04:01:57.322349+0000","last_unstale":"2023-06-08T04:01:58.680027+0000","last_undegraded":"2023-06-08T04:01:58.680027+0000","last_fullsized":"2023-06-08T04:01:58.680027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:51:05.995434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297855+0000","last_change":"2023-06-08T04:01:57.316863+0000","last_active":"2023-06-08T04:01:58.297855+0000","last_peered":"2023-06-08T04:01:58.297855+0000","last_clean":"2023-06-08T04:01:58.297855+0000","last_became_active":"2023-06-08T04:01:57.315117+0000","last_became_peered":"2023-06-08T04:01:57.315117+0000","last_unstale":"2023-06-08T04:01:58.297855+0000","last_undegraded":"2023-06-08T04:01:58.297855+0000","last_fullsized":"2023-06-08T04:01:58.297855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298377+0000","last_change":"2023-06-08T04:01:57.323352+0000","last_active":"2023-06-08T04:01:58.298377+0000","last_peered":"2023-06-08T04:01:58.298377+0000","last_clean":"2023-06-08T04:01:58.298377+0000","last_became_active":"2023-06-08T04:01:57.323064+0000","last_became_peered":"2023-06-08T04:01:57.323064+0000","last_unstale":"2023-06-08T04:01:58.298377+0000","last_undegraded":"2023-06-08T04:01:58.298377+0000","last_fullsized":"2023-06-08T04:01:58.298377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:48.859195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680108+0000","last_change":"2023-06-08T04:01:57.306101+0000","last_active":"2023-06-08T04:01:58.680108+0000","last_peered":"2023-06-08T04:01:58.680108+0000","last_clean":"2023-06-08T04:01:58.680108+0000","last_became_active":"2023-06-08T04:01:57.305817+0000","last_became_peered":"2023-06-08T04:01:57.305817+0000","last_unstale":"2023-06-08T04:01:58.680108+0000","last_undegraded":"2023-06-08T04:01:58.680108+0000","last_fullsized":"2023-06-08T04:01:58.680108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298566+0000","last_change":"2023-06-08T04:01:57.309420+0000","last_active":"2023-06-08T04:01:58.298566+0000","last_peered":"2023-06-08T04:01:58.298566+0000","last_clean":"2023-06-08T04:01:58.298566+0000","last_became_active":"2023-06-08T04:01:57.309076+0000","last_became_peered":"2023-06-08T04:01:57.309076+0000","last_unstale":"2023-06-08T04:01:58.298566+0000","last_undegraded":"2023-06-08T04:01:58.298566+0000","last_fullsized":"2023-06-08T04:01:58.298566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679683+0000","last_change":"2023-06-08T04:01:57.324575+0000","last_active":"2023-06-08T04:01:58.679683+0000","last_peered":"2023-06-08T04:01:58.679683+0000","last_clean":"2023-06-08T04:01:58.679683+0000","last_became_active":"2023-06-08T04:01:57.323557+0000","last_became_peered":"2023-06-08T04:01:57.323557+0000","last_unstale":"2023-06-08T04:01:58.679683+0000","last_undegraded":"2023-06-08T04:01:58.679683+0000","last_fullsized":"2023-06-08T04:01:58.679683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:47.350874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294799+0000","last_change":"2023-06-08T04:01:57.324310+0000","last_active":"2023-06-08T04:01:58.294799+0000","last_peered":"2023-06-08T04:01:58.294799+0000","last_clean":"2023-06-08T04:01:58.294799+0000","last_became_active":"2023-06-08T04:01:57.324044+0000","last_became_peered":"2023-06-08T04:01:57.324044+0000","last_unstale":"2023-06-08T04:01:58.294799+0000","last_undegraded":"2023-06-08T04:01:58.294799+0000","last_fullsized":"2023-06-08T04:01:58.294799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:15:47.285133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294647+0000","last_change":"2023-06-08T04:01:57.300242+0000","last_active":"2023-06-08T04:01:58.294647+0000","last_peered":"2023-06-08T04:01:58.294647+0000","last_clean":"2023-06-08T04:01:58.294647+0000","last_became_active":"2023-06-08T04:01:57.299927+0000","last_became_peered":"2023-06-08T04:01:57.299927+0000","last_unstale":"2023-06-08T04:01:58.294647+0000","last_undegraded":"2023-06-08T04:01:58.294647+0000","last_fullsized":"2023-06-08T04:01:58.294647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:03:23.454096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298679+0000","last_change":"2023-06-08T04:01:57.309428+0000","last_active":"2023-06-08T04:01:58.298679+0000","last_peered":"2023-06-08T04:01:58.298679+0000","last_clean":"2023-06-08T04:01:58.298679+0000","last_became_active":"2023-06-08T04:01:57.309107+0000","last_became_peered":"2023-06-08T04:01:57.309107+0000","last_unstale":"2023-06-08T04:01:58.298679+0000","last_undegraded":"2023-06-08T04:01:58.298679+0000","last_fullsized":"2023-06-08T04:01:58.298679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298112+0000","last_change":"2023-06-08T04:01:57.317232+0000","last_active":"2023-06-08T04:01:58.298112+0000","last_peered":"2023-06-08T04:01:58.298112+0000","last_clean":"2023-06-08T04:01:58.298112+0000","last_became_active":"2023-06-08T04:01:57.316821+0000","last_became_peered":"2023-06-08T04:01:57.316821+0000","last_unstale":"2023-06-08T04:01:58.298112+0000","last_undegraded":"2023-06-08T04:01:58.298112+0000","last_fullsized":"2023-06-08T04:01:58.298112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:18.694789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678985+0000","last_change":"2023-06-08T04:01:57.314928+0000","last_active":"2023-06-08T04:01:58.678985+0000","last_peered":"2023-06-08T04:01:58.678985+0000","last_clean":"2023-06-08T04:01:58.678985+0000","last_became_active":"2023-06-08T04:01:57.314630+0000","last_became_peered":"2023-06-08T04:01:57.314630+0000","last_unstale":"2023-06-08T04:01:58.678985+0000","last_undegraded":"2023-06-08T04:01:58.678985+0000","last_fullsized":"2023-06-08T04:01:58.678985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:50.348618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680237+0000","last_change":"2023-06-08T04:01:57.304277+0000","last_active":"2023-06-08T04:01:58.680237+0000","last_peered":"2023-06-08T04:01:58.680237+0000","last_clean":"2023-06-08T04:01:58.680237+0000","last_became_active":"2023-06-08T04:01:57.303959+0000","last_became_peered":"2023-06-08T04:01:57.303959+0000","last_unstale":"2023-06-08T04:01:58.680237+0000","last_undegraded":"2023-06-08T04:01:58.680237+0000","last_fullsized":"2023-06-08T04:01:58.680237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679694+0000","last_change":"2023-06-08T04:01:57.316825+0000","last_active":"2023-06-08T04:01:58.679694+0000","last_peered":"2023-06-08T04:01:58.679694+0000","last_clean":"2023-06-08T04:01:58.679694+0000","last_became_active":"2023-06-08T04:01:57.315505+0000","last_became_peered":"2023-06-08T04:01:57.315505+0000","last_unstale":"2023-06-08T04:01:58.679694+0000","last_undegraded":"2023-06-08T04:01:58.679694+0000","last_fullsized":"2023-06-08T04:01:58.679694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294748+0000","last_change":"2023-06-08T04:01:57.317700+0000","last_active":"2023-06-08T04:01:58.294748+0000","last_peered":"2023-06-08T04:01:58.294748+0000","last_clean":"2023-06-08T04:01:58.294748+0000","last_became_active":"2023-06-08T04:01:57.317409+0000","last_became_peered":"2023-06-08T04:01:57.317409+0000","last_unstale":"2023-06-08T04:01:58.294748+0000","last_undegraded":"2023-06-08T04:01:58.294748+0000","last_fullsized":"2023-06-08T04:01:58.294748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:21:07.937389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680014+0000","last_change":"2023-06-08T04:01:57.327000+0000","last_active":"2023-06-08T04:01:58.680014+0000","last_peered":"2023-06-08T04:01:58.680014+0000","last_clean":"2023-06-08T04:01:58.680014+0000","last_became_active":"2023-06-08T04:01:57.326736+0000","last_became_peered":"2023-06-08T04:01:57.326736+0000","last_unstale":"2023-06-08T04:01:58.680014+0000","last_undegraded":"2023-06-08T04:01:58.680014+0000","last_fullsized":"2023-06-08T04:01:58.680014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:53:41.237371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298091+0000","last_change":"2023-06-08T04:01:57.320374+0000","last_active":"2023-06-08T04:01:58.298091+0000","last_peered":"2023-06-08T04:01:58.298091+0000","last_clean":"2023-06-08T04:01:58.298091+0000","last_became_active":"2023-06-08T04:01:57.320093+0000","last_became_peered":"2023-06-08T04:01:57.320093+0000","last_unstale":"2023-06-08T04:01:58.298091+0000","last_undegraded":"2023-06-08T04:01:58.298091+0000","last_fullsized":"2023-06-08T04:01:58.298091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678990+0000","last_change":"2023-06-08T04:01:57.307041+0000","last_active":"2023-06-08T04:01:58.678990+0000","last_peered":"2023-06-08T04:01:58.678990+0000","last_clean":"2023-06-08T04:01:58.678990+0000","last_became_active":"2023-06-08T04:01:57.306750+0000","last_became_peered":"2023-06-08T04:01:57.306750+0000","last_unstale":"2023-06-08T04:01:58.678990+0000","last_undegraded":"2023-06-08T04:01:58.678990+0000","last_fullsized":"2023-06-08T04:01:58.678990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:20.141121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679647+0000","last_change":"2023-06-08T04:01:57.305284+0000","last_active":"2023-06-08T04:01:58.679647+0000","last_peered":"2023-06-08T04:01:58.679647+0000","last_clean":"2023-06-08T04:01:58.679647+0000","last_became_active":"2023-06-08T04:01:57.304750+0000","last_became_peered":"2023-06-08T04:01:57.304750+0000","last_unstale":"2023-06-08T04:01:58.679647+0000","last_undegraded":"2023-06-08T04:01:58.679647+0000","last_fullsized":"2023-06-08T04:01:58.679647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:21.118831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297864+0000","last_change":"2023-06-08T04:01:57.319635+0000","last_active":"2023-06-08T04:01:58.297864+0000","last_peered":"2023-06-08T04:01:58.297864+0000","last_clean":"2023-06-08T04:01:58.297864+0000","last_became_active":"2023-06-08T04:01:57.319342+0000","last_became_peered":"2023-06-08T04:01:57.319342+0000","last_unstale":"2023-06-08T04:01:58.297864+0000","last_undegraded":"2023-06-08T04:01:58.297864+0000","last_fullsized":"2023-06-08T04:01:58.297864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:54.420632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679843+0000","last_change":"2023-06-08T04:01:57.313530+0000","last_active":"2023-06-08T04:01:58.679843+0000","last_peered":"2023-06-08T04:01:58.679843+0000","last_clean":"2023-06-08T04:01:58.679843+0000","last_became_active":"2023-06-08T04:01:57.313216+0000","last_became_peered":"2023-06-08T04:01:57.313216+0000","last_unstale":"2023-06-08T04:01:58.679843+0000","last_undegraded":"2023-06-08T04:01:58.679843+0000","last_fullsized":"2023-06-08T04:01:58.679843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680049+0000","last_change":"2023-06-08T04:01:57.312444+0000","last_active":"2023-06-08T04:01:58.680049+0000","last_peered":"2023-06-08T04:01:58.680049+0000","last_clean":"2023-06-08T04:01:58.680049+0000","last_became_active":"2023-06-08T04:01:57.312127+0000","last_became_peered":"2023-06-08T04:01:57.312127+0000","last_unstale":"2023-06-08T04:01:58.680049+0000","last_undegraded":"2023-06-08T04:01:58.680049+0000","last_fullsized":"2023-06-08T04:01:58.680049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298912+0000","last_change":"2023-06-08T04:01:57.311749+0000","last_active":"2023-06-08T04:01:58.298912+0000","last_peered":"2023-06-08T04:01:58.298912+0000","last_clean":"2023-06-08T04:01:58.298912+0000","last_became_active":"2023-06-08T04:01:57.311478+0000","last_became_peered":"2023-06-08T04:01:57.311478+0000","last_unstale":"2023-06-08T04:01:58.298912+0000","last_undegraded":"2023-06-08T04:01:58.298912+0000","last_fullsized":"2023-06-08T04:01:58.298912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680117+0000","last_change":"2023-06-08T04:01:56.788030+0000","last_active":"2023-06-08T04:01:58.680117+0000","last_peered":"2023-06-08T04:01:58.680117+0000","last_clean":"2023-06-08T04:01:58.680117+0000","last_became_active":"2023-06-08T04:01:56.787625+0000","last_became_peered":"2023-06-08T04:01:56.787625+0000","last_unstale":"2023-06-08T04:01:58.680117+0000","last_undegraded":"2023-06-08T04:01:58.680117+0000","last_fullsized":"2023-06-08T04:01:58.680117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:07:19.055855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679624+0000","last_change":"2023-06-08T04:01:57.308473+0000","last_active":"2023-06-08T04:01:58.679624+0000","last_peered":"2023-06-08T04:01:58.679624+0000","last_clean":"2023-06-08T04:01:58.679624+0000","last_became_active":"2023-06-08T04:01:57.307707+0000","last_became_peered":"2023-06-08T04:01:57.307707+0000","last_unstale":"2023-06-08T04:01:58.679624+0000","last_undegraded":"2023-06-08T04:01:58.679624+0000","last_fullsized":"2023-06-08T04:01:58.679624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678826+0000","last_change":"2023-06-08T04:01:56.782915+0000","last_active":"2023-06-08T04:01:58.678826+0000","last_peered":"2023-06-08T04:01:58.678826+0000","last_clean":"2023-06-08T04:01:58.678826+0000","last_became_active":"2023-06-08T04:01:56.782574+0000","last_became_peered":"2023-06-08T04:01:56.782574+0000","last_unstale":"2023-06-08T04:01:58.678826+0000","last_undegraded":"2023-06-08T04:01:58.678826+0000","last_fullsized":"2023-06-08T04:01:58.678826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:19.133778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680505+0000","last_change":"2023-06-08T04:01:57.310946+0000","last_active":"2023-06-08T04:01:58.680505+0000","last_peered":"2023-06-08T04:01:58.680505+0000","last_clean":"2023-06-08T04:01:58.680505+0000","last_became_active":"2023-06-08T04:01:57.310665+0000","last_became_peered":"2023-06-08T04:01:57.310665+0000","last_unstale":"2023-06-08T04:01:58.680505+0000","last_undegraded":"2023-06-08T04:01:58.680505+0000","last_fullsized":"2023-06-08T04:01:58.680505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:54.420632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679960+0000","last_change":"2023-06-08T04:01:56.781278+0000","last_active":"2023-06-08T04:01:58.679960+0000","last_peered":"2023-06-08T04:01:58.679960+0000","last_clean":"2023-06-08T04:01:58.679960+0000","last_became_active":"2023-06-08T04:01:56.780953+0000","last_became_peered":"2023-06-08T04:01:56.780953+0000","last_unstale":"2023-06-08T04:01:58.679960+0000","last_undegraded":"2023-06-08T04:01:58.679960+0000","last_fullsized":"2023-06-08T04:01:58.679960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:12.973041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679890+0000","last_change":"2023-06-08T04:01:57.313256+0000","last_active":"2023-06-08T04:01:58.679890+0000","last_peered":"2023-06-08T04:01:58.679890+0000","last_clean":"2023-06-08T04:01:58.679890+0000","last_became_active":"2023-06-08T04:01:57.312990+0000","last_became_peered":"2023-06-08T04:01:57.312990+0000","last_unstale":"2023-06-08T04:01:58.679890+0000","last_undegraded":"2023-06-08T04:01:58.679890+0000","last_fullsized":"2023-06-08T04:01:58.679890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:28.694562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680347+0000","last_change":"2023-06-08T04:01:56.773826+0000","last_active":"2023-06-08T04:01:58.680347+0000","last_peered":"2023-06-08T04:01:58.680347+0000","last_clean":"2023-06-08T04:01:58.680347+0000","last_became_active":"2023-06-08T04:01:56.773459+0000","last_became_peered":"2023-06-08T04:01:56.773459+0000","last_unstale":"2023-06-08T04:01:58.680347+0000","last_undegraded":"2023-06-08T04:01:58.680347+0000","last_fullsized":"2023-06-08T04:01:58.680347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:24.507881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679843+0000","last_change":"2023-06-08T04:01:57.304560+0000","last_active":"2023-06-08T04:01:58.679843+0000","last_peered":"2023-06-08T04:01:58.679843+0000","last_clean":"2023-06-08T04:01:58.679843+0000","last_became_active":"2023-06-08T04:01:57.304311+0000","last_became_peered":"2023-06-08T04:01:57.304311+0000","last_unstale":"2023-06-08T04:01:58.679843+0000","last_undegraded":"2023-06-08T04:01:58.679843+0000","last_fullsized":"2023-06-08T04:01:58.679843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:12:00.959096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298423+0000","last_change":"2023-06-08T04:01:56.783994+0000","last_active":"2023-06-08T04:01:58.298423+0000","last_peered":"2023-06-08T04:01:58.298423+0000","last_clean":"2023-06-08T04:01:58.298423+0000","last_became_active":"2023-06-08T04:01:56.783344+0000","last_became_peered":"2023-06-08T04:01:56.783344+0000","last_unstale":"2023-06-08T04:01:58.298423+0000","last_undegraded":"2023-06-08T04:01:58.298423+0000","last_fullsized":"2023-06-08T04:01:58.298423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:42.712772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680687+0000","last_change":"2023-06-08T04:01:57.313756+0000","last_active":"2023-06-08T04:01:58.680687+0000","last_peered":"2023-06-08T04:01:58.680687+0000","last_clean":"2023-06-08T04:01:58.680687+0000","last_became_active":"2023-06-08T04:01:57.313436+0000","last_became_peered":"2023-06-08T04:01:57.313436+0000","last_unstale":"2023-06-08T04:01:58.680687+0000","last_undegraded":"2023-06-08T04:01:58.680687+0000","last_fullsized":"2023-06-08T04:01:58.680687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:19:05.998159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299112+0000","last_change":"2023-06-08T04:01:56.788377+0000","last_active":"2023-06-08T04:01:58.299112+0000","last_peered":"2023-06-08T04:01:58.299112+0000","last_clean":"2023-06-08T04:01:58.299112+0000","last_became_active":"2023-06-08T04:01:56.788107+0000","last_became_peered":"2023-06-08T04:01:56.788107+0000","last_unstale":"2023-06-08T04:01:58.299112+0000","last_undegraded":"2023-06-08T04:01:58.299112+0000","last_fullsized":"2023-06-08T04:01:58.299112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:11.801004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679085+0000","last_change":"2023-06-08T04:01:57.313322+0000","last_active":"2023-06-08T04:01:58.679085+0000","last_peered":"2023-06-08T04:01:58.679085+0000","last_clean":"2023-06-08T04:01:58.679085+0000","last_became_active":"2023-06-08T04:01:57.312901+0000","last_became_peered":"2023-06-08T04:01:57.312901+0000","last_unstale":"2023-06-08T04:01:58.679085+0000","last_undegraded":"2023-06-08T04:01:58.679085+0000","last_fullsized":"2023-06-08T04:01:58.679085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679636+0000","last_change":"2023-06-08T04:01:56.787707+0000","last_active":"2023-06-08T04:01:58.679636+0000","last_peered":"2023-06-08T04:01:58.679636+0000","last_clean":"2023-06-08T04:01:58.679636+0000","last_became_active":"2023-06-08T04:01:56.787416+0000","last_became_peered":"2023-06-08T04:01:56.787416+0000","last_unstale":"2023-06-08T04:01:58.679636+0000","last_undegraded":"2023-06-08T04:01:58.679636+0000","last_fullsized":"2023-06-08T04:01:58.679636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:17.687446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679084+0000","last_change":"2023-06-08T04:01:57.330479+0000","last_active":"2023-06-08T04:01:58.679084+0000","last_peered":"2023-06-08T04:01:58.679084+0000","last_clean":"2023-06-08T04:01:58.679084+0000","last_became_active":"2023-06-08T04:01:57.330160+0000","last_became_peered":"2023-06-08T04:01:57.330160+0000","last_unstale":"2023-06-08T04:01:58.679084+0000","last_undegraded":"2023-06-08T04:01:58.679084+0000","last_fullsized":"2023-06-08T04:01:58.679084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:49.777624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298027+0000","last_change":"2023-06-08T04:01:56.784611+0000","last_active":"2023-06-08T04:01:58.298027+0000","last_peered":"2023-06-08T04:01:58.298027+0000","last_clean":"2023-06-08T04:01:58.298027+0000","last_became_active":"2023-06-08T04:01:56.784281+0000","last_became_peered":"2023-06-08T04:01:56.784281+0000","last_unstale":"2023-06-08T04:01:58.298027+0000","last_undegraded":"2023-06-08T04:01:58.298027+0000","last_fullsized":"2023-06-08T04:01:58.298027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:12.973041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679123+0000","last_change":"2023-06-08T04:01:57.308023+0000","last_active":"2023-06-08T04:01:58.679123+0000","last_peered":"2023-06-08T04:01:58.679123+0000","last_clean":"2023-06-08T04:01:58.679123+0000","last_became_active":"2023-06-08T04:01:57.307736+0000","last_became_peered":"2023-06-08T04:01:57.307736+0000","last_unstale":"2023-06-08T04:01:58.679123+0000","last_undegraded":"2023-06-08T04:01:58.679123+0000","last_fullsized":"2023-06-08T04:01:58.679123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679194+0000","last_change":"2023-06-08T04:01:56.785032+0000","last_active":"2023-06-08T04:01:58.679194+0000","last_peered":"2023-06-08T04:01:58.679194+0000","last_clean":"2023-06-08T04:01:58.679194+0000","last_became_active":"2023-06-08T04:01:56.784737+0000","last_became_peered":"2023-06-08T04:01:56.784737+0000","last_unstale":"2023-06-08T04:01:58.679194+0000","last_undegraded":"2023-06-08T04:01:58.679194+0000","last_fullsized":"2023-06-08T04:01:58.679194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:16.084147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298926+0000","last_change":"2023-06-08T04:01:57.311452+0000","last_active":"2023-06-08T04:01:58.298926+0000","last_peered":"2023-06-08T04:01:58.298926+0000","last_clean":"2023-06-08T04:01:58.298926+0000","last_became_active":"2023-06-08T04:01:57.311216+0000","last_became_peered":"2023-06-08T04:01:57.311216+0000","last_unstale":"2023-06-08T04:01:58.298926+0000","last_undegraded":"2023-06-08T04:01:58.298926+0000","last_fullsized":"2023-06-08T04:01:58.298926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:25.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298001+0000","last_change":"2023-06-08T04:01:56.787492+0000","last_active":"2023-06-08T04:01:58.298001+0000","last_peered":"2023-06-08T04:01:58.298001+0000","last_clean":"2023-06-08T04:01:58.298001+0000","last_became_active":"2023-06-08T04:01:56.787212+0000","last_became_peered":"2023-06-08T04:01:56.787212+0000","last_unstale":"2023-06-08T04:01:58.298001+0000","last_undegraded":"2023-06-08T04:01:58.298001+0000","last_fullsized":"2023-06-08T04:01:58.298001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:11:59.951753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680188+0000","last_change":"2023-06-08T04:01:57.307696+0000","last_active":"2023-06-08T04:01:58.680188+0000","last_peered":"2023-06-08T04:01:58.680188+0000","last_clean":"2023-06-08T04:01:58.680188+0000","last_became_active":"2023-06-08T04:01:57.307394+0000","last_became_peered":"2023-06-08T04:01:57.307394+0000","last_unstale":"2023-06-08T04:01:58.680188+0000","last_undegraded":"2023-06-08T04:01:58.680188+0000","last_fullsized":"2023-06-08T04:01:58.680188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:00:24.759983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679211+0000","last_change":"2023-06-08T04:01:56.792893+0000","last_active":"2023-06-08T04:01:58.679211+0000","last_peered":"2023-06-08T04:01:58.679211+0000","last_clean":"2023-06-08T04:01:58.679211+0000","last_became_active":"2023-06-08T04:01:56.792583+0000","last_became_peered":"2023-06-08T04:01:56.792583+0000","last_unstale":"2023-06-08T04:01:58.679211+0000","last_undegraded":"2023-06-08T04:01:58.679211+0000","last_fullsized":"2023-06-08T04:01:58.679211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:51:11.572500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679629+0000","last_change":"2023-06-08T04:01:57.313638+0000","last_active":"2023-06-08T04:01:58.679629+0000","last_peered":"2023-06-08T04:01:58.679629+0000","last_clean":"2023-06-08T04:01:58.679629+0000","last_became_active":"2023-06-08T04:01:57.313084+0000","last_became_peered":"2023-06-08T04:01:57.313084+0000","last_unstale":"2023-06-08T04:01:58.679629+0000","last_undegraded":"2023-06-08T04:01:58.679629+0000","last_fullsized":"2023-06-08T04:01:58.679629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:23.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298175+0000","last_change":"2023-06-08T04:01:56.786135+0000","last_active":"2023-06-08T04:01:58.298175+0000","last_peered":"2023-06-08T04:01:58.298175+0000","last_clean":"2023-06-08T04:01:58.298175+0000","last_became_active":"2023-06-08T04:01:56.785831+0000","last_became_peered":"2023-06-08T04:01:56.785831+0000","last_unstale":"2023-06-08T04:01:58.298175+0000","last_undegraded":"2023-06-08T04:01:58.298175+0000","last_fullsized":"2023-06-08T04:01:58.298175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:46.343531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298483+0000","last_change":"2023-06-08T04:01:57.311375+0000","last_active":"2023-06-08T04:01:58.298483+0000","last_peered":"2023-06-08T04:01:58.298483+0000","last_clean":"2023-06-08T04:01:58.298483+0000","last_became_active":"2023-06-08T04:01:57.310796+0000","last_became_peered":"2023-06-08T04:01:57.310796+0000","last_unstale":"2023-06-08T04:01:58.298483+0000","last_undegraded":"2023-06-08T04:01:58.298483+0000","last_fullsized":"2023-06-08T04:01:58.298483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:41.897231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298396+0000","last_change":"2023-06-08T04:01:56.786840+0000","last_active":"2023-06-08T04:01:58.298396+0000","last_peered":"2023-06-08T04:01:58.298396+0000","last_clean":"2023-06-08T04:01:58.298396+0000","last_became_active":"2023-06-08T04:01:56.786481+0000","last_became_peered":"2023-06-08T04:01:56.786481+0000","last_unstale":"2023-06-08T04:01:58.298396+0000","last_undegraded":"2023-06-08T04:01:58.298396+0000","last_fullsized":"2023-06-08T04:01:58.298396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:19:04.990816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678894+0000","last_change":"2023-06-08T04:01:57.324051+0000","last_active":"2023-06-08T04:01:58.678894+0000","last_peered":"2023-06-08T04:01:58.678894+0000","last_clean":"2023-06-08T04:01:58.678894+0000","last_became_active":"2023-06-08T04:01:57.323207+0000","last_became_peered":"2023-06-08T04:01:57.323207+0000","last_unstale":"2023-06-08T04:01:58.678894+0000","last_undegraded":"2023-06-08T04:01:58.678894+0000","last_fullsized":"2023-06-08T04:01:58.678894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299059+0000","last_change":"2023-06-08T04:01:56.785385+0000","last_active":"2023-06-08T04:01:58.299059+0000","last_peered":"2023-06-08T04:01:58.299059+0000","last_clean":"2023-06-08T04:01:58.299059+0000","last_became_active":"2023-06-08T04:01:56.785079+0000","last_became_peered":"2023-06-08T04:01:56.785079+0000","last_unstale":"2023-06-08T04:01:58.299059+0000","last_undegraded":"2023-06-08T04:01:58.299059+0000","last_fullsized":"2023-06-08T04:01:58.299059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:56.785165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679791+0000","last_change":"2023-06-08T04:01:57.313448+0000","last_active":"2023-06-08T04:01:58.679791+0000","last_peered":"2023-06-08T04:01:58.679791+0000","last_clean":"2023-06-08T04:01:58.679791+0000","last_became_active":"2023-06-08T04:01:57.312734+0000","last_became_peered":"2023-06-08T04:01:57.312734+0000","last_unstale":"2023-06-08T04:01:58.679791+0000","last_undegraded":"2023-06-08T04:01:58.679791+0000","last_fullsized":"2023-06-08T04:01:58.679791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298787+0000","last_change":"2023-06-08T04:01:56.779903+0000","last_active":"2023-06-08T04:01:58.298787+0000","last_peered":"2023-06-08T04:01:58.298787+0000","last_clean":"2023-06-08T04:01:58.298787+0000","last_became_active":"2023-06-08T04:01:56.779569+0000","last_became_peered":"2023-06-08T04:01:56.779569+0000","last_unstale":"2023-06-08T04:01:58.298787+0000","last_undegraded":"2023-06-08T04:01:58.298787+0000","last_fullsized":"2023-06-08T04:01:58.298787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:52.080071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679025+0000","last_change":"2023-06-08T04:01:57.309781+0000","last_active":"2023-06-08T04:01:58.679025+0000","last_peered":"2023-06-08T04:01:58.679025+0000","last_clean":"2023-06-08T04:01:58.679025+0000","last_became_active":"2023-06-08T04:01:57.309383+0000","last_became_peered":"2023-06-08T04:01:57.309383+0000","last_unstale":"2023-06-08T04:01:58.679025+0000","last_undegraded":"2023-06-08T04:01:58.679025+0000","last_fullsized":"2023-06-08T04:01:58.679025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680127+0000","last_change":"2023-06-08T04:01:56.785855+0000","last_active":"2023-06-08T04:01:58.680127+0000","last_peered":"2023-06-08T04:01:58.680127+0000","last_clean":"2023-06-08T04:01:58.680127+0000","last_became_active":"2023-06-08T04:01:56.785233+0000","last_became_peered":"2023-06-08T04:01:56.785233+0000","last_unstale":"2023-06-08T04:01:58.680127+0000","last_undegraded":"2023-06-08T04:01:58.680127+0000","last_fullsized":"2023-06-08T04:01:58.680127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:20:17.687446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679452+0000","last_change":"2023-06-08T04:01:57.322184+0000","last_active":"2023-06-08T04:01:58.679452+0000","last_peered":"2023-06-08T04:01:58.679452+0000","last_clean":"2023-06-08T04:01:58.679452+0000","last_became_active":"2023-06-08T04:01:57.321644+0000","last_became_peered":"2023-06-08T04:01:57.321644+0000","last_unstale":"2023-06-08T04:01:58.679452+0000","last_undegraded":"2023-06-08T04:01:58.679452+0000","last_fullsized":"2023-06-08T04:01:58.679452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:12:00.959096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679629+0000","last_change":"2023-06-08T04:01:56.793021+0000","last_active":"2023-06-08T04:01:58.679629+0000","last_peered":"2023-06-08T04:01:58.679629+0000","last_clean":"2023-06-08T04:01:58.679629+0000","last_became_active":"2023-06-08T04:01:56.792695+0000","last_became_peered":"2023-06-08T04:01:56.792695+0000","last_unstale":"2023-06-08T04:01:58.679629+0000","last_undegraded":"2023-06-08T04:01:58.679629+0000","last_fullsized":"2023-06-08T04:01:58.679629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:16.084147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679919+0000","last_change":"2023-06-08T04:01:57.315172+0000","last_active":"2023-06-08T04:01:58.679919+0000","last_peered":"2023-06-08T04:01:58.679919+0000","last_clean":"2023-06-08T04:01:58.679919+0000","last_became_active":"2023-06-08T04:01:57.314816+0000","last_became_peered":"2023-06-08T04:01:57.314816+0000","last_unstale":"2023-06-08T04:01:58.679919+0000","last_undegraded":"2023-06-08T04:01:58.679919+0000","last_fullsized":"2023-06-08T04:01:58.679919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:17:12.808347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679033+0000","last_change":"2023-06-08T04:01:56.782841+0000","last_active":"2023-06-08T04:01:58.679033+0000","last_peered":"2023-06-08T04:01:58.679033+0000","last_clean":"2023-06-08T04:01:58.679033+0000","last_became_active":"2023-06-08T04:01:56.782518+0000","last_became_peered":"2023-06-08T04:01:56.782518+0000","last_unstale":"2023-06-08T04:01:58.679033+0000","last_undegraded":"2023-06-08T04:01:58.679033+0000","last_fullsized":"2023-06-08T04:01:58.679033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679866+0000","last_change":"2023-06-08T04:01:57.326388+0000","last_active":"2023-06-08T04:01:58.679866+0000","last_peered":"2023-06-08T04:01:58.679866+0000","last_clean":"2023-06-08T04:01:58.679866+0000","last_became_active":"2023-06-08T04:01:57.326127+0000","last_became_peered":"2023-06-08T04:01:57.326127+0000","last_unstale":"2023-06-08T04:01:58.679866+0000","last_undegraded":"2023-06-08T04:01:58.679866+0000","last_fullsized":"2023-06-08T04:01:58.679866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:57.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679592+0000","last_change":"2023-06-08T04:01:56.789026+0000","last_active":"2023-06-08T04:01:58.679592+0000","last_peered":"2023-06-08T04:01:58.679592+0000","last_clean":"2023-06-08T04:01:58.679592+0000","last_became_active":"2023-06-08T04:01:56.788477+0000","last_became_peered":"2023-06-08T04:01:56.788477+0000","last_unstale":"2023-06-08T04:01:58.679592+0000","last_undegraded":"2023-06-08T04:01:58.679592+0000","last_fullsized":"2023-06-08T04:01:58.679592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680114+0000","last_change":"2023-06-08T04:01:57.305826+0000","last_active":"2023-06-08T04:01:58.680114+0000","last_peered":"2023-06-08T04:01:58.680114+0000","last_clean":"2023-06-08T04:01:58.680114+0000","last_became_active":"2023-06-08T04:01:57.305443+0000","last_became_peered":"2023-06-08T04:01:57.305443+0000","last_unstale":"2023-06-08T04:01:58.680114+0000","last_undegraded":"2023-06-08T04:01:58.680114+0000","last_fullsized":"2023-06-08T04:01:58.680114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679382+0000","last_change":"2023-06-08T04:01:56.789943+0000","last_active":"2023-06-08T04:01:58.679382+0000","last_peered":"2023-06-08T04:01:58.679382+0000","last_clean":"2023-06-08T04:01:58.679382+0000","last_became_active":"2023-06-08T04:01:56.789641+0000","last_became_peered":"2023-06-08T04:01:56.789641+0000","last_unstale":"2023-06-08T04:01:58.679382+0000","last_undegraded":"2023-06-08T04:01:58.679382+0000","last_fullsized":"2023-06-08T04:01:58.679382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:24.507881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679700+0000","last_change":"2023-06-08T04:01:50.999784+0000","last_active":"2023-06-08T04:01:58.679700+0000","last_peered":"2023-06-08T04:01:58.679700+0000","last_clean":"2023-06-08T04:01:58.679700+0000","last_became_active":"2023-06-08T04:01:50.999446+0000","last_became_peered":"2023-06-08T04:01:50.999446+0000","last_unstale":"2023-06-08T04:01:58.679700+0000","last_undegraded":"2023-06-08T04:01:58.679700+0000","last_fullsized":"2023-06-08T04:01:58.679700+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:18:58.957649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679453+0000","last_change":"2023-06-08T04:01:57.314412+0000","last_active":"2023-06-08T04:01:58.679453+0000","last_peered":"2023-06-08T04:01:58.679453+0000","last_clean":"2023-06-08T04:01:58.679453+0000","last_became_active":"2023-06-08T04:01:57.314079+0000","last_became_peered":"2023-06-08T04:01:57.314079+0000","last_unstale":"2023-06-08T04:01:58.679453+0000","last_undegraded":"2023-06-08T04:01:58.679453+0000","last_fullsized":"2023-06-08T04:01:58.679453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:50.348618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679209+0000","last_change":"2023-06-08T04:01:50.729188+0000","last_active":"2023-06-08T04:01:58.679209+0000","last_peered":"2023-06-08T04:01:58.679209+0000","last_clean":"2023-06-08T04:01:58.679209+0000","last_became_active":"2023-06-08T04:01:50.728711+0000","last_became_peered":"2023-06-08T04:01:50.728711+0000","last_unstale":"2023-06-08T04:01:58.679209+0000","last_undegraded":"2023-06-08T04:01:58.679209+0000","last_fullsized":"2023-06-08T04:01:58.679209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:46.046903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:59.251695+0000","last_change":"2023-06-08T04:01:56.784336+0000","last_active":"2023-06-08T04:01:59.251695+0000","last_peered":"2023-06-08T04:01:59.251695+0000","last_clean":"2023-06-08T04:01:59.251695+0000","last_became_active":"2023-06-08T04:01:56.783906+0000","last_became_peered":"2023-06-08T04:01:56.783906+0000","last_unstale":"2023-06-08T04:01:59.251695+0000","last_undegraded":"2023-06-08T04:01:59.251695+0000","last_fullsized":"2023-06-08T04:01:59.251695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:52:48.770281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678949+0000","last_change":"2023-06-08T04:01:57.325405+0000","last_active":"2023-06-08T04:01:58.678949+0000","last_peered":"2023-06-08T04:01:58.678949+0000","last_clean":"2023-06-08T04:01:58.678949+0000","last_became_active":"2023-06-08T04:01:57.325123+0000","last_became_peered":"2023-06-08T04:01:57.325123+0000","last_unstale":"2023-06-08T04:01:58.678949+0000","last_undegraded":"2023-06-08T04:01:58.678949+0000","last_fullsized":"2023-06-08T04:01:58.678949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:29:25.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678720+0000","last_change":"2023-06-08T04:01:50.734710+0000","last_active":"2023-06-08T04:01:58.678720+0000","last_peered":"2023-06-08T04:01:58.678720+0000","last_clean":"2023-06-08T04:01:58.678720+0000","last_became_active":"2023-06-08T04:01:50.734287+0000","last_became_peered":"2023-06-08T04:01:50.734287+0000","last_unstale":"2023-06-08T04:01:58.678720+0000","last_undegraded":"2023-06-08T04:01:58.678720+0000","last_fullsized":"2023-06-08T04:01:58.678720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:51:05.539333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297919+0000","last_change":"2023-06-08T04:01:51.742803+0000","last_active":"2023-06-08T04:01:58.297919+0000","last_peered":"2023-06-08T04:01:58.297919+0000","last_clean":"2023-06-08T04:01:58.297919+0000","last_became_active":"2023-06-08T04:01:51.742466+0000","last_became_peered":"2023-06-08T04:01:51.742466+0000","last_unstale":"2023-06-08T04:01:58.297919+0000","last_undegraded":"2023-06-08T04:01:58.297919+0000","last_fullsized":"2023-06-08T04:01:58.297919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_clean_scrub_stamp":"2023-06-08T04:01:50.718021+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:17.413272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679950+0000","last_change":"2023-06-08T04:01:56.783919+0000","last_active":"2023-06-08T04:01:58.679950+0000","last_peered":"2023-06-08T04:01:58.679950+0000","last_clean":"2023-06-08T04:01:58.679950+0000","last_became_active":"2023-06-08T04:01:56.783607+0000","last_became_peered":"2023-06-08T04:01:56.783607+0000","last_unstale":"2023-06-08T04:01:58.679950+0000","last_undegraded":"2023-06-08T04:01:58.679950+0000","last_fullsized":"2023-06-08T04:01:58.679950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:46:27.687219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680318+0000","last_change":"2023-06-08T04:01:57.309149+0000","last_active":"2023-06-08T04:01:58.680318+0000","last_peered":"2023-06-08T04:01:58.680318+0000","last_clean":"2023-06-08T04:01:58.680318+0000","last_became_active":"2023-06-08T04:01:57.308445+0000","last_became_peered":"2023-06-08T04:01:57.308445+0000","last_unstale":"2023-06-08T04:01:58.680318+0000","last_undegraded":"2023-06-08T04:01:58.680318+0000","last_fullsized":"2023-06-08T04:01:58.680318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:50.260754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297951+0000","last_change":"2023-06-08T04:01:51.001331+0000","last_active":"2023-06-08T04:01:58.297951+0000","last_peered":"2023-06-08T04:01:58.297951+0000","last_clean":"2023-06-08T04:01:58.297951+0000","last_became_active":"2023-06-08T04:01:51.001009+0000","last_became_peered":"2023-06-08T04:01:51.001009+0000","last_unstale":"2023-06-08T04:01:58.297951+0000","last_undegraded":"2023-06-08T04:01:58.297951+0000","last_fullsized":"2023-06-08T04:01:58.297951+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:14.078321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678533+0000","last_change":"2023-06-08T04:01:56.787400+0000","last_active":"2023-06-08T04:01:58.678533+0000","last_peered":"2023-06-08T04:01:58.678533+0000","last_clean":"2023-06-08T04:01:58.678533+0000","last_became_active":"2023-06-08T04:01:56.785569+0000","last_became_peered":"2023-06-08T04:01:56.785569+0000","last_unstale":"2023-06-08T04:01:58.678533+0000","last_undegraded":"2023-06-08T04:01:58.678533+0000","last_fullsized":"2023-06-08T04:01:58.678533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:44:53.499091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679987+0000","last_change":"2023-06-08T04:01:57.314750+0000","last_active":"2023-06-08T04:01:58.679987+0000","last_peered":"2023-06-08T04:01:58.679987+0000","last_clean":"2023-06-08T04:01:58.679987+0000","last_became_active":"2023-06-08T04:01:57.314472+0000","last_became_peered":"2023-06-08T04:01:57.314472+0000","last_unstale":"2023-06-08T04:01:58.679987+0000","last_undegraded":"2023-06-08T04:01:58.679987+0000","last_fullsized":"2023-06-08T04:01:58.679987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.297740+0000","last_change":"2023-06-08T04:01:51.000319+0000","last_active":"2023-06-08T04:01:58.297740+0000","last_peered":"2023-06-08T04:01:58.297740+0000","last_clean":"2023-06-08T04:01:58.297740+0000","last_became_active":"2023-06-08T04:01:50.999943+0000","last_became_peered":"2023-06-08T04:01:50.999943+0000","last_unstale":"2023-06-08T04:01:58.297740+0000","last_undegraded":"2023-06-08T04:01:58.297740+0000","last_fullsized":"2023-06-08T04:01:58.297740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:43.308108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678945+0000","last_change":"2023-06-08T04:01:56.774312+0000","last_active":"2023-06-08T04:01:58.678945+0000","last_peered":"2023-06-08T04:01:58.678945+0000","last_clean":"2023-06-08T04:01:58.678945+0000","last_became_active":"2023-06-08T04:01:56.774005+0000","last_became_peered":"2023-06-08T04:01:56.774005+0000","last_unstale":"2023-06-08T04:01:58.678945+0000","last_undegraded":"2023-06-08T04:01:58.678945+0000","last_fullsized":"2023-06-08T04:01:58.678945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:30.163198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679484+0000","last_change":"2023-06-08T04:01:57.326639+0000","last_active":"2023-06-08T04:01:58.679484+0000","last_peered":"2023-06-08T04:01:58.679484+0000","last_clean":"2023-06-08T04:01:58.679484+0000","last_became_active":"2023-06-08T04:01:57.326373+0000","last_became_peered":"2023-06-08T04:01:57.326373+0000","last_unstale":"2023-06-08T04:01:58.679484+0000","last_undegraded":"2023-06-08T04:01:58.679484+0000","last_fullsized":"2023-06-08T04:01:58.679484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.247246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298044+0000","last_change":"2023-06-08T04:01:51.000090+0000","last_active":"2023-06-08T04:01:58.298044+0000","last_peered":"2023-06-08T04:01:58.298044+0000","last_clean":"2023-06-08T04:01:58.298044+0000","last_became_active":"2023-06-08T04:01:50.999789+0000","last_became_peered":"2023-06-08T04:01:50.999789+0000","last_unstale":"2023-06-08T04:01:58.298044+0000","last_undegraded":"2023-06-08T04:01:58.298044+0000","last_fullsized":"2023-06-08T04:01:58.298044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:11:58.206736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679223+0000","last_change":"2023-06-08T04:01:56.778178+0000","last_active":"2023-06-08T04:01:58.679223+0000","last_peered":"2023-06-08T04:01:58.679223+0000","last_clean":"2023-06-08T04:01:58.679223+0000","last_became_active":"2023-06-08T04:01:56.777877+0000","last_became_peered":"2023-06-08T04:01:56.777877+0000","last_unstale":"2023-06-08T04:01:58.679223+0000","last_undegraded":"2023-06-08T04:01:58.679223+0000","last_fullsized":"2023-06-08T04:01:58.679223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:07:22.443805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679364+0000","last_change":"2023-06-08T04:01:57.312009+0000","last_active":"2023-06-08T04:01:58.679364+0000","last_peered":"2023-06-08T04:01:58.679364+0000","last_clean":"2023-06-08T04:01:58.679364+0000","last_became_active":"2023-06-08T04:01:57.311651+0000","last_became_peered":"2023-06-08T04:01:57.311651+0000","last_unstale":"2023-06-08T04:01:58.679364+0000","last_undegraded":"2023-06-08T04:01:58.679364+0000","last_fullsized":"2023-06-08T04:01:58.679364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:41.897231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679250+0000","last_change":"2023-06-08T04:01:51.000507+0000","last_active":"2023-06-08T04:01:58.679250+0000","last_peered":"2023-06-08T04:01:58.679250+0000","last_clean":"2023-06-08T04:01:58.679250+0000","last_became_active":"2023-06-08T04:01:51.000175+0000","last_became_peered":"2023-06-08T04:01:51.000175+0000","last_unstale":"2023-06-08T04:01:58.679250+0000","last_undegraded":"2023-06-08T04:01:58.679250+0000","last_fullsized":"2023-06-08T04:01:58.679250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:08:13.100611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679229+0000","last_change":"2023-06-08T04:01:56.785424+0000","last_active":"2023-06-08T04:01:58.679229+0000","last_peered":"2023-06-08T04:01:58.679229+0000","last_clean":"2023-06-08T04:01:58.679229+0000","last_became_active":"2023-06-08T04:01:56.785198+0000","last_became_peered":"2023-06-08T04:01:56.785198+0000","last_unstale":"2023-06-08T04:01:58.679229+0000","last_undegraded":"2023-06-08T04:01:58.679229+0000","last_fullsized":"2023-06-08T04:01:58.679229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:52:47.851853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679359+0000","last_change":"2023-06-08T04:01:57.315582+0000","last_active":"2023-06-08T04:01:58.679359+0000","last_peered":"2023-06-08T04:01:58.679359+0000","last_clean":"2023-06-08T04:01:58.679359+0000","last_became_active":"2023-06-08T04:01:57.314479+0000","last_became_peered":"2023-06-08T04:01:57.314479+0000","last_unstale":"2023-06-08T04:01:58.679359+0000","last_undegraded":"2023-06-08T04:01:58.679359+0000","last_fullsized":"2023-06-08T04:01:58.679359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679828+0000","last_change":"2023-06-08T04:01:50.734174+0000","last_active":"2023-06-08T04:01:58.679828+0000","last_peered":"2023-06-08T04:01:58.679828+0000","last_clean":"2023-06-08T04:01:58.679828+0000","last_became_active":"2023-06-08T04:01:50.733832+0000","last_became_peered":"2023-06-08T04:01:50.733832+0000","last_unstale":"2023-06-08T04:01:58.679828+0000","last_undegraded":"2023-06-08T04:01:58.679828+0000","last_fullsized":"2023-06-08T04:01:58.679828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:34.856721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299103+0000","last_change":"2023-06-08T04:01:56.782230+0000","last_active":"2023-06-08T04:01:58.299103+0000","last_peered":"2023-06-08T04:01:58.299103+0000","last_clean":"2023-06-08T04:01:58.299103+0000","last_became_active":"2023-06-08T04:01:56.781942+0000","last_became_peered":"2023-06-08T04:01:56.781942+0000","last_unstale":"2023-06-08T04:01:58.299103+0000","last_undegraded":"2023-06-08T04:01:58.299103+0000","last_fullsized":"2023-06-08T04:01:58.299103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:53.413290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679365+0000","last_change":"2023-06-08T04:01:57.314750+0000","last_active":"2023-06-08T04:01:58.679365+0000","last_peered":"2023-06-08T04:01:58.679365+0000","last_clean":"2023-06-08T04:01:58.679365+0000","last_became_active":"2023-06-08T04:01:57.314515+0000","last_became_peered":"2023-06-08T04:01:57.314515+0000","last_unstale":"2023-06-08T04:01:58.679365+0000","last_undegraded":"2023-06-08T04:01:58.679365+0000","last_fullsized":"2023-06-08T04:01:58.679365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:07:43.720115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679505+0000","last_change":"2023-06-08T04:01:56.784632+0000","last_active":"2023-06-08T04:01:58.679505+0000","last_peered":"2023-06-08T04:01:58.679505+0000","last_clean":"2023-06-08T04:01:58.679505+0000","last_became_active":"2023-06-08T04:01:56.784077+0000","last_became_peered":"2023-06-08T04:01:56.784077+0000","last_unstale":"2023-06-08T04:01:58.679505+0000","last_undegraded":"2023-06-08T04:01:58.679505+0000","last_fullsized":"2023-06-08T04:01:58.679505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:21:40.889888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.294761+0000","last_change":"2023-06-08T04:01:57.306546+0000","last_active":"2023-06-08T04:01:58.294761+0000","last_peered":"2023-06-08T04:01:58.294761+0000","last_clean":"2023-06-08T04:01:58.294761+0000","last_became_active":"2023-06-08T04:01:57.306284+0000","last_became_peered":"2023-06-08T04:01:57.306284+0000","last_unstale":"2023-06-08T04:01:58.294761+0000","last_undegraded":"2023-06-08T04:01:58.294761+0000","last_fullsized":"2023-06-08T04:01:58.294761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:27:15.918495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.298675+0000","last_change":"2023-06-08T04:01:56.782619+0000","last_active":"2023-06-08T04:01:58.298675+0000","last_peered":"2023-06-08T04:01:58.298675+0000","last_clean":"2023-06-08T04:01:58.298675+0000","last_became_active":"2023-06-08T04:01:56.782330+0000","last_became_peered":"2023-06-08T04:01:56.782330+0000","last_unstale":"2023-06-08T04:01:58.298675+0000","last_undegraded":"2023-06-08T04:01:58.298675+0000","last_fullsized":"2023-06-08T04:01:58.298675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:30.163198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679246+0000","last_change":"2023-06-08T04:01:57.321947+0000","last_active":"2023-06-08T04:01:58.679246+0000","last_peered":"2023-06-08T04:01:58.679246+0000","last_clean":"2023-06-08T04:01:58.679246+0000","last_became_active":"2023-06-08T04:01:57.321553+0000","last_became_peered":"2023-06-08T04:01:57.321553+0000","last_unstale":"2023-06-08T04:01:58.679246+0000","last_undegraded":"2023-06-08T04:01:58.679246+0000","last_fullsized":"2023-06-08T04:01:58.679246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:21.118831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.299053+0000","last_change":"2023-06-08T04:01:56.781610+0000","last_active":"2023-06-08T04:01:58.299053+0000","last_peered":"2023-06-08T04:01:58.299053+0000","last_clean":"2023-06-08T04:01:58.299053+0000","last_became_active":"2023-06-08T04:01:56.781235+0000","last_became_peered":"2023-06-08T04:01:56.781235+0000","last_unstale":"2023-06-08T04:01:58.299053+0000","last_undegraded":"2023-06-08T04:01:58.299053+0000","last_fullsized":"2023-06-08T04:01:58.299053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:49.341275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680212+0000","last_change":"2023-06-08T04:01:57.320898+0000","last_active":"2023-06-08T04:01:58.680212+0000","last_peered":"2023-06-08T04:01:58.680212+0000","last_clean":"2023-06-08T04:01:58.680212+0000","last_became_active":"2023-06-08T04:01:57.320681+0000","last_became_peered":"2023-06-08T04:01:57.320681+0000","last_unstale":"2023-06-08T04:01:58.680212+0000","last_undegraded":"2023-06-08T04:01:58.680212+0000","last_fullsized":"2023-06-08T04:01:58.680212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:34:03.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679303+0000","last_change":"2023-06-08T04:01:56.789740+0000","last_active":"2023-06-08T04:01:58.679303+0000","last_peered":"2023-06-08T04:01:58.679303+0000","last_clean":"2023-06-08T04:01:58.679303+0000","last_became_active":"2023-06-08T04:01:56.789322+0000","last_became_peered":"2023-06-08T04:01:56.789322+0000","last_unstale":"2023-06-08T04:01:58.679303+0000","last_undegraded":"2023-06-08T04:01:58.679303+0000","last_fullsized":"2023-06-08T04:01:58.679303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:16:49.253411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680786+0000","last_change":"2023-06-08T04:01:57.301738+0000","last_active":"2023-06-08T04:01:58.680786+0000","last_peered":"2023-06-08T04:01:58.680786+0000","last_clean":"2023-06-08T04:01:58.680786+0000","last_became_active":"2023-06-08T04:01:57.301468+0000","last_became_peered":"2023-06-08T04:01:57.301468+0000","last_unstale":"2023-06-08T04:01:58.680786+0000","last_undegraded":"2023-06-08T04:01:58.680786+0000","last_fullsized":"2023-06-08T04:01:58.680786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:57.792508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680472+0000","last_change":"2023-06-08T04:01:56.774643+0000","last_active":"2023-06-08T04:01:58.680472+0000","last_peered":"2023-06-08T04:01:58.680472+0000","last_clean":"2023-06-08T04:01:58.680472+0000","last_became_active":"2023-06-08T04:01:56.774331+0000","last_became_peered":"2023-06-08T04:01:56.774331+0000","last_unstale":"2023-06-08T04:01:58.680472+0000","last_undegraded":"2023-06-08T04:01:58.680472+0000","last_fullsized":"2023-06-08T04:01:58.680472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:55.748554+0000","last_clean_scrub_stamp":"2023-06-08T04:01:55.748554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:43:49.341275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.678854+0000","last_change":"2023-06-08T04:01:57.325733+0000","last_active":"2023-06-08T04:01:58.678854+0000","last_peered":"2023-06-08T04:01:58.678854+0000","last_clean":"2023-06-08T04:01:58.678854+0000","last_became_active":"2023-06-08T04:01:57.325478+0000","last_became_peered":"2023-06-08T04:01:57.325478+0000","last_unstale":"2023-06-08T04:01:58.678854+0000","last_undegraded":"2023-06-08T04:01:58.678854+0000","last_fullsized":"2023-06-08T04:01:58.678854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:53.087414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679936+0000","last_change":"2023-06-08T04:01:57.316607+0000","last_active":"2023-06-08T04:01:58.679936+0000","last_peered":"2023-06-08T04:01:58.679936+0000","last_clean":"2023-06-08T04:01:58.679936+0000","last_became_active":"2023-06-08T04:01:57.316279+0000","last_became_peered":"2023-06-08T04:01:57.316279+0000","last_unstale":"2023-06-08T04:01:58.679936+0000","last_undegraded":"2023-06-08T04:01:58.679936+0000","last_fullsized":"2023-06-08T04:01:58.679936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:57:31.170541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680685+0000","last_change":"2023-06-08T04:01:57.307400+0000","last_active":"2023-06-08T04:01:58.680685+0000","last_peered":"2023-06-08T04:01:58.680685+0000","last_clean":"2023-06-08T04:01:58.680685+0000","last_became_active":"2023-06-08T04:01:57.307110+0000","last_became_peered":"2023-06-08T04:01:57.307110+0000","last_unstale":"2023-06-08T04:01:58.680685+0000","last_undegraded":"2023-06-08T04:01:58.680685+0000","last_fullsized":"2023-06-08T04:01:58.680685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:33:47.350874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680097+0000","last_change":"2023-06-08T04:01:57.328380+0000","last_active":"2023-06-08T04:01:58.680097+0000","last_peered":"2023-06-08T04:01:58.680097+0000","last_clean":"2023-06-08T04:01:58.680097+0000","last_became_active":"2023-06-08T04:01:57.328134+0000","last_became_peered":"2023-06-08T04:01:57.328134+0000","last_unstale":"2023-06-08T04:01:58.680097+0000","last_undegraded":"2023-06-08T04:01:58.680097+0000","last_fullsized":"2023-06-08T04:01:58.680097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:25:34.644774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.680126+0000","last_change":"2023-06-08T04:01:57.313801+0000","last_active":"2023-06-08T04:01:58.680126+0000","last_peered":"2023-06-08T04:01:58.680126+0000","last_clean":"2023-06-08T04:01:58.680126+0000","last_became_active":"2023-06-08T04:01:57.313059+0000","last_became_peered":"2023-06-08T04:01:57.313059+0000","last_unstale":"2023-06-08T04:01:58.680126+0000","last_undegraded":"2023-06-08T04:01:58.680126+0000","last_fullsized":"2023-06-08T04:01:58.680126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:50:40.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-08T04:01:58.679109+0000","last_change":"2023-06-08T04:01:57.316784+0000","last_active":"2023-06-08T04:01:58.679109+0000","last_peered":"2023-06-08T04:01:58.679109+0000","last_clean":"2023-06-08T04:01:58.679109+0000","last_became_active":"2023-06-08T04:01:57.316329+0000","last_became_peered":"2023-06-08T04:01:57.316329+0000","last_unstale":"2023-06-08T04:01:58.679109+0000","last_undegraded":"2023-06-08T04:01:58.679109+0000","last_fullsized":"2023-06-08T04:01:58.679109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:56.755897+0000","last_clean_scrub_stamp":"2023-06-08T04:01:56.755897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:17.091490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":671608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8010000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2469999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2189999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":669828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":81080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":80112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.968}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8279999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T04:02:08.481 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-08T04:02:08.481 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-08T04:02:08.481 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-08T04:02:08.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-08T04:02:08.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.708+0000 7f389b1ff700 1 Processor -- start 2023-06-08T04:02:08.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.708+0000 7f389b1ff700 1 -- start start 2023-06-08T04:02:08.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.710+0000 7f389b1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3894160a60 0x7f38940b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.710+0000 7f389b1ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f38940b4b50 0x7f38940d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.710+0000 7f389b1ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940d0800 con 0x7f38940b83f0 2023-06-08T04:02:08.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.710+0000 7f389b1ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3894160ed0 con 0x7f38940b4b50 2023-06-08T04:02:08.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.710+0000 7f389b1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940b4fd0 con 0x7f3894160a60 2023-06-08T04:02:08.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.710+0000 7f3898f9b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f38940b83f0 0x7f38940ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51618/0 (socket says 172.21.15.16:51618) 2023-06-08T04:02:08.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.710+0000 7f3898f9b700 1 -- 172.21.15.16:0/2505710760 learned_addr learned my addr 172.21.15.16:0/2505710760 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:08.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.710+0000 7f389979c700 1 --2- 172.21.15.16:0/2505710760 >> v2:172.21.15.16:3300/0 conn(0x7f38940b4b50 0x7f38940d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.710+0000 7f3893fff700 1 --2- 172.21.15.16:0/2505710760 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3894160a60 0x7f38940b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.711+0000 7f389979c700 1 -- 172.21.15.16:0/2505710760 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3894160a60 msgr2=0x7f38940b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:08.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.711+0000 7f389979c700 1 --2- 172.21.15.16:0/2505710760 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3894160a60 0x7f38940b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.711+0000 7f389979c700 1 -- 172.21.15.16:0/2505710760 >> v1:172.21.15.16:6789/0 conn(0x7f38940b83f0 legacy=0x7f38940ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.711+0000 7f389979c700 1 -- 172.21.15.16:0/2505710760 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940cd1e0 con 0x7f38940b4b50 2023-06-08T04:02:08.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.711+0000 7f38937fe700 1 -- 172.21.15.16:0/2505710760 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117903380 0 0) 0x7f38940d0800 con 0x7f38940b83f0 2023-06-08T04:02:08.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.711+0000 7f389979c700 1 --2- 172.21.15.16:0/2505710760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38940b4b50 0x7f38940d0fc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f388c009d90 tx=0x7f388c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7352d880bae7a04 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:08.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.711+0000 7f38937fe700 1 -- 172.21.15.16:0/2505710760 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00e070 con 0x7f38940b4b50 2023-06-08T04:02:08.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.711+0000 7f38937fe700 1 -- 172.21.15.16:0/2505710760 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c00bb20 con 0x7f38940b4b50 2023-06-08T04:02:08.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.711+0000 7f38937fe700 1 -- 172.21.15.16:0/2505710760 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c012430 con 0x7f38940b4b50 2023-06-08T04:02:08.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.712+0000 7f389b1ff700 1 -- 172.21.15.16:0/2505710760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38940b4b50 msgr2=0x7f38940d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.712+0000 7f389b1ff700 1 --2- 172.21.15.16:0/2505710760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38940b4b50 0x7f38940d0fc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f388c009d90 tx=0x7f388c00b330 comp rx=0 tx=0).stop 2023-06-08T04:02:08.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.712+0000 7f389b1ff700 1 -- 172.21.15.16:0/2505710760 shutdown_connections 2023-06-08T04:02:08.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.712+0000 7f389b1ff700 1 --2- 172.21.15.16:0/2505710760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38940b4b50 0x7f38940d0fc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.712+0000 7f389b1ff700 1 --2- 172.21.15.16:0/2505710760 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3894160a60 0x7f38940b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.712+0000 7f389b1ff700 1 -- 172.21.15.16:0/2505710760 >> 172.21.15.16:0/2505710760 conn(0x7f38940cf610 msgr2=0x7f38940cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:08.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.712+0000 7f389b1ff700 1 -- 172.21.15.16:0/2505710760 shutdown_connections 2023-06-08T04:02:08.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.712+0000 7f389b1ff700 1 -- 172.21.15.16:0/2505710760 wait complete. 2023-06-08T04:02:08.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.714+0000 7f389b1ff700 1 Processor -- start 2023-06-08T04:02:08.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.715+0000 7f389b1ff700 1 -- start start 2023-06-08T04:02:08.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f389b1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38940b4b50 0x7f38941f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f389b1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38940b83f0 0x7f3894157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f389b1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3894160a60 0x7f38940b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f389b1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894157bd0 con 0x7f38940b83f0 2023-06-08T04:02:08.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f389b1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38941f1e20 con 0x7f38940b4b50 2023-06-08T04:02:08.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f389b1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38941f2100 con 0x7f3894160a60 2023-06-08T04:02:08.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f3893fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38940b83f0 0x7f3894157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f3893fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38940b83f0 0x7f3894157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42346/0 (socket says 172.21.15.16:42346) 2023-06-08T04:02:08.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f3893fff700 1 -- 172.21.15.16:0/1821333120 learned_addr learned my addr 172.21.15.16:0/1821333120 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:08.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f3898f9b700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38940b4b50 0x7f38941f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f389979c700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3894160a60 0x7f38940b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f3893fff700 1 -- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3894160a60 msgr2=0x7f38940b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f3893fff700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3894160a60 0x7f38940b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f3893fff700 1 -- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38940b4b50 msgr2=0x7f38941f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f3893fff700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38940b4b50 0x7f38941f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.716+0000 7f3893fff700 1 -- 172.21.15.16:0/1821333120 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c009a70 con 0x7f38940b83f0 2023-06-08T04:02:08.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.717+0000 7f3893fff700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38940b83f0 0x7f3894157690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f388000e870 tx=0x7f388000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:08.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.717+0000 7f38917fa700 1 -- 172.21.15.16:0/1821333120 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880009590 con 0x7f38940b83f0 2023-06-08T04:02:08.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.717+0000 7f38917fa700 1 -- 172.21.15.16:0/1821333120 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388000ee70 con 0x7f38940b83f0 2023-06-08T04:02:08.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.717+0000 7f38917fa700 1 -- 172.21.15.16:0/1821333120 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388000ca50 con 0x7f38940b83f0 2023-06-08T04:02:08.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.717+0000 7f389b1ff700 1 -- 172.21.15.16:0/1821333120 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38941f23e0 con 0x7f38940b83f0 2023-06-08T04:02:08.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.717+0000 7f389b1ff700 1 -- 172.21.15.16:0/1821333120 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38941f1ad0 con 0x7f38940b83f0 2023-06-08T04:02:08.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.718+0000 7f389b1ff700 1 -- 172.21.15.16:0/1821333120 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38940740e0 con 0x7f38940b83f0 2023-06-08T04:02:08.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.719+0000 7f38917fa700 1 -- 172.21.15.16:0/1821333120 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f388000cbb0 con 0x7f38940b83f0 2023-06-08T04:02:08.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.720+0000 7f38917fa700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f387806ace0 0x7f387806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:08.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.720+0000 7f38917fa700 1 -- 172.21.15.16:0/1821333120 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38800894a0 con 0x7f38940b83f0 2023-06-08T04:02:08.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.721+0000 7f3898f9b700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f387806ace0 0x7f387806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:08.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.721+0000 7f3898f9b700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f387806ace0 0x7f387806d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3888000f60 tx=0x7f3888007be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:08.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.724+0000 7f38917fa700 1 -- 172.21.15.16:0/1821333120 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3880057fd0 con 0x7f38940b83f0 2023-06-08T04:02:08.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.975+0000 7f389b1ff700 1 -- 172.21.15.16:0/1821333120 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f38940b7cc0 con 0x7f38940b83f0 2023-06-08T04:02:08.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.975+0000 7f38917fa700 1 -- 172.21.15.16:0/1821333120 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f388000ce60 con 0x7f38940b83f0 2023-06-08T04:02:08.979 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:08.979 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-08T04:02:08.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.977+0000 7f389b1ff700 1 -- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f387806ace0 msgr2=0x7f387806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.977+0000 7f389b1ff700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f387806ace0 0x7f387806d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3888000f60 tx=0x7f3888007be0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.977+0000 7f389b1ff700 1 -- 172.21.15.16:0/1821333120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38940b83f0 msgr2=0x7f3894157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:08.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.977+0000 7f389b1ff700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38940b83f0 0x7f3894157690 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f388000e870 tx=0x7f388000ec30 comp rx=0 tx=0).stop 2023-06-08T04:02:08.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.978+0000 7f389b1ff700 1 -- 172.21.15.16:0/1821333120 shutdown_connections 2023-06-08T04:02:08.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.978+0000 7f389b1ff700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f387806ace0 0x7f387806d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.978+0000 7f389b1ff700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3894160a60 0x7f38940b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.978+0000 7f389b1ff700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f38940b4b50 0x7f38941f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.978+0000 7f389b1ff700 1 --2- 172.21.15.16:0/1821333120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38940b83f0 0x7f3894157690 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:08.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.978+0000 7f389b1ff700 1 -- 172.21.15.16:0/1821333120 >> 172.21.15.16:0/1821333120 conn(0x7f38940cf610 msgr2=0x7f38940cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:08.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.978+0000 7f389b1ff700 1 -- 172.21.15.16:0/1821333120 shutdown_connections 2023-06-08T04:02:08.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:08.978+0000 7f389b1ff700 1 -- 172.21.15.16:0/1821333120 wait complete. 2023-06-08T04:02:08.999 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-08T04:02:09.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:09.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.195+0000 7fd2c17ff700 1 Processor -- start 2023-06-08T04:02:09.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.195+0000 7fd2c17ff700 1 -- start start 2023-06-08T04:02:09.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2c17ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd2bc0b83f0 0x7fd2bc160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2c17ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b4d20 0x7fd2bc0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2c17ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc0d0800 con 0x7fd2bc0ced40 2023-06-08T04:02:09.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2c17ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc0cd1e0 con 0x7fd2bc0b83f0 2023-06-08T04:02:09.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2c17ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0cd4c0 con 0x7fd2bc0b4d20 2023-06-08T04:02:09.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2baffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd2bc0b83f0 0x7fd2bc160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2baffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd2bc0b83f0 0x7fd2bc160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42352/0 (socket says 172.21.15.16:42352) 2023-06-08T04:02:09.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2baffd700 1 -- 172.21.15.16:0/1643204975 learned_addr learned my addr 172.21.15.16:0/1643204975 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:09.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2bb7fe700 1 --2- 172.21.15.16:0/1643204975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b4d20 0x7fd2bc0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2baffd700 1 -- 172.21.15.16:0/1643204975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b4d20 msgr2=0x7fd2bc0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:09.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2baffd700 1 --2- 172.21.15.16:0/1643204975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b4d20 0x7fd2bc0d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2baffd700 1 -- 172.21.15.16:0/1643204975 >> v1:172.21.15.169:6789/0 conn(0x7fd2bc0ced40 legacy=0x7fd2bc0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:09.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.197+0000 7fd2baffd700 1 -- 172.21.15.16:0/1643204975 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0d0aa0 con 0x7fd2bc0b83f0 2023-06-08T04:02:09.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.198+0000 7fd2baffd700 1 --2- 172.21.15.16:0/1643204975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0b83f0 0x7fd2bc160a60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0098f0 tx=0x7fd2ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff74ecc8ad179c4 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:09.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.198+0000 7fd2ba7fc700 1 -- 172.21.15.16:0/1643204975 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac004230 con 0x7fd2bc0b83f0 2023-06-08T04:02:09.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.198+0000 7fd2ba7fc700 1 -- 172.21.15.16:0/1643204975 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac004390 con 0x7fd2bc0b83f0 2023-06-08T04:02:09.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.198+0000 7fd2ba7fc700 1 -- 172.21.15.16:0/1643204975 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0036a0 con 0x7fd2bc0b83f0 2023-06-08T04:02:09.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.198+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1643204975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0b83f0 msgr2=0x7fd2bc160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:09.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.198+0000 7fd2c17ff700 1 --2- 172.21.15.16:0/1643204975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0b83f0 0x7fd2bc160a60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0098f0 tx=0x7fd2ac009c00 comp rx=0 tx=0).stop 2023-06-08T04:02:09.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.199+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1643204975 shutdown_connections 2023-06-08T04:02:09.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.199+0000 7fd2c17ff700 1 --2- 172.21.15.16:0/1643204975 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0b83f0 0x7fd2bc160a60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.199+0000 7fd2c17ff700 1 --2- 172.21.15.16:0/1643204975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b4d20 0x7fd2bc0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.199+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1643204975 >> 172.21.15.16:0/1643204975 conn(0x7fd2bc0cf610 msgr2=0x7fd2bc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:09.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.199+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1643204975 shutdown_connections 2023-06-08T04:02:09.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.199+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1643204975 wait complete. 2023-06-08T04:02:09.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.200+0000 7fd2c17ff700 1 Processor -- start 2023-06-08T04:02:09.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.200+0000 7fd2c17ff700 1 -- start start 2023-06-08T04:02:09.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.201+0000 7fd2c17ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b4d20 0x7fd2bc1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.201+0000 7fd2c17ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 0x7fd2bc0b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.201+0000 7fd2c17ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.201+0000 7fd2c17ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0cb410 con 0x7fd2bc0ced40 2023-06-08T04:02:09.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.201+0000 7fd2c17ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0caae0 con 0x7fd2bc0b4d20 2023-06-08T04:02:09.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.201+0000 7fd2c17ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0cadc0 con 0x7fd2bc0b83f0 2023-06-08T04:02:09.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2bb7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2bb7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42362/0 (socket says 172.21.15.16:42362) 2023-06-08T04:02:09.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2baffd700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b4d20 0x7fd2bc1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2bb7fe700 1 -- 172.21.15.16:0/1795466336 learned_addr learned my addr 172.21.15.16:0/1795466336 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:09.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2b3fff700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 0x7fd2bc0b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2bb7fe700 1 -- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 msgr2=0x7fd2bc0b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:09.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2bb7fe700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 0x7fd2bc0b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2bb7fe700 1 -- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b4d20 msgr2=0x7fd2bc1587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:09.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2bb7fe700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b4d20 0x7fd2bc1587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2bb7fe700 1 -- 172.21.15.16:0/1795466336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac009550 con 0x7fd2bc0ced40 2023-06-08T04:02:09.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2b3fff700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 0x7fd2bc0b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:09.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.202+0000 7fd2bb7fe700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b6be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4007e30 tx=0x7fd2b400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:09.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.203+0000 7fd2b37fe700 1 -- 172.21.15.16:0/1795466336 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400ede0 con 0x7fd2bc0ced40 2023-06-08T04:02:09.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.203+0000 7fd2b37fe700 1 -- 172.21.15.16:0/1795466336 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b4014420 con 0x7fd2bc0ced40 2023-06-08T04:02:09.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.203+0000 7fd2b37fe700 1 -- 172.21.15.16:0/1795466336 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40147d0 con 0x7fd2bc0ced40 2023-06-08T04:02:09.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.203+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1795466336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc0cb0a0 con 0x7fd2bc0ced40 2023-06-08T04:02:09.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.203+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1795466336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc159580 con 0x7fd2bc0ced40 2023-06-08T04:02:09.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.204+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1795466336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc0cb5c0 con 0x7fd2bc0ced40 2023-06-08T04:02:09.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.205+0000 7fd2b37fe700 1 -- 172.21.15.16:0/1795466336 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd2b4014930 con 0x7fd2bc0ced40 2023-06-08T04:02:09.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.206+0000 7fd2b37fe700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd29c06ad10 0x7fd29c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.206+0000 7fd2b37fe700 1 -- 172.21.15.16:0/1795466336 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2b4089cd0 con 0x7fd2bc0ced40 2023-06-08T04:02:09.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.207+0000 7fd2baffd700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd29c06ad10 0x7fd29c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.207+0000 7fd2baffd700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd29c06ad10 0x7fd29c06d1c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009130 tx=0x7fd2ac008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:09.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.211+0000 7fd2b37fe700 1 -- 172.21.15.16:0/1795466336 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd2bc0cb5c0 con 0x7fd2bc0ced40 2023-06-08T04:02:09.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.417+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1795466336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2bc0740e0 con 0x7fd2bc0ced40 2023-06-08T04:02:09.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.418+0000 7fd2b37fe700 1 -- 172.21.15.16:0/1795466336 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7fd2b40586e0 con 0x7fd2bc0ced40 2023-06-08T04:02:09.422 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:09.422 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:09.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.420+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd29c06ad10 msgr2=0x7fd29c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:09.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.420+0000 7fd2c17ff700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd29c06ad10 0x7fd29c06d1c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009130 tx=0x7fd2ac008030 comp rx=0 tx=0).stop 2023-06-08T04:02:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.420+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1795466336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 msgr2=0x7fd2bc0b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.420+0000 7fd2c17ff700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b6be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4007e30 tx=0x7fd2b400e3c0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.420+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1795466336 shutdown_connections 2023-06-08T04:02:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.420+0000 7fd2c17ff700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd29c06ad10 0x7fd29c06d1c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.420+0000 7fd2c17ff700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2bc0ced40 0x7fd2bc0b6be0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.420+0000 7fd2c17ff700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd2bc0b4d20 0x7fd2bc1587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.420+0000 7fd2c17ff700 1 --2- 172.21.15.16:0/1795466336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd2bc0b83f0 0x7fd2bc0b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.420+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1795466336 >> 172.21.15.16:0/1795466336 conn(0x7fd2bc0cf610 msgr2=0x7fd2bc0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:09.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.421+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1795466336 shutdown_connections 2023-06-08T04:02:09.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.421+0000 7fd2c17ff700 1 -- 172.21.15.16:0/1795466336 wait complete. 2023-06-08T04:02:09.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:01:54.980592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:01:56.264608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:02:09.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:02:09.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.641+0000 7f9ff19ff700 1 Processor -- start 2023-06-08T04:02:09.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.641+0000 7f9ff19ff700 1 -- start start 2023-06-08T04:02:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.642+0000 7f9ff19ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9fec160a60 0x7f9fec0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.642+0000 7f9ff19ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9fec0b4b50 0x7f9fec0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.642+0000 7f9ff19ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec0d0800 con 0x7f9fec0b83f0 2023-06-08T04:02:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.642+0000 7f9ff19ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec160ed0 con 0x7f9fec160a60 2023-06-08T04:02:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.642+0000 7f9ff19ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec0b4fd0 con 0x7f9fec0b4b50 2023-06-08T04:02:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.642+0000 7f9fe3fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9fec160a60 0x7f9fec0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.642+0000 7f9feaffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9fec0b83f0 0x7f9fec0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51634/0 (socket says 172.21.15.16:51634) 2023-06-08T04:02:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.642+0000 7f9fe3fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9fec160a60 0x7f9fec0b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42368/0 (socket says 172.21.15.16:42368) 2023-06-08T04:02:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.642+0000 7f9feaffd700 1 -- 172.21.15.16:0/3143849869 learned_addr learned my addr 172.21.15.16:0/3143849869 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:09.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.643+0000 7f9feb7fe700 1 --2- 172.21.15.16:0/3143849869 >> v2:172.21.15.169:3300/0 conn(0x7f9fec0b4b50 0x7f9fec0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.643+0000 7f9fe3fff700 1 -- 172.21.15.16:0/3143849869 >> v2:172.21.15.169:3300/0 conn(0x7f9fec0b4b50 msgr2=0x7f9fec0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.643+0000 7f9fe3fff700 1 --2- 172.21.15.16:0/3143849869 >> v2:172.21.15.169:3300/0 conn(0x7f9fec0b4b50 0x7f9fec0d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.643+0000 7f9fe3fff700 1 -- 172.21.15.16:0/3143849869 >> v1:172.21.15.16:6789/0 conn(0x7f9fec0b83f0 legacy=0x7f9fec0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.643+0000 7f9fe3fff700 1 -- 172.21.15.16:0/3143849869 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0cd1e0 con 0x7f9fec160a60 2023-06-08T04:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.643+0000 7f9fea7fc700 1 -- 172.21.15.16:0/3143849869 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706320021 0 0) 0x7f9fec0d0800 con 0x7f9fec0b83f0 2023-06-08T04:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.643+0000 7f9fe3fff700 1 --2- 172.21.15.16:0/3143849869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fec160a60 0x7f9fec0b4610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0b2590 tx=0x7f9fd4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3317ce7cf38c5ed7 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:09.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.643+0000 7f9fea7fc700 1 -- 172.21.15.16:0/3143849869 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4011830 con 0x7f9fec160a60 2023-06-08T04:02:09.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.643+0000 7f9fea7fc700 1 -- 172.21.15.16:0/3143849869 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd4011990 con 0x7f9fec160a60 2023-06-08T04:02:09.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.643+0000 7f9fea7fc700 1 -- 172.21.15.16:0/3143849869 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4011d20 con 0x7f9fec160a60 2023-06-08T04:02:09.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.644+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3143849869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fec160a60 msgr2=0x7f9fec0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:09.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.644+0000 7f9ff19ff700 1 --2- 172.21.15.16:0/3143849869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fec160a60 0x7f9fec0b4610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0b2590 tx=0x7f9fd4009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:09.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.644+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3143849869 shutdown_connections 2023-06-08T04:02:09.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.644+0000 7f9ff19ff700 1 --2- 172.21.15.16:0/3143849869 >> v2:172.21.15.169:3300/0 conn(0x7f9fec0b4b50 0x7f9fec0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.644+0000 7f9ff19ff700 1 --2- 172.21.15.16:0/3143849869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fec160a60 0x7f9fec0b4610 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.644+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3143849869 >> 172.21.15.16:0/3143849869 conn(0x7f9fec0cf610 msgr2=0x7f9fec0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:09.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.644+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3143849869 shutdown_connections 2023-06-08T04:02:09.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.644+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3143849869 wait complete. 2023-06-08T04:02:09.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.646+0000 7f9ff19ff700 1 Processor -- start 2023-06-08T04:02:09.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.646+0000 7f9ff19ff700 1 -- start start 2023-06-08T04:02:09.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.647+0000 7f9ff19ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fec0b4b50 0x7f9fec0d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.647+0000 7f9ff19ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fec0b83f0 0x7f9fec0d1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.647+0000 7f9ff19ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9fec160a60 0x7f9fec153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.647+0000 7f9ff19ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec15f3c0 con 0x7f9fec0b4b50 2023-06-08T04:02:09.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.647+0000 7f9ff19ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec15e740 con 0x7f9fec0b83f0 2023-06-08T04:02:09.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.647+0000 7f9ff19ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec15ea20 con 0x7f9fec160a60 2023-06-08T04:02:09.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.647+0000 7f9feaffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fec0b4b50 0x7f9fec0d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.647+0000 7f9feaffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fec0b4b50 0x7f9fec0d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42378/0 (socket says 172.21.15.16:42378) 2023-06-08T04:02:09.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.647+0000 7f9feaffd700 1 -- 172.21.15.16:0/3337686831 learned_addr learned my addr 172.21.15.16:0/3337686831 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:09.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.647+0000 7f9fe3fff700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fec0b83f0 0x7f9fec0d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.647+0000 7f9feb7fe700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9fec160a60 0x7f9fec153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.648+0000 7f9feaffd700 1 -- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9fec160a60 msgr2=0x7f9fec153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:09.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.648+0000 7f9feaffd700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9fec160a60 0x7f9fec153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.648+0000 7f9feaffd700 1 -- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fec0b83f0 msgr2=0x7f9fec0d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:09.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.648+0000 7f9feaffd700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fec0b83f0 0x7f9fec0d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.648+0000 7f9feaffd700 1 -- 172.21.15.16:0/3337686831 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd40094a0 con 0x7f9fec0b4b50 2023-06-08T04:02:09.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.648+0000 7f9feaffd700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fec0b4b50 0x7f9fec0d0e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0011e0 tx=0x7f9fdc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:09.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.648+0000 7f9fe8ff9700 1 -- 172.21.15.16:0/3337686831 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc004c80 con 0x7f9fec0b4b50 2023-06-08T04:02:09.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.648+0000 7f9fe8ff9700 1 -- 172.21.15.16:0/3337686831 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc004de0 con 0x7f9fec0b4b50 2023-06-08T04:02:09.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.648+0000 7f9fe8ff9700 1 -- 172.21.15.16:0/3337686831 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc007310 con 0x7f9fec0b4b50 2023-06-08T04:02:09.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.648+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3337686831 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec15ed00 con 0x7f9fec0b4b50 2023-06-08T04:02:09.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.648+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3337686831 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec15f7e0 con 0x7f9fec0b4b50 2023-06-08T04:02:09.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.649+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3337686831 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec0740e0 con 0x7f9fec0b4b50 2023-06-08T04:02:09.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.651+0000 7f9fe8ff9700 1 -- 172.21.15.16:0/3337686831 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9fdc007470 con 0x7f9fec0b4b50 2023-06-08T04:02:09.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.651+0000 7f9fe8ff9700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9fcc06ace0 0x7f9fcc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:09.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.651+0000 7f9fe8ff9700 1 -- 172.21.15.16:0/3337686831 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9fdc089110 con 0x7f9fec0b4b50 2023-06-08T04:02:09.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.652+0000 7f9fe3fff700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9fcc06ace0 0x7f9fcc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:09.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.652+0000 7f9fe3fff700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9fcc06ace0 0x7f9fcc06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40090b0 tx=0x7f9fd401c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:09.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.656+0000 7f9fe8ff9700 1 -- 172.21.15.16:0/3337686831 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9fdc054250 con 0x7f9fec0b4b50 2023-06-08T04:02:09.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.862+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3337686831 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9fec06c2f0 con 0x7f9fec0b4b50 2023-06-08T04:02:09.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.862+0000 7f9fe8ff9700 1 -- 172.21.15.16:0/3337686831 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9fdc057870 con 0x7f9fec0b4b50 2023-06-08T04:02:09.866 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:02:09.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.864+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9fcc06ace0 msgr2=0x7f9fcc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:09.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.865+0000 7f9ff19ff700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9fcc06ace0 0x7f9fcc06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fd40090b0 tx=0x7f9fd401c040 comp rx=0 tx=0).stop 2023-06-08T04:02:09.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.865+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3337686831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fec0b4b50 msgr2=0x7f9fec0d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:09.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.865+0000 7f9ff19ff700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fec0b4b50 0x7f9fec0d0e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0011e0 tx=0x7f9fdc00ca30 comp rx=0 tx=0).stop 2023-06-08T04:02:09.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.865+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3337686831 shutdown_connections 2023-06-08T04:02:09.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.865+0000 7f9ff19ff700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9fcc06ace0 0x7f9fcc06d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.865+0000 7f9ff19ff700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9fec160a60 0x7f9fec153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.865+0000 7f9ff19ff700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fec0b4b50 0x7f9fec0d0e10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.865+0000 7f9ff19ff700 1 --2- 172.21.15.16:0/3337686831 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fec0b83f0 0x7f9fec0d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:09.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.865+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3337686831 >> 172.21.15.16:0/3337686831 conn(0x7f9fec0cf610 msgr2=0x7f9fec073280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:09.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.865+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3337686831 shutdown_connections 2023-06-08T04:02:09.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:09.865+0000 7f9ff19ff700 1 -- 172.21.15.16:0/3337686831 wait complete. 2023-06-08T04:02:09.886 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:02:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.085+0000 7f453bdff700 1 Processor -- start 2023-06-08T04:02:10.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.085+0000 7f453bdff700 1 -- start start 2023-06-08T04:02:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.086+0000 7f453bdff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4534160a60 0x7f45340b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.086+0000 7f453bdff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45340b4b50 0x7f45340d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.086+0000 7f453bdff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340d0800 con 0x7f45340b83f0 2023-06-08T04:02:10.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.086+0000 7f453bdff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4534160ed0 con 0x7f4534160a60 2023-06-08T04:02:10.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.086+0000 7f453bdff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45340b4fd0 con 0x7f45340b4b50 2023-06-08T04:02:10.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.087+0000 7f4539b9b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f45340b83f0 0x7f45340ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51646/0 (socket says 172.21.15.16:51646) 2023-06-08T04:02:10.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.087+0000 7f4539b9b700 1 -- 172.21.15.16:0/3910118789 learned_addr learned my addr 172.21.15.16:0/3910118789 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:10.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.087+0000 7f453a39c700 1 --2- 172.21.15.16:0/3910118789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45340b4b50 0x7f45340d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.087+0000 7f453939a700 1 --2- 172.21.15.16:0/3910118789 >> v2:172.21.15.169:3300/0 conn(0x7f4534160a60 0x7f45340b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.087+0000 7f4538b99700 1 -- 172.21.15.16:0/3910118789 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591784932 0 0) 0x7f45340d0800 con 0x7f45340b83f0 2023-06-08T04:02:10.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.087+0000 7f4538b99700 1 -- 172.21.15.16:0/3910118789 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45200035b0 con 0x7f45340b83f0 2023-06-08T04:02:10.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.087+0000 7f453a39c700 1 -- 172.21.15.16:0/3910118789 >> v2:172.21.15.169:3300/0 conn(0x7f4534160a60 msgr2=0x7f45340b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:10.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.087+0000 7f453a39c700 1 --2- 172.21.15.16:0/3910118789 >> v2:172.21.15.169:3300/0 conn(0x7f4534160a60 0x7f45340b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.087+0000 7f453a39c700 1 -- 172.21.15.16:0/3910118789 >> v1:172.21.15.16:6789/0 conn(0x7f45340b83f0 legacy=0x7f45340ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.087+0000 7f4538b99700 1 -- 172.21.15.16:0/3910118789 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 42720123 0 0) 0x7f45200035b0 con 0x7f45340b83f0 2023-06-08T04:02:10.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.087+0000 7f453a39c700 1 -- 172.21.15.16:0/3910118789 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45340cd1e0 con 0x7f45340b4b50 2023-06-08T04:02:10.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.088+0000 7f453a39c700 1 --2- 172.21.15.16:0/3910118789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45340b4b50 0x7f45340d0fc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f452c009d90 tx=0x7f452c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a25b8789c67e37 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:10.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.088+0000 7f4538b99700 1 -- 172.21.15.16:0/3910118789 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c00e070 con 0x7f45340b4b50 2023-06-08T04:02:10.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.088+0000 7f4538b99700 1 -- 172.21.15.16:0/3910118789 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c003a20 con 0x7f45340b4b50 2023-06-08T04:02:10.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.088+0000 7f4538b99700 1 -- 172.21.15.16:0/3910118789 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530001670 con 0x7f45340b4b50 2023-06-08T04:02:10.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.088+0000 7f453bdff700 1 -- 172.21.15.16:0/3910118789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45340b4b50 msgr2=0x7f45340d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.088+0000 7f453bdff700 1 --2- 172.21.15.16:0/3910118789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45340b4b50 0x7f45340d0fc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f452c009d90 tx=0x7f452c00b330 comp rx=0 tx=0).stop 2023-06-08T04:02:10.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.089+0000 7f453bdff700 1 -- 172.21.15.16:0/3910118789 shutdown_connections 2023-06-08T04:02:10.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.089+0000 7f453bdff700 1 --2- 172.21.15.16:0/3910118789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45340b4b50 0x7f45340d0fc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.089+0000 7f453bdff700 1 --2- 172.21.15.16:0/3910118789 >> v2:172.21.15.169:3300/0 conn(0x7f4534160a60 0x7f45340b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.089+0000 7f453bdff700 1 -- 172.21.15.16:0/3910118789 >> 172.21.15.16:0/3910118789 conn(0x7f45340cf610 msgr2=0x7f45340cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:10.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.089+0000 7f453bdff700 1 -- 172.21.15.16:0/3910118789 shutdown_connections 2023-06-08T04:02:10.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.089+0000 7f453bdff700 1 -- 172.21.15.16:0/3910118789 wait complete. 2023-06-08T04:02:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.090+0000 7f453bdff700 1 Processor -- start 2023-06-08T04:02:10.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.091+0000 7f453bdff700 1 -- start start 2023-06-08T04:02:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.091+0000 7f453bdff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45340b4b50 0x7f45340cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453bdff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45340b83f0 0x7f453415d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453bdff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4534160a60 0x7f453415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453bdff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45341549b0 con 0x7f4534160a60 2023-06-08T04:02:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453bdff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45340cb120 con 0x7f45340b4b50 2023-06-08T04:02:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453bdff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45340cb3c0 con 0x7f45340b83f0 2023-06-08T04:02:10.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453a39c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4534160a60 0x7f453415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453a39c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4534160a60 0x7f453415dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42390/0 (socket says 172.21.15.16:42390) 2023-06-08T04:02:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453a39c700 1 -- 172.21.15.16:0/153630134 learned_addr learned my addr 172.21.15.16:0/153630134 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453939a700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45340b83f0 0x7f453415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f4539b9b700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45340b4b50 0x7f45340cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453a39c700 1 -- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45340b83f0 msgr2=0x7f453415d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453a39c700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45340b83f0 0x7f453415d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453a39c700 1 -- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45340b4b50 msgr2=0x7f45340cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453a39c700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45340b4b50 0x7f45340cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f453a39c700 1 -- 172.21.15.16:0/153630134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c009a70 con 0x7f4534160a60 2023-06-08T04:02:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.092+0000 7f4539b9b700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45340b4b50 0x7f45340cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.093+0000 7f453a39c700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4534160a60 0x7f453415dc90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f45340b5110 tx=0x7f452c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.093+0000 7f452a7fc700 1 -- 172.21.15.16:0/153630134 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c009410 con 0x7f4534160a60 2023-06-08T04:02:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.093+0000 7f452a7fc700 1 -- 172.21.15.16:0/153630134 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c0044e0 con 0x7f4534160a60 2023-06-08T04:02:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.093+0000 7f453bdff700 1 -- 172.21.15.16:0/153630134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45340cb910 con 0x7f4534160a60 2023-06-08T04:02:10.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.093+0000 7f452a7fc700 1 -- 172.21.15.16:0/153630134 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c004890 con 0x7f4534160a60 2023-06-08T04:02:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.093+0000 7f453bdff700 1 -- 172.21.15.16:0/153630134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45340cbed0 con 0x7f4534160a60 2023-06-08T04:02:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.094+0000 7f453bdff700 1 -- 172.21.15.16:0/153630134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45340cc060 con 0x7f4534160a60 2023-06-08T04:02:10.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.095+0000 7f452a7fc700 1 -- 172.21.15.16:0/153630134 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f452c012430 con 0x7f4534160a60 2023-06-08T04:02:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.096+0000 7f452a7fc700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f451806ace0 0x7f451806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.096+0000 7f452a7fc700 1 -- 172.21.15.16:0/153630134 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f452c08b070 con 0x7f4534160a60 2023-06-08T04:02:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.096+0000 7f4539b9b700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f451806ace0 0x7f451806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.097+0000 7f4539b9b700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f451806ace0 0x7f451806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4530001860 tx=0x7f45300015f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:10.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.100+0000 7f452a7fc700 1 -- 172.21.15.16:0/153630134 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f452c0bd310 con 0x7f4534160a60 2023-06-08T04:02:10.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.304+0000 7f453bdff700 1 -- 172.21.15.16:0/153630134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45340740e0 con 0x7f4534160a60 2023-06-08T04:02:10.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.305+0000 7f452a7fc700 1 -- 172.21.15.16:0/153630134 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f452c02a0a0 con 0x7f4534160a60 2023-06-08T04:02:10.309 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:02:10.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 -- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f451806ace0 msgr2=0x7f451806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f451806ace0 0x7f451806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4530001860 tx=0x7f45300015f0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 -- 172.21.15.16:0/153630134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4534160a60 msgr2=0x7f453415dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4534160a60 0x7f453415dc90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f45340b5110 tx=0x7f452c004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 -- 172.21.15.16:0/153630134 shutdown_connections 2023-06-08T04:02:10.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f451806ace0 0x7f451806d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4534160a60 0x7f453415dc90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45340b4b50 0x7f45340cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 --2- 172.21.15.16:0/153630134 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45340b83f0 0x7f453415d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 -- 172.21.15.16:0/153630134 >> 172.21.15.16:0/153630134 conn(0x7f45340cf610 msgr2=0x7f453415c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:10.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 -- 172.21.15.16:0/153630134 shutdown_connections 2023-06-08T04:02:10.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.307+0000 7f453bdff700 1 -- 172.21.15.16:0/153630134 wait complete. 2023-06-08T04:02:10.328 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:02:10.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.527+0000 7ffa48dff700 1 Processor -- start 2023-06-08T04:02:10.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.528+0000 7ffa48dff700 1 -- start start 2023-06-08T04:02:10.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa48dff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffa44160a60 0x7ffa440b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa48dff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa440b4b50 0x7ffa440d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa48dff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa440d0800 con 0x7ffa440b83f0 2023-06-08T04:02:10.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa48dff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa44160ed0 con 0x7ffa440b4b50 2023-06-08T04:02:10.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa48dff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa440b4fd0 con 0x7ffa44160a60 2023-06-08T04:02:10.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa42d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa440b4b50 0x7ffa440d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa42d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa440b4b50 0x7ffa440d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42400/0 (socket says 172.21.15.16:42400) 2023-06-08T04:02:10.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa42d9d700 1 -- 172.21.15.16:0/368471772 learned_addr learned my addr 172.21.15.16:0/368471772 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:10.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa3bfff700 1 --2- 172.21.15.16:0/368471772 >> v2:172.21.15.169:3300/0 conn(0x7ffa44160a60 0x7ffa440b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa42d9d700 1 -- 172.21.15.16:0/368471772 >> v2:172.21.15.169:3300/0 conn(0x7ffa44160a60 msgr2=0x7ffa440b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:10.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa42d9d700 1 --2- 172.21.15.16:0/368471772 >> v2:172.21.15.169:3300/0 conn(0x7ffa44160a60 0x7ffa440b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa42d9d700 1 -- 172.21.15.16:0/368471772 >> v1:172.21.15.169:6789/0 conn(0x7ffa440b83f0 legacy=0x7ffa440ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.529+0000 7ffa42d9d700 1 -- 172.21.15.16:0/368471772 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa440cd1e0 con 0x7ffa440b4b50 2023-06-08T04:02:10.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.530+0000 7ffa42d9d700 1 --2- 172.21.15.16:0/368471772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa440b4b50 0x7ffa440d0fc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa4406c4e0 tx=0x7ffa3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b7083a841eaa63 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:10.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.530+0000 7ffa41d9b700 1 -- 172.21.15.16:0/368471772 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c00e070 con 0x7ffa440b4b50 2023-06-08T04:02:10.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.530+0000 7ffa41d9b700 1 -- 172.21.15.16:0/368471772 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c00b910 con 0x7ffa440b4b50 2023-06-08T04:02:10.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.530+0000 7ffa41d9b700 1 -- 172.21.15.16:0/368471772 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c00bcc0 con 0x7ffa440b4b50 2023-06-08T04:02:10.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.530+0000 7ffa48dff700 1 -- 172.21.15.16:0/368471772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa440b4b50 msgr2=0x7ffa440d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.530+0000 7ffa48dff700 1 --2- 172.21.15.16:0/368471772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa440b4b50 0x7ffa440d0fc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa4406c4e0 tx=0x7ffa3c00b330 comp rx=0 tx=0).stop 2023-06-08T04:02:10.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.531+0000 7ffa48dff700 1 -- 172.21.15.16:0/368471772 shutdown_connections 2023-06-08T04:02:10.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.531+0000 7ffa48dff700 1 --2- 172.21.15.16:0/368471772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa440b4b50 0x7ffa440d0fc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.531+0000 7ffa48dff700 1 --2- 172.21.15.16:0/368471772 >> v2:172.21.15.169:3300/0 conn(0x7ffa44160a60 0x7ffa440b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.531+0000 7ffa48dff700 1 -- 172.21.15.16:0/368471772 >> 172.21.15.16:0/368471772 conn(0x7ffa440cf610 msgr2=0x7ffa440cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:10.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.531+0000 7ffa48dff700 1 -- 172.21.15.16:0/368471772 shutdown_connections 2023-06-08T04:02:10.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.531+0000 7ffa48dff700 1 -- 172.21.15.16:0/368471772 wait complete. 2023-06-08T04:02:10.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.532+0000 7ffa48dff700 1 Processor -- start 2023-06-08T04:02:10.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.533+0000 7ffa48dff700 1 -- start start 2023-06-08T04:02:10.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.533+0000 7ffa48dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa440b4b50 0x7ffa44154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.533+0000 7ffa48dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa440b83f0 0x7ffa441593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.533+0000 7ffa48dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa44160a60 0x7ffa441598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.533+0000 7ffa48dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4415f5c0 con 0x7ffa440b4b50 2023-06-08T04:02:10.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.533+0000 7ffa48dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4415e6d0 con 0x7ffa44160a60 2023-06-08T04:02:10.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.533+0000 7ffa48dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4415e9b0 con 0x7ffa440b83f0 2023-06-08T04:02:10.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa4259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa440b4b50 0x7ffa44154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa4259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa440b4b50 0x7ffa44154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42412/0 (socket says 172.21.15.16:42412) 2023-06-08T04:02:10.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa4259c700 1 -- 172.21.15.16:0/384325787 learned_addr learned my addr 172.21.15.16:0/384325787 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:10.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa3bfff700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa440b83f0 0x7ffa441593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa42d9d700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa44160a60 0x7ffa441598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa4259c700 1 -- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa440b83f0 msgr2=0x7ffa441593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa4259c700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa440b83f0 0x7ffa441593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa4259c700 1 -- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa44160a60 msgr2=0x7ffa441598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa4259c700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa44160a60 0x7ffa441598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa4259c700 1 -- 172.21.15.16:0/384325787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c009b30 con 0x7ffa440b4b50 2023-06-08T04:02:10.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa42d9d700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa44160a60 0x7ffa441598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:10.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.534+0000 7ffa4259c700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa440b4b50 0x7ffa44154460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400c4e0 tx=0x7ffa3400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:10.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.535+0000 7ffa3affd700 1 -- 172.21.15.16:0/384325787 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa340052d0 con 0x7ffa440b4b50 2023-06-08T04:02:10.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.535+0000 7ffa3affd700 1 -- 172.21.15.16:0/384325787 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa34005430 con 0x7ffa440b4b50 2023-06-08T04:02:10.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.535+0000 7ffa48dff700 1 -- 172.21.15.16:0/384325787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4415ec90 con 0x7ffa440b4b50 2023-06-08T04:02:10.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.535+0000 7ffa3affd700 1 -- 172.21.15.16:0/384325787 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa340038c0 con 0x7ffa440b4b50 2023-06-08T04:02:10.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.535+0000 7ffa48dff700 1 -- 172.21.15.16:0/384325787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4415f250 con 0x7ffa440b4b50 2023-06-08T04:02:10.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.536+0000 7ffa48dff700 1 -- 172.21.15.16:0/384325787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa440740e0 con 0x7ffa440b4b50 2023-06-08T04:02:10.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.537+0000 7ffa3affd700 1 -- 172.21.15.16:0/384325787 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa34003a20 con 0x7ffa440b4b50 2023-06-08T04:02:10.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.537+0000 7ffa3affd700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa2406ace0 0x7ffa2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.538+0000 7ffa3affd700 1 -- 172.21.15.16:0/384325787 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa34088a00 con 0x7ffa440b4b50 2023-06-08T04:02:10.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.538+0000 7ffa3bfff700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa2406ace0 0x7ffa2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.539+0000 7ffa3bfff700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa2406ace0 0x7ffa2406d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa441f54a0 tx=0x7ffa2c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:10.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.542+0000 7ffa3affd700 1 -- 172.21.15.16:0/384325787 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffa34053a10 con 0x7ffa440b4b50 2023-06-08T04:02:10.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.745+0000 7ffa48dff700 1 -- 172.21.15.16:0/384325787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa4406bf20 con 0x7ffa440b4b50 2023-06-08T04:02:10.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.745+0000 7ffa3affd700 1 -- 172.21.15.16:0/384325787 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa34057030 con 0x7ffa440b4b50 2023-06-08T04:02:10.749 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:02:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.747+0000 7ffa48dff700 1 -- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa2406ace0 msgr2=0x7ffa2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.747+0000 7ffa48dff700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa2406ace0 0x7ffa2406d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffa441f54a0 tx=0x7ffa2c008040 comp rx=0 tx=0).stop 2023-06-08T04:02:10.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.747+0000 7ffa48dff700 1 -- 172.21.15.16:0/384325787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa440b4b50 msgr2=0x7ffa44154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.747+0000 7ffa48dff700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa440b4b50 0x7ffa44154460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400c4e0 tx=0x7ffa3400c8a0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.747+0000 7ffa48dff700 1 -- 172.21.15.16:0/384325787 shutdown_connections 2023-06-08T04:02:10.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.747+0000 7ffa48dff700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa2406ace0 0x7ffa2406d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.747+0000 7ffa48dff700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa44160a60 0x7ffa441598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.747+0000 7ffa48dff700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa440b4b50 0x7ffa44154460 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.747+0000 7ffa48dff700 1 --2- 172.21.15.16:0/384325787 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa440b83f0 0x7ffa441593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.747+0000 7ffa48dff700 1 -- 172.21.15.16:0/384325787 >> 172.21.15.16:0/384325787 conn(0x7ffa440cf610 msgr2=0x7ffa440d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:10.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.748+0000 7ffa48dff700 1 -- 172.21.15.16:0/384325787 shutdown_connections 2023-06-08T04:02:10.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.748+0000 7ffa48dff700 1 -- 172.21.15.16:0/384325787 wait complete. 2023-06-08T04:02:10.769 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:02:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.968+0000 7f07dcbff700 1 Processor -- start 2023-06-08T04:02:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.968+0000 7f07dcbff700 1 -- start start 2023-06-08T04:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.969+0000 7f07dcbff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07d80b83f0 0x7f07d8160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.969+0000 7f07dcbff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f07d80ced40 0x7f07d80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.969+0000 7f07dcbff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f07d80b4b50 0x7f07d806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.969+0000 7f07dcbff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d80b4fd0 con 0x7f07d80ced40 2023-06-08T04:02:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.969+0000 7f07dcbff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d80d0800 con 0x7f07d80b4b50 2023-06-08T04:02:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.969+0000 7f07dcbff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d80cd1e0 con 0x7f07d80b83f0 2023-06-08T04:02:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d5d9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f07d80ced40 0x7f07d80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d5d9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f07d80ced40 0x7f07d80b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42420/0 (socket says 172.21.15.16:42420) 2023-06-08T04:02:10.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d5d9b700 1 -- 172.21.15.16:0/2602503220 learned_addr learned my addr 172.21.15.16:0/2602503220 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:10.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d659c700 1 --2- 172.21.15.16:0/2602503220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07d80b83f0 0x7f07d8160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d6d9d700 1 --2- 172.21.15.16:0/2602503220 >> v2:172.21.15.169:3300/0 conn(0x7f07d80b4b50 0x7f07d806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d5d9b700 1 -- 172.21.15.16:0/2602503220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07d80b83f0 msgr2=0x7f07d8160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:10.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d5d9b700 1 --2- 172.21.15.16:0/2602503220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07d80b83f0 0x7f07d8160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d5d9b700 1 -- 172.21.15.16:0/2602503220 >> v2:172.21.15.169:3300/0 conn(0x7f07d80b4b50 msgr2=0x7f07d806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:10.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d5d9b700 1 --2- 172.21.15.16:0/2602503220 >> v2:172.21.15.169:3300/0 conn(0x7f07d80b4b50 0x7f07d806b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d5d9b700 1 -- 172.21.15.16:0/2602503220 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d80cd4c0 con 0x7f07d80ced40 2023-06-08T04:02:10.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d659c700 1 --2- 172.21.15.16:0/2602503220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07d80b83f0 0x7f07d8160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:10.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.970+0000 7f07d5d9b700 1 --2- 172.21.15.16:0/2602503220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07d80ced40 0x7f07d80b4610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f07d8073cb0 tx=0x7f07cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a63070cad64c33 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:10.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07d559a700 1 -- 172.21.15.16:0/2602503220 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00b870 con 0x7f07d80ced40 2023-06-08T04:02:10.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07d559a700 1 -- 172.21.15.16:0/2602503220 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07cc00b9d0 con 0x7f07d80ced40 2023-06-08T04:02:10.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07d559a700 1 -- 172.21.15.16:0/2602503220 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00bd60 con 0x7f07d80ced40 2023-06-08T04:02:10.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07dcbff700 1 -- 172.21.15.16:0/2602503220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07d80ced40 msgr2=0x7f07d80b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07dcbff700 1 --2- 172.21.15.16:0/2602503220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07d80ced40 0x7f07d80b4610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f07d8073cb0 tx=0x7f07cc009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07dcbff700 1 -- 172.21.15.16:0/2602503220 shutdown_connections 2023-06-08T04:02:10.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07dcbff700 1 --2- 172.21.15.16:0/2602503220 >> v2:172.21.15.169:3300/0 conn(0x7f07d80b4b50 0x7f07d806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07dcbff700 1 --2- 172.21.15.16:0/2602503220 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07d80b83f0 0x7f07d8160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07dcbff700 1 --2- 172.21.15.16:0/2602503220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07d80ced40 0x7f07d80b4610 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07dcbff700 1 -- 172.21.15.16:0/2602503220 >> 172.21.15.16:0/2602503220 conn(0x7f07d80cf610 msgr2=0x7f07d80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:10.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07dcbff700 1 -- 172.21.15.16:0/2602503220 shutdown_connections 2023-06-08T04:02:10.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.971+0000 7f07dcbff700 1 -- 172.21.15.16:0/2602503220 wait complete. 2023-06-08T04:02:10.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.973+0000 7f07dcbff700 1 Processor -- start 2023-06-08T04:02:10.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.973+0000 7f07dcbff700 1 -- start start 2023-06-08T04:02:10.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.974+0000 7f07dcbff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07d80b4b50 0x7f07d8153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.974+0000 7f07dcbff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07d80b83f0 0x7f07d80b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.974+0000 7f07dcbff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07d80ced40 0x7f07d80b6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.974+0000 7f07dcbff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d8153c50 con 0x7f07d80b4b50 2023-06-08T04:02:10.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.974+0000 7f07dcbff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d81f5fd0 con 0x7f07d80b83f0 2023-06-08T04:02:10.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.974+0000 7f07dcbff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d80cc200 con 0x7f07d80ced40 2023-06-08T04:02:10.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.974+0000 7f07d659c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07d80b4b50 0x7f07d8153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.974+0000 7f07d659c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07d80b4b50 0x7f07d8153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42430/0 (socket says 172.21.15.16:42430) 2023-06-08T04:02:10.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.974+0000 7f07d659c700 1 -- 172.21.15.16:0/3854508696 learned_addr learned my addr 172.21.15.16:0/3854508696 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:10.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07d5d9b700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07d80b83f0 0x7f07d80b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07d6d9d700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07d80ced40 0x7f07d80b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07d659c700 1 -- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07d80ced40 msgr2=0x7f07d80b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07d659c700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07d80ced40 0x7f07d80b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07d659c700 1 -- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07d80b83f0 msgr2=0x7f07d80b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:10.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07d659c700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07d80b83f0 0x7f07d80b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:10.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07d659c700 1 -- 172.21.15.16:0/3854508696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc009550 con 0x7f07d80b4b50 2023-06-08T04:02:10.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07d659c700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07d80b4b50 0x7f07d8153710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07c800e810 tx=0x7f07c800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:10.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07c6ffd700 1 -- 172.21.15.16:0/3854508696 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c8004230 con 0x7f07d80b4b50 2023-06-08T04:02:10.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07c6ffd700 1 -- 172.21.15.16:0/3854508696 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c80043b0 con 0x7f07d80b4b50 2023-06-08T04:02:10.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07dcbff700 1 -- 172.21.15.16:0/3854508696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d80cc4e0 con 0x7f07d80b4b50 2023-06-08T04:02:10.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07c6ffd700 1 -- 172.21.15.16:0/3854508696 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c80038e0 con 0x7f07d80b4b50 2023-06-08T04:02:10.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.975+0000 7f07dcbff700 1 -- 172.21.15.16:0/3854508696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d80cbef0 con 0x7f07d80b4b50 2023-06-08T04:02:10.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.976+0000 7f07dcbff700 1 -- 172.21.15.16:0/3854508696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d80740e0 con 0x7f07d80b4b50 2023-06-08T04:02:10.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.977+0000 7f07c6ffd700 1 -- 172.21.15.16:0/3854508696 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f07c8003a40 con 0x7f07d80b4b50 2023-06-08T04:02:10.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.978+0000 7f07c6ffd700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f07b806ace0 0x7f07b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:10.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.978+0000 7f07c6ffd700 1 -- 172.21.15.16:0/3854508696 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07c8088ef0 con 0x7f07d80b4b50 2023-06-08T04:02:10.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.979+0000 7f07d5d9b700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f07b806ace0 0x7f07b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:10.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.980+0000 7f07d5d9b700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f07b806ace0 0x7f07b806d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07cc014040 tx=0x7f07cc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:10.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:10.982+0000 7f07c6ffd700 1 -- 172.21.15.16:0/3854508696 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f07c8057a20 con 0x7f07d80b4b50 2023-06-08T04:02:11.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.189+0000 7f07dcbff700 1 -- 172.21.15.16:0/3854508696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07d815b6c0 con 0x7f07d80b4b50 2023-06-08T04:02:11.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.190+0000 7f07c6ffd700 1 -- 172.21.15.16:0/3854508696 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07c80094c0 con 0x7f07d80b4b50 2023-06-08T04:02:11.194 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:02:11.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 -- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f07b806ace0 msgr2=0x7f07b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f07b806ace0 0x7f07b806d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f07cc014040 tx=0x7f07cc008030 comp rx=0 tx=0).stop 2023-06-08T04:02:11.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 -- 172.21.15.16:0/3854508696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07d80b4b50 msgr2=0x7f07d8153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07d80b4b50 0x7f07d8153710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07c800e810 tx=0x7f07c800eb20 comp rx=0 tx=0).stop 2023-06-08T04:02:11.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 -- 172.21.15.16:0/3854508696 shutdown_connections 2023-06-08T04:02:11.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f07b806ace0 0x7f07b806d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07d80ced40 0x7f07d80b6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07d80b4b50 0x7f07d8153710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 --2- 172.21.15.16:0/3854508696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07d80b83f0 0x7f07d80b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 -- 172.21.15.16:0/3854508696 >> 172.21.15.16:0/3854508696 conn(0x7f07d80cf610 msgr2=0x7f07d815c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:11.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 -- 172.21.15.16:0/3854508696 shutdown_connections 2023-06-08T04:02:11.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.192+0000 7f07dcbff700 1 -- 172.21.15.16:0/3854508696 wait complete. 2023-06-08T04:02:11.213 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T04:02:11.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.410+0000 7fb9ed1ff700 1 Processor -- start 2023-06-08T04:02:11.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.410+0000 7fb9ed1ff700 1 -- start start 2023-06-08T04:02:11.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.411+0000 7fb9ed1ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9e80b83f0 0x7fb9e8160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:11.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.411+0000 7fb9ed1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9e80ced40 0x7fb9e80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:11.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.411+0000 7fb9ed1ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80d0800 con 0x7fb9e80b4b50 2023-06-08T04:02:11.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.411+0000 7fb9ed1ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e80b4fd0 con 0x7fb9e80b83f0 2023-06-08T04:02:11.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.411+0000 7fb9ed1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80cd1e0 con 0x7fb9e80ced40 2023-06-08T04:02:11.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.412+0000 7fb9e6d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9e80b83f0 0x7fb9e8160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:11.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.412+0000 7fb9e759e700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb9e80b4b50 0x7fb9e806b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51648/0 (socket says 172.21.15.16:51648) 2023-06-08T04:02:11.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.412+0000 7fb9e759e700 1 -- 172.21.15.16:0/3852940288 learned_addr learned my addr 172.21.15.16:0/3852940288 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:11.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.412+0000 7fb9e659c700 1 --2- 172.21.15.16:0/3852940288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9e80ced40 0x7fb9e80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:11.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.412+0000 7fb9e6d9d700 1 -- 172.21.15.16:0/3852940288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9e80ced40 msgr2=0x7fb9e80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:11.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.412+0000 7fb9e6d9d700 1 --2- 172.21.15.16:0/3852940288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9e80ced40 0x7fb9e80b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.412+0000 7fb9e6d9d700 1 -- 172.21.15.16:0/3852940288 >> v1:172.21.15.16:6789/0 conn(0x7fb9e80b4b50 legacy=0x7fb9e806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.412+0000 7fb9e6d9d700 1 -- 172.21.15.16:0/3852940288 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80cd4c0 con 0x7fb9e80b83f0 2023-06-08T04:02:11.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.412+0000 7fb9e5d9b700 1 -- 172.21.15.16:0/3852940288 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014445778 0 0) 0x7fb9e80d0800 con 0x7fb9e80b4b50 2023-06-08T04:02:11.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.412+0000 7fb9e6d9d700 1 --2- 172.21.15.16:0/3852940288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e80b83f0 0x7fb9e8160a60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009840 tx=0x7fb9d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d863d3eda2517b40 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:11.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.413+0000 7fb9e5d9b700 1 -- 172.21.15.16:0/3852940288 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8011830 con 0x7fb9e80b83f0 2023-06-08T04:02:11.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.413+0000 7fb9e5d9b700 1 -- 172.21.15.16:0/3852940288 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8011990 con 0x7fb9e80b83f0 2023-06-08T04:02:11.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.413+0000 7fb9e5d9b700 1 -- 172.21.15.16:0/3852940288 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8011d20 con 0x7fb9e80b83f0 2023-06-08T04:02:11.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.413+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/3852940288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e80b83f0 msgr2=0x7fb9e8160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.413+0000 7fb9ed1ff700 1 --2- 172.21.15.16:0/3852940288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e80b83f0 0x7fb9e8160a60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009840 tx=0x7fb9d8009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:11.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.413+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/3852940288 shutdown_connections 2023-06-08T04:02:11.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.413+0000 7fb9ed1ff700 1 --2- 172.21.15.16:0/3852940288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e80b83f0 0x7fb9e8160a60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.413+0000 7fb9ed1ff700 1 --2- 172.21.15.16:0/3852940288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9e80ced40 0x7fb9e80b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.413+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/3852940288 >> 172.21.15.16:0/3852940288 conn(0x7fb9e80cf610 msgr2=0x7fb9e80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:11.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.413+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/3852940288 shutdown_connections 2023-06-08T04:02:11.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.413+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/3852940288 wait complete. 2023-06-08T04:02:11.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.416+0000 7fb9ed1ff700 1 Processor -- start 2023-06-08T04:02:11.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.416+0000 7fb9ed1ff700 1 -- start start 2023-06-08T04:02:11.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.417+0000 7fb9ed1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9e80b4b50 0x7fb9e81541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:11.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.417+0000 7fb9ed1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9e80b83f0 0x7fb9e815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:11.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.417+0000 7fb9ed1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e80ced40 0x7fb9e80b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:11.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.417+0000 7fb9ed1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e815df20 con 0x7fb9e80ced40 2023-06-08T04:02:11.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.417+0000 7fb9ed1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e815d420 con 0x7fb9e80b83f0 2023-06-08T04:02:11.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.417+0000 7fb9ed1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e815d700 con 0x7fb9e80b4b50 2023-06-08T04:02:11.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.417+0000 7fb9e759e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e80ced40 0x7fb9e80b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:11.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.417+0000 7fb9e759e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e80ced40 0x7fb9e80b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42454/0 (socket says 172.21.15.16:42454) 2023-06-08T04:02:11.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.417+0000 7fb9e759e700 1 -- 172.21.15.16:0/432188537 learned_addr learned my addr 172.21.15.16:0/432188537 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:11.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9e6d9d700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9e80b4b50 0x7fb9e81541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:11.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9e659c700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9e80b83f0 0x7fb9e815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:11.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9e759e700 1 -- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9e80b4b50 msgr2=0x7fb9e81541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9e759e700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9e80b4b50 0x7fb9e81541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9e759e700 1 -- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9e80b83f0 msgr2=0x7fb9e815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9e759e700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9e80b83f0 0x7fb9e815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9e759e700 1 -- 172.21.15.16:0/432188537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80094a0 con 0x7fb9e80ced40 2023-06-08T04:02:11.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9e659c700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9e80b83f0 0x7fb9e815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:11.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9e759e700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e80ced40 0x7fb9e80b3640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0002230 tx=0x7fb9e000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:11.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9cf7fe700 1 -- 172.21.15.16:0/432188537 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000ac20 con 0x7fb9e80ced40 2023-06-08T04:02:11.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9cf7fe700 1 -- 172.21.15.16:0/432188537 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e000ada0 con 0x7fb9e80ced40 2023-06-08T04:02:11.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/432188537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e815e170 con 0x7fb9e80ced40 2023-06-08T04:02:11.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9cf7fe700 1 -- 172.21.15.16:0/432188537 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0007310 con 0x7fb9e80ced40 2023-06-08T04:02:11.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.418+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/432188537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e81546f0 con 0x7fb9e80ced40 2023-06-08T04:02:11.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.419+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/432188537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e815d8d0 con 0x7fb9e80ced40 2023-06-08T04:02:11.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.420+0000 7fb9cf7fe700 1 -- 172.21.15.16:0/432188537 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9e0007470 con 0x7fb9e80ced40 2023-06-08T04:02:11.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.421+0000 7fb9cf7fe700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9d406ace0 0x7fb9d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:11.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.421+0000 7fb9cf7fe700 1 -- 172.21.15.16:0/432188537 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9e0088ff0 con 0x7fb9e80ced40 2023-06-08T04:02:11.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.422+0000 7fb9e6d9d700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9d406ace0 0x7fb9d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:11.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.423+0000 7fb9e6d9d700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9d406ace0 0x7fb9d406d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80090b0 tx=0x7fb9d8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:11.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.426+0000 7fb9cf7fe700 1 -- 172.21.15.16:0/432188537 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb9e00540f0 con 0x7fb9e80ced40 2023-06-08T04:02:11.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.677+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/432188537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9e80740e0 con 0x7fb9e80ced40 2023-06-08T04:02:11.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.677+0000 7fb9cf7fe700 1 -- 172.21.15.16:0/432188537 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7fb9e0057710 con 0x7fb9e80ced40 2023-06-08T04:02:11.681 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:11.681 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3633702519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3633702519},{"type":"v1","addr":"172.21.15.16:6834","nonce":3633702519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/711045362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":711045362},{"type":"v1","addr":"172.21.15.169:6837","nonce":711045362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1926912680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1926912680},{"type":"v1","addr":"172.21.15.16:6835","nonce":1926912680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T04:01:57.284697+0000","modified":"2023-06-08T04:02:00.771168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6836/1286012043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1286012043},{"type":"v1","addr":"172.21.15.169:6836","nonce":1286012043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T04:02:11.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.679+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9d406ace0 msgr2=0x7fb9d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.679+0000 7fb9ed1ff700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9d406ace0 0x7fb9d406d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80090b0 tx=0x7fb9d8008030 comp rx=0 tx=0).stop 2023-06-08T04:02:11.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.679+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/432188537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e80ced40 msgr2=0x7fb9e80b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.680+0000 7fb9ed1ff700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e80ced40 0x7fb9e80b3640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0002230 tx=0x7fb9e000a060 comp rx=0 tx=0).stop 2023-06-08T04:02:11.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.680+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/432188537 shutdown_connections 2023-06-08T04:02:11.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.680+0000 7fb9ed1ff700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9d406ace0 0x7fb9d406d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.680+0000 7fb9ed1ff700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e80ced40 0x7fb9e80b3640 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.680+0000 7fb9ed1ff700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9e80b4b50 0x7fb9e81541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.680+0000 7fb9ed1ff700 1 --2- 172.21.15.16:0/432188537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9e80b83f0 0x7fb9e815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.680+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/432188537 >> 172.21.15.16:0/432188537 conn(0x7fb9e80cf610 msgr2=0x7fb9e815c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:11.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.680+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/432188537 shutdown_connections 2023-06-08T04:02:11.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.680+0000 7fb9ed1ff700 1 -- 172.21.15.16:0/432188537 wait complete. 2023-06-08T04:02:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-06-08T04:02:11.702 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:11.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.899+0000 7fe5755ff700 1 Processor -- start 2023-06-08T04:02:11.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.899+0000 7fe5755ff700 1 -- start start 2023-06-08T04:02:11.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe5755ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe5700b83f0 0x7fe570160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:11.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe5755ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5700d0800 con 0x7fe5700ced40 2023-06-08T04:02:11.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe5755ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5700cd1e0 con 0x7fe5700b4d20 2023-06-08T04:02:11.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe5755ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5700cd4c0 con 0x7fe5700b83f0 2023-06-08T04:02:11.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe56effd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe5700b83f0 0x7fe570160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:11.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe56effd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe5700b83f0 0x7fe570160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42468/0 (socket says 172.21.15.16:42468) 2023-06-08T04:02:11.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe56effd700 1 -- 172.21.15.16:0/1184646843 learned_addr learned my addr 172.21.15.16:0/1184646843 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:11.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe56e7fc700 1 --1- 172.21.15.16:0/1184646843 >> v1:172.21.15.16:6789/0 conn(0x7fe5700ced40 0x7fe5700b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51654/0 (socket says 172.21.15.16:51654) 2023-06-08T04:02:11.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe56effd700 1 -- 172.21.15.16:0/1184646843 >> v1:172.21.15.169:6789/0 conn(0x7fe5700b4d20 legacy=0x7fe5700d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:11.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe56effd700 1 -- 172.21.15.16:0/1184646843 >> v1:172.21.15.16:6789/0 conn(0x7fe5700ced40 legacy=0x7fe5700b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe56effd700 1 -- 172.21.15.16:0/1184646843 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5700d0aa0 con 0x7fe5700b83f0 2023-06-08T04:02:11.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.901+0000 7fe56dffb700 1 -- 172.21.15.16:0/1184646843 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579705419 0 0) 0x7fe5700d0800 con 0x7fe5700ced40 2023-06-08T04:02:11.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.902+0000 7fe56effd700 1 --2- 172.21.15.16:0/1184646843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5700b83f0 0x7fe570160a60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe5600098f0 tx=0x7fe560009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f89283f6d69e9e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:11.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.902+0000 7fe56dffb700 1 -- 172.21.15.16:0/1184646843 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560004230 con 0x7fe5700b83f0 2023-06-08T04:02:11.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.902+0000 7fe56dffb700 1 -- 172.21.15.16:0/1184646843 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe560004390 con 0x7fe5700b83f0 2023-06-08T04:02:11.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.902+0000 7fe56dffb700 1 -- 172.21.15.16:0/1184646843 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5600036a0 con 0x7fe5700b83f0 2023-06-08T04:02:11.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.902+0000 7fe5755ff700 1 -- 172.21.15.16:0/1184646843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5700b83f0 msgr2=0x7fe570160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.902+0000 7fe5755ff700 1 --2- 172.21.15.16:0/1184646843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5700b83f0 0x7fe570160a60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe5600098f0 tx=0x7fe560009c00 comp rx=0 tx=0).stop 2023-06-08T04:02:11.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.902+0000 7fe5755ff700 1 -- 172.21.15.16:0/1184646843 shutdown_connections 2023-06-08T04:02:11.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.902+0000 7fe5755ff700 1 --2- 172.21.15.16:0/1184646843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5700b83f0 0x7fe570160a60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.902+0000 7fe5755ff700 1 -- 172.21.15.16:0/1184646843 >> 172.21.15.16:0/1184646843 conn(0x7fe5700cf610 msgr2=0x7fe5700cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:11.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.902+0000 7fe5755ff700 1 -- 172.21.15.16:0/1184646843 shutdown_connections 2023-06-08T04:02:11.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.903+0000 7fe5755ff700 1 -- 172.21.15.16:0/1184646843 wait complete. 2023-06-08T04:02:11.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.905+0000 7fe5755ff700 1 Processor -- start 2023-06-08T04:02:11.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.905+0000 7fe5755ff700 1 -- start start 2023-06-08T04:02:11.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.906+0000 7fe5755ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5700b4d20 0x7fe5701f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:11.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.906+0000 7fe5755ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5700b83f0 0x7fe57015d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:11.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.906+0000 7fe5755ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5700ced40 0x7fe57006b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:11.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.906+0000 7fe5755ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700c9c60 con 0x7fe5700b4d20 2023-06-08T04:02:11.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.906+0000 7fe5755ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5701f5160 con 0x7fe5700b83f0 2023-06-08T04:02:11.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.906+0000 7fe5755ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5701f5720 con 0x7fe5700ced40 2023-06-08T04:02:11.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56effd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5700b4d20 0x7fe5701f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:11.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56effd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5700b4d20 0x7fe5701f5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42482/0 (socket says 172.21.15.16:42482) 2023-06-08T04:02:11.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56effd700 1 -- 172.21.15.16:0/4110003312 learned_addr learned my addr 172.21.15.16:0/4110003312 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:11.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56e7fc700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5700b83f0 0x7fe57015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:11.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56effd700 1 -- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5700ced40 msgr2=0x7fe57006b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56f7fe700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5700ced40 0x7fe57006b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:11.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56effd700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5700ced40 0x7fe57006b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56effd700 1 -- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5700b83f0 msgr2=0x7fe57015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:11.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56effd700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5700b83f0 0x7fe57015d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:11.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56effd700 1 -- 172.21.15.16:0/4110003312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe560009550 con 0x7fe5700b4d20 2023-06-08T04:02:11.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56e7fc700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5700b83f0 0x7fe57015d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:11.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56f7fe700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5700ced40 0x7fe57006b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:11.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe56effd700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5700b4d20 0x7fe5701f5bb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe560009130 tx=0x7fe560004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:11.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.907+0000 7fe5577fe700 1 -- 172.21.15.16:0/4110003312 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560003d70 con 0x7fe5700b4d20 2023-06-08T04:02:11.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.908+0000 7fe5577fe700 1 -- 172.21.15.16:0/4110003312 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56001f070 con 0x7fe5700b4d20 2023-06-08T04:02:11.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.908+0000 7fe5577fe700 1 -- 172.21.15.16:0/4110003312 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000b8a0 con 0x7fe5700b4d20 2023-06-08T04:02:11.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.908+0000 7fe5755ff700 1 -- 172.21.15.16:0/4110003312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57015da00 con 0x7fe5700b4d20 2023-06-08T04:02:11.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.908+0000 7fe5755ff700 1 -- 172.21.15.16:0/4110003312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5700ca190 con 0x7fe5700b4d20 2023-06-08T04:02:11.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.909+0000 7fe5755ff700 1 -- 172.21.15.16:0/4110003312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5700740e0 con 0x7fe5700b4d20 2023-06-08T04:02:11.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.910+0000 7fe5577fe700 1 -- 172.21.15.16:0/4110003312 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe560021030 con 0x7fe5700b4d20 2023-06-08T04:02:11.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.910+0000 7fe5577fe700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe55c06ace0 0x7fe55c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:11.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.910+0000 7fe5577fe700 1 -- 172.21.15.16:0/4110003312 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe56008ac90 con 0x7fe5700b4d20 2023-06-08T04:02:11.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.911+0000 7fe56e7fc700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe55c06ace0 0x7fe55c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:11.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.911+0000 7fe56e7fc700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe55c06ace0 0x7fe55c06d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe564007fd0 tx=0x7fe564009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:11.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:11.915+0000 7fe5577fe700 1 -- 172.21.15.16:0/4110003312 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe560055d30 con 0x7fe5700b4d20 2023-06-08T04:02:12.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.125+0000 7fe5755ff700 1 -- 172.21.15.16:0/4110003312 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5700740e0 con 0x7fe5700b4d20 2023-06-08T04:02:12.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.126+0000 7fe5577fe700 1 -- 172.21.15.16:0/4110003312 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7fe560010380 con 0x7fe5700b4d20 2023-06-08T04:02:12.131 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:12.131 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 -- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe55c06ace0 msgr2=0x7fe55c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe55c06ace0 0x7fe55c06d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe564007fd0 tx=0x7fe564009040 comp rx=0 tx=0).stop 2023-06-08T04:02:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 -- 172.21.15.16:0/4110003312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5700b4d20 msgr2=0x7fe5701f5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5700b4d20 0x7fe5701f5bb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe560009130 tx=0x7fe560004750 comp rx=0 tx=0).stop 2023-06-08T04:02:12.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 -- 172.21.15.16:0/4110003312 shutdown_connections 2023-06-08T04:02:12.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe55c06ace0 0x7fe55c06d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5700ced40 0x7fe57006b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5700b4d20 0x7fe5701f5bb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 --2- 172.21.15.16:0/4110003312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5700b83f0 0x7fe57015d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 -- 172.21.15.16:0/4110003312 >> 172.21.15.16:0/4110003312 conn(0x7fe5700cf610 msgr2=0x7fe5700b7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:12.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 -- 172.21.15.16:0/4110003312 shutdown_connections 2023-06-08T04:02:12.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.129+0000 7fe5755ff700 1 -- 172.21.15.16:0/4110003312 wait complete. 2023-06-08T04:02:12.151 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:01:54.980592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:01:56.264608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:02:12.152 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:02:12.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.352+0000 7f3380dff700 1 Processor -- start 2023-06-08T04:02:12.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.352+0000 7f3380dff700 1 -- start start 2023-06-08T04:02:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.353+0000 7f3380dff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f337c0b83f0 0x7f337c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.353+0000 7f3380dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f337c0ced40 0x7f337c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.353+0000 7f3380dff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f337c0b4b50 0x7f337c06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.353+0000 7f3380dff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337c0b4fd0 con 0x7f337c0b83f0 2023-06-08T04:02:12.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.353+0000 7f3380dff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337c0d0800 con 0x7f337c0b4b50 2023-06-08T04:02:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.353+0000 7f3380dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0cd1e0 con 0x7f337c0ced40 2023-06-08T04:02:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.353+0000 7f337a59c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f337c0b83f0 0x7f337c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.353+0000 7f337a59c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f337c0b83f0 0x7f337c160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48004/0 (socket says 172.21.15.16:48004) 2023-06-08T04:02:12.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.353+0000 7f337a59c700 1 -- 172.21.15.16:0/1583447476 learned_addr learned my addr 172.21.15.16:0/1583447476 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.353+0000 7f337ad9d700 1 --2- 172.21.15.16:0/1583447476 >> v2:172.21.15.169:3300/0 conn(0x7f337c0b4b50 0x7f337c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.353+0000 7f3373fff700 1 --2- 172.21.15.16:0/1583447476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f337c0ced40 0x7f337c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.354+0000 7f337a59c700 1 -- 172.21.15.16:0/1583447476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f337c0ced40 msgr2=0x7f337c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.354+0000 7f337a59c700 1 --2- 172.21.15.16:0/1583447476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f337c0ced40 0x7f337c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.354+0000 7f337a59c700 1 -- 172.21.15.16:0/1583447476 >> v2:172.21.15.169:3300/0 conn(0x7f337c0b4b50 msgr2=0x7f337c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.354+0000 7f337a59c700 1 --2- 172.21.15.16:0/1583447476 >> v2:172.21.15.169:3300/0 conn(0x7f337c0b4b50 0x7f337c06b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.354+0000 7f337a59c700 1 -- 172.21.15.16:0/1583447476 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0cd4c0 con 0x7f337c0b83f0 2023-06-08T04:02:12.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.354+0000 7f337a59c700 1 --2- 172.21.15.16:0/1583447476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f337c0b83f0 0x7f337c160a60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f337c073cb0 tx=0x7f336c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88aaa785d51014d1 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.354+0000 7f3379d9b700 1 -- 172.21.15.16:0/1583447476 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c011830 con 0x7f337c0b83f0 2023-06-08T04:02:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.354+0000 7f3379d9b700 1 -- 172.21.15.16:0/1583447476 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c011990 con 0x7f337c0b83f0 2023-06-08T04:02:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.354+0000 7f3379d9b700 1 -- 172.21.15.16:0/1583447476 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c011d20 con 0x7f337c0b83f0 2023-06-08T04:02:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.355+0000 7f3380dff700 1 -- 172.21.15.16:0/1583447476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f337c0b83f0 msgr2=0x7f337c160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.355+0000 7f3380dff700 1 --2- 172.21.15.16:0/1583447476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f337c0b83f0 0x7f337c160a60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f337c073cb0 tx=0x7f336c009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.355+0000 7f3380dff700 1 -- 172.21.15.16:0/1583447476 shutdown_connections 2023-06-08T04:02:12.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.355+0000 7f3380dff700 1 --2- 172.21.15.16:0/1583447476 >> v2:172.21.15.169:3300/0 conn(0x7f337c0b4b50 0x7f337c06b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.355+0000 7f3380dff700 1 --2- 172.21.15.16:0/1583447476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f337c0b83f0 0x7f337c160a60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.355+0000 7f3380dff700 1 --2- 172.21.15.16:0/1583447476 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f337c0ced40 0x7f337c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.355+0000 7f3380dff700 1 -- 172.21.15.16:0/1583447476 >> 172.21.15.16:0/1583447476 conn(0x7f337c0cf610 msgr2=0x7f337c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.355+0000 7f3380dff700 1 -- 172.21.15.16:0/1583447476 shutdown_connections 2023-06-08T04:02:12.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.355+0000 7f3380dff700 1 -- 172.21.15.16:0/1583447476 wait complete. 2023-06-08T04:02:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.357+0000 7f3380dff700 1 Processor -- start 2023-06-08T04:02:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.357+0000 7f3380dff700 1 -- start start 2023-06-08T04:02:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.358+0000 7f3380dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f337c0b4b50 0x7f337c0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.358+0000 7f3380dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f337c0b83f0 0x7f337c1f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.358+0000 7f3380dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f337c0ced40 0x7f337c0c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.358+0000 7f3380dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c1f2c30 con 0x7f337c0ced40 2023-06-08T04:02:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.358+0000 7f3380dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0cb370 con 0x7f337c0b83f0 2023-06-08T04:02:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.358+0000 7f3380dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0cb650 con 0x7f337c0b4b50 2023-06-08T04:02:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.358+0000 7f337ad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f337c0ced40 0x7f337c0c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.358+0000 7f337ad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f337c0ced40 0x7f337c0c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48016/0 (socket says 172.21.15.16:48016) 2023-06-08T04:02:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.358+0000 7f337ad9d700 1 -- 172.21.15.16:0/4116835260 learned_addr learned my addr 172.21.15.16:0/4116835260 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.358+0000 7f337a59c700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f337c0b4b50 0x7f337c0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.358+0000 7f3373fff700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f337c0b83f0 0x7f337c1f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f337ad9d700 1 -- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f337c0b4b50 msgr2=0x7f337c0cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f337ad9d700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f337c0b4b50 0x7f337c0cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f337ad9d700 1 -- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f337c0b83f0 msgr2=0x7f337c1f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f337ad9d700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f337c0b83f0 0x7f337c1f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f337ad9d700 1 -- 172.21.15.16:0/4116835260 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c009550 con 0x7f337c0ced40 2023-06-08T04:02:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f3373fff700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f337c0b83f0 0x7f337c1f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f337ad9d700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f337c0ced40 0x7f337c0c88b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f337400eed0 tx=0x7f337400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:12.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f3372ffd700 1 -- 172.21.15.16:0/4116835260 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374010040 con 0x7f337c0ced40 2023-06-08T04:02:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f3372ffd700 1 -- 172.21.15.16:0/4116835260 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337400bd30 con 0x7f337c0ced40 2023-06-08T04:02:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f3372ffd700 1 -- 172.21.15.16:0/4116835260 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337400bea0 con 0x7f337c0ced40 2023-06-08T04:02:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f3380dff700 1 -- 172.21.15.16:0/4116835260 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337c0cb930 con 0x7f337c0ced40 2023-06-08T04:02:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.359+0000 7f3380dff700 1 -- 172.21.15.16:0/4116835260 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c0cbef0 con 0x7f337c0ced40 2023-06-08T04:02:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.360+0000 7f3380dff700 1 -- 172.21.15.16:0/4116835260 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c0740e0 con 0x7f337c0ced40 2023-06-08T04:02:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.361+0000 7f3372ffd700 1 -- 172.21.15.16:0/4116835260 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3374014620 con 0x7f337c0ced40 2023-06-08T04:02:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.363+0000 7f3372ffd700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f335c06ace0 0x7f335c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.363+0000 7f3372ffd700 1 -- 172.21.15.16:0/4116835260 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33740898d0 con 0x7f337c0ced40 2023-06-08T04:02:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.363+0000 7f337a59c700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f335c06ace0 0x7f335c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.364+0000 7f337a59c700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f335c06ace0 0x7f335c06d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f336c009c10 tx=0x7f336c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:12.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.367+0000 7f3372ffd700 1 -- 172.21.15.16:0/4116835260 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3374054970 con 0x7f337c0ced40 2023-06-08T04:02:12.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.571+0000 7f3380dff700 1 -- 172.21.15.16:0/4116835260 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f337c15c450 con 0x7f337c0ced40 2023-06-08T04:02:12.575 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.571+0000 7f3372ffd700 1 -- 172.21.15.16:0/4116835260 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3374018020 con 0x7f337c0ced40 2023-06-08T04:02:12.575 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:02:12.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.573+0000 7f3380dff700 1 -- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f335c06ace0 msgr2=0x7f335c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.573+0000 7f3380dff700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f335c06ace0 0x7f335c06d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f336c009c10 tx=0x7f336c008030 comp rx=0 tx=0).stop 2023-06-08T04:02:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.573+0000 7f3380dff700 1 -- 172.21.15.16:0/4116835260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f337c0ced40 msgr2=0x7f337c0c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.573+0000 7f3380dff700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f337c0ced40 0x7f337c0c88b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f337400eed0 tx=0x7f337400b390 comp rx=0 tx=0).stop 2023-06-08T04:02:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.573+0000 7f3380dff700 1 -- 172.21.15.16:0/4116835260 shutdown_connections 2023-06-08T04:02:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.573+0000 7f3380dff700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f335c06ace0 0x7f335c06d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.573+0000 7f3380dff700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f337c0ced40 0x7f337c0c88b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.573+0000 7f3380dff700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f337c0b4b50 0x7f337c0cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.573+0000 7f3380dff700 1 --2- 172.21.15.16:0/4116835260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f337c0b83f0 0x7f337c1f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.573+0000 7f3380dff700 1 -- 172.21.15.16:0/4116835260 >> 172.21.15.16:0/4116835260 conn(0x7f337c0cf610 msgr2=0x7f337c0b7380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:12.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.573+0000 7f3380dff700 1 -- 172.21.15.16:0/4116835260 shutdown_connections 2023-06-08T04:02:12.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.574+0000 7f3380dff700 1 -- 172.21.15.16:0/4116835260 wait complete. 2023-06-08T04:02:12.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:02:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.795+0000 7f03f57ff700 1 Processor -- start 2023-06-08T04:02:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.795+0000 7f03f57ff700 1 -- start start 2023-06-08T04:02:12.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.796+0000 7f03f57ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03f00b4d20 0x7f03f0167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.796+0000 7f03f57ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00d0800 con 0x7f03f0160a60 2023-06-08T04:02:12.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.796+0000 7f03f57ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00cd1e0 con 0x7f03f00b83f0 2023-06-08T04:02:12.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.796+0000 7f03f57ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0160ed0 con 0x7f03f00b4d20 2023-06-08T04:02:12.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.797+0000 7f03ee7fc700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f03f0160a60 0x7f03f00b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59414/0 (socket says 172.21.15.16:59414) 2023-06-08T04:02:12.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.797+0000 7f03ee7fc700 1 -- 172.21.15.16:0/3869952076 learned_addr learned my addr 172.21.15.16:0/3869952076 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:12.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.797+0000 7f03ef7fe700 1 --2- 172.21.15.16:0/3869952076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03f00b4d20 0x7f03f0167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.797+0000 7f03edffb700 1 -- 172.21.15.16:0/3869952076 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703538801 0 0) 0x7f03f00d0800 con 0x7f03f0160a60 2023-06-08T04:02:12.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.797+0000 7f03edffb700 1 -- 172.21.15.16:0/3869952076 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d80035b0 con 0x7f03f0160a60 2023-06-08T04:02:12.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.797+0000 7f03edffb700 1 -- 172.21.15.16:0/3869952076 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878668220 0 0) 0x7f03f00cd1e0 con 0x7f03f00b83f0 2023-06-08T04:02:12.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.797+0000 7f03edffb700 1 -- 172.21.15.16:0/3869952076 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03f00d0800 con 0x7f03f00b83f0 2023-06-08T04:02:12.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.797+0000 7f03ef7fe700 1 -- 172.21.15.16:0/3869952076 >> v1:172.21.15.169:6789/0 conn(0x7f03f00b83f0 legacy=0x7f03f00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.797+0000 7f03ef7fe700 1 -- 172.21.15.16:0/3869952076 >> v1:172.21.15.16:6789/0 conn(0x7f03f0160a60 legacy=0x7f03f00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.797+0000 7f03ef7fe700 1 -- 172.21.15.16:0/3869952076 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00cd4c0 con 0x7f03f00b4d20 2023-06-08T04:02:12.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.798+0000 7f03ef7fe700 1 --2- 172.21.15.16:0/3869952076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03f00b4d20 0x7f03f0167260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009dc0 tx=0x7f03e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fbe5c46b63f7426 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:12.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.798+0000 7f03edffb700 1 -- 172.21.15.16:0/3869952076 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e800e070 con 0x7f03f00b4d20 2023-06-08T04:02:12.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.798+0000 7f03edffb700 1 -- 172.21.15.16:0/3869952076 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e800bb20 con 0x7f03f00b4d20 2023-06-08T04:02:12.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.798+0000 7f03edffb700 1 -- 172.21.15.16:0/3869952076 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e800be90 con 0x7f03f00b4d20 2023-06-08T04:02:12.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.798+0000 7f03f57ff700 1 -- 172.21.15.16:0/3869952076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03f00b4d20 msgr2=0x7f03f0167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.798+0000 7f03f57ff700 1 --2- 172.21.15.16:0/3869952076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03f00b4d20 0x7f03f0167260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009dc0 tx=0x7f03e800b330 comp rx=0 tx=0).stop 2023-06-08T04:02:12.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.799+0000 7f03f57ff700 1 -- 172.21.15.16:0/3869952076 shutdown_connections 2023-06-08T04:02:12.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.799+0000 7f03f57ff700 1 --2- 172.21.15.16:0/3869952076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03f00b4d20 0x7f03f0167260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.799+0000 7f03f57ff700 1 -- 172.21.15.16:0/3869952076 >> 172.21.15.16:0/3869952076 conn(0x7f03f00cf610 msgr2=0x7f03f00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.799+0000 7f03f57ff700 1 -- 172.21.15.16:0/3869952076 shutdown_connections 2023-06-08T04:02:12.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.799+0000 7f03f57ff700 1 -- 172.21.15.16:0/3869952076 wait complete. 2023-06-08T04:02:12.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.801+0000 7f03f57ff700 1 Processor -- start 2023-06-08T04:02:12.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.801+0000 7f03f57ff700 1 -- start start 2023-06-08T04:02:12.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03f57ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03f00b4d20 0x7f03f00c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03f57ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00b83f0 0x7f03f00b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03f57ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03f0160a60 0x7f03f00b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03f57ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01f2f30 con 0x7f03f00b83f0 2023-06-08T04:02:12.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03f57ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01f3210 con 0x7f03f00b4d20 2023-06-08T04:02:12.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03f57ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01f34f0 con 0x7f03f0160a60 2023-06-08T04:02:12.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03ee7fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00b83f0 0x7f03f00b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03ee7fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00b83f0 0x7f03f00b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48018/0 (socket says 172.21.15.16:48018) 2023-06-08T04:02:12.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03ee7fc700 1 -- 172.21.15.16:0/4147301785 learned_addr learned my addr 172.21.15.16:0/4147301785 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:12.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03eeffd700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03f00b4d20 0x7f03f00c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03ef7fe700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03f0160a60 0x7f03f00b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03ee7fc700 1 -- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03f0160a60 msgr2=0x7f03f00b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03ee7fc700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03f0160a60 0x7f03f00b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03ee7fc700 1 -- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03f00b4d20 msgr2=0x7f03f00c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:12.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03ee7fc700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03f00b4d20 0x7f03f00c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:12.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.802+0000 7f03ee7fc700 1 -- 172.21.15.16:0/4147301785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8009a70 con 0x7f03f00b83f0 2023-06-08T04:02:12.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.803+0000 7f03ee7fc700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00b83f0 0x7f03f00b3250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f03e4001eb0 tx=0x7f03e400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:12.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.803+0000 7f03d77fe700 1 -- 172.21.15.16:0/4147301785 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4005d70 con 0x7f03f00b83f0 2023-06-08T04:02:12.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.803+0000 7f03d77fe700 1 -- 172.21.15.16:0/4147301785 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e40070d0 con 0x7f03f00b83f0 2023-06-08T04:02:12.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.803+0000 7f03d77fe700 1 -- 172.21.15.16:0/4147301785 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4007480 con 0x7f03f00b83f0 2023-06-08T04:02:12.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.803+0000 7f03f57ff700 1 -- 172.21.15.16:0/4147301785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f01f37d0 con 0x7f03f00b83f0 2023-06-08T04:02:12.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.803+0000 7f03f57ff700 1 -- 172.21.15.16:0/4147301785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f00c8db0 con 0x7f03f00b83f0 2023-06-08T04:02:12.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.804+0000 7f03f57ff700 1 -- 172.21.15.16:0/4147301785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f00740e0 con 0x7f03f00b83f0 2023-06-08T04:02:12.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.805+0000 7f03d77fe700 1 -- 172.21.15.16:0/4147301785 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03e40075e0 con 0x7f03f00b83f0 2023-06-08T04:02:12.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.806+0000 7f03d77fe700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f03dc06ace0 0x7f03dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:12.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.806+0000 7f03d77fe700 1 -- 172.21.15.16:0/4147301785 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03e4088880 con 0x7f03f00b83f0 2023-06-08T04:02:12.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.806+0000 7f03eeffd700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f03dc06ace0 0x7f03dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:12.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.807+0000 7f03eeffd700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f03dc06ace0 0x7f03dc06d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03e0001830 tx=0x7f03e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:12.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:12.810+0000 7f03d77fe700 1 -- 172.21.15.16:0/4147301785 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03e4053920 con 0x7f03f00b83f0 2023-06-08T04:02:13.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.018+0000 7f03f57ff700 1 -- 172.21.15.16:0/4147301785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03f00b4b00 con 0x7f03f00b83f0 2023-06-08T04:02:13.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.018+0000 7f03d77fe700 1 -- 172.21.15.16:0/4147301785 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03e4056f40 con 0x7f03f00b83f0 2023-06-08T04:02:13.023 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:02:13.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.020+0000 7f03f57ff700 1 -- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f03dc06ace0 msgr2=0x7f03dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.021+0000 7f03f57ff700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f03dc06ace0 0x7f03dc06d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03e0001830 tx=0x7f03e0009040 comp rx=0 tx=0).stop 2023-06-08T04:02:13.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.021+0000 7f03f57ff700 1 -- 172.21.15.16:0/4147301785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00b83f0 msgr2=0x7f03f00b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.021+0000 7f03f57ff700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00b83f0 0x7f03f00b3250 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f03e4001eb0 tx=0x7f03e400c7b0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.021+0000 7f03f57ff700 1 -- 172.21.15.16:0/4147301785 shutdown_connections 2023-06-08T04:02:13.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.021+0000 7f03f57ff700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f03dc06ace0 0x7f03dc06d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.021+0000 7f03f57ff700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f03f0160a60 0x7f03f00b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.021+0000 7f03f57ff700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03f00b4d20 0x7f03f00c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.021+0000 7f03f57ff700 1 --2- 172.21.15.16:0/4147301785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f00b83f0 0x7f03f00b3250 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.021+0000 7f03f57ff700 1 -- 172.21.15.16:0/4147301785 >> 172.21.15.16:0/4147301785 conn(0x7f03f00cf610 msgr2=0x7f03f00b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:13.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.021+0000 7f03f57ff700 1 -- 172.21.15.16:0/4147301785 shutdown_connections 2023-06-08T04:02:13.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.021+0000 7f03f57ff700 1 -- 172.21.15.16:0/4147301785 wait complete. 2023-06-08T04:02:13.042 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:02:13.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.241+0000 7f3e54bff700 1 Processor -- start 2023-06-08T04:02:13.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.242+0000 7f3e54bff700 1 -- start start 2023-06-08T04:02:13.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.243+0000 7f3e54bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e50160a60 0x7f3e500b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.243+0000 7f3e54bff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3e500b4b50 0x7f3e500d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.243+0000 7f3e54bff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e500d0800 con 0x7f3e500b83f0 2023-06-08T04:02:13.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.243+0000 7f3e54bff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e50160ed0 con 0x7f3e500b4b50 2023-06-08T04:02:13.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.243+0000 7f3e54bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500b4fd0 con 0x7f3e50160a60 2023-06-08T04:02:13.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.243+0000 7f3e4e59c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3e500b83f0 0x7f3e500ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59424/0 (socket says 172.21.15.16:59424) 2023-06-08T04:02:13.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.243+0000 7f3e4e59c700 1 -- 172.21.15.16:0/3402174920 learned_addr learned my addr 172.21.15.16:0/3402174920 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:13.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.243+0000 7f3e4ed9d700 1 --2- 172.21.15.16:0/3402174920 >> v2:172.21.15.169:3300/0 conn(0x7f3e500b4b50 0x7f3e500d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.243+0000 7f3e47fff700 1 --2- 172.21.15.16:0/3402174920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e50160a60 0x7f3e500b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.243+0000 7f3e4dd9b700 1 -- 172.21.15.16:0/3402174920 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144780281 0 0) 0x7f3e500d0800 con 0x7f3e500b83f0 2023-06-08T04:02:13.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.244+0000 7f3e4dd9b700 1 -- 172.21.15.16:0/3402174920 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e3c0035b0 con 0x7f3e500b83f0 2023-06-08T04:02:13.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.244+0000 7f3e4ed9d700 1 -- 172.21.15.16:0/3402174920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e50160a60 msgr2=0x7f3e500b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:13.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.244+0000 7f3e4ed9d700 1 --2- 172.21.15.16:0/3402174920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e50160a60 0x7f3e500b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.244+0000 7f3e4ed9d700 1 -- 172.21.15.16:0/3402174920 >> v1:172.21.15.16:6789/0 conn(0x7f3e500b83f0 legacy=0x7f3e500ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.244+0000 7f3e4ed9d700 1 -- 172.21.15.16:0/3402174920 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e500cd1e0 con 0x7f3e500b4b50 2023-06-08T04:02:13.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.244+0000 7f3e47fff700 1 --2- 172.21.15.16:0/3402174920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e50160a60 0x7f3e500b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:02:13.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.244+0000 7f3e4ed9d700 1 --2- 172.21.15.16:0/3402174920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e500b4b50 0x7f3e500d0fc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009d90 tx=0x7f3e4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2087302094eac82 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:13.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.244+0000 7f3e4dd9b700 1 -- 172.21.15.16:0/3402174920 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800e070 con 0x7f3e500b4b50 2023-06-08T04:02:13.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.244+0000 7f3e4dd9b700 1 -- 172.21.15.16:0/3402174920 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4800bb20 con 0x7f3e500b4b50 2023-06-08T04:02:13.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.244+0000 7f3e4dd9b700 1 -- 172.21.15.16:0/3402174920 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48012430 con 0x7f3e500b4b50 2023-06-08T04:02:13.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.245+0000 7f3e54bff700 1 -- 172.21.15.16:0/3402174920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e500b4b50 msgr2=0x7f3e500d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.245+0000 7f3e54bff700 1 --2- 172.21.15.16:0/3402174920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e500b4b50 0x7f3e500d0fc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009d90 tx=0x7f3e4800b330 comp rx=0 tx=0).stop 2023-06-08T04:02:13.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.245+0000 7f3e54bff700 1 -- 172.21.15.16:0/3402174920 shutdown_connections 2023-06-08T04:02:13.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.245+0000 7f3e54bff700 1 --2- 172.21.15.16:0/3402174920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e500b4b50 0x7f3e500d0fc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.245+0000 7f3e54bff700 1 --2- 172.21.15.16:0/3402174920 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e50160a60 0x7f3e500b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.245+0000 7f3e54bff700 1 -- 172.21.15.16:0/3402174920 >> 172.21.15.16:0/3402174920 conn(0x7f3e500cf610 msgr2=0x7f3e500cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:13.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.245+0000 7f3e54bff700 1 -- 172.21.15.16:0/3402174920 shutdown_connections 2023-06-08T04:02:13.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.245+0000 7f3e54bff700 1 -- 172.21.15.16:0/3402174920 wait complete. 2023-06-08T04:02:13.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.247+0000 7f3e54bff700 1 Processor -- start 2023-06-08T04:02:13.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.248+0000 7f3e54bff700 1 -- start start 2023-06-08T04:02:13.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.249+0000 7f3e54bff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e500b4b50 0x7f3e501f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.249+0000 7f3e54bff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e500b83f0 0x7f3e5015da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.249+0000 7f3e54bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e50160a60 0x7f3e5015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.249+0000 7f3e54bff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500c9c60 con 0x7f3e500b83f0 2023-06-08T04:02:13.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.249+0000 7f3e54bff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500c9f40 con 0x7f3e500b4b50 2023-06-08T04:02:13.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.249+0000 7f3e54bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5015e380 con 0x7f3e50160a60 2023-06-08T04:02:13.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.249+0000 7f3e47fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e500b83f0 0x7f3e5015da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.249+0000 7f3e47fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e500b83f0 0x7f3e5015da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48034/0 (socket says 172.21.15.16:48034) 2023-06-08T04:02:13.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.249+0000 7f3e47fff700 1 -- 172.21.15.16:0/598724568 learned_addr learned my addr 172.21.15.16:0/598724568 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.249+0000 7f3e4e59c700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e500b4b50 0x7f3e501f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.249+0000 7f3e4ed9d700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e50160a60 0x7f3e5015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e47fff700 1 -- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e50160a60 msgr2=0x7f3e5015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e47fff700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e50160a60 0x7f3e5015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e47fff700 1 -- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e500b4b50 msgr2=0x7f3e501f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e47fff700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e500b4b50 0x7f3e501f1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e47fff700 1 -- 172.21.15.16:0/598724568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e380094a0 con 0x7f3e500b83f0 2023-06-08T04:02:13.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e4e59c700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e500b4b50 0x7f3e501f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:13.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e47fff700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e500b83f0 0x7f3e5015da80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800ec10 tx=0x7f3e38009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:13.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e46ffd700 1 -- 172.21.15.16:0/598724568 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3800c8e0 con 0x7f3e500b83f0 2023-06-08T04:02:13.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e46ffd700 1 -- 172.21.15.16:0/598724568 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3800ca40 con 0x7f3e500b83f0 2023-06-08T04:02:13.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e46ffd700 1 -- 172.21.15.16:0/598724568 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3800cdd0 con 0x7f3e500b83f0 2023-06-08T04:02:13.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e54bff700 1 -- 172.21.15.16:0/598724568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e48009a70 con 0x7f3e500b83f0 2023-06-08T04:02:13.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.250+0000 7f3e54bff700 1 -- 172.21.15.16:0/598724568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5015e940 con 0x7f3e500b83f0 2023-06-08T04:02:13.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.251+0000 7f3e54bff700 1 -- 172.21.15.16:0/598724568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e500ca220 con 0x7f3e500b83f0 2023-06-08T04:02:13.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.252+0000 7f3e46ffd700 1 -- 172.21.15.16:0/598724568 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e38013470 con 0x7f3e500b83f0 2023-06-08T04:02:13.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.253+0000 7f3e46ffd700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3e3006ace0 0x7f3e3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.253+0000 7f3e46ffd700 1 -- 172.21.15.16:0/598724568 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e38089680 con 0x7f3e500b83f0 2023-06-08T04:02:13.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.253+0000 7f3e4e59c700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3e3006ace0 0x7f3e3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.254+0000 7f3e4e59c700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3e3006ace0 0x7f3e3006d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e400011e0 tx=0x7f3e40009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:13.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.257+0000 7f3e46ffd700 1 -- 172.21.15.16:0/598724568 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3e38054690 con 0x7f3e500b83f0 2023-06-08T04:02:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.468+0000 7f3e54bff700 1 -- 172.21.15.16:0/598724568 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e500ca080 con 0x7f3e500b83f0 2023-06-08T04:02:13.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.468+0000 7f3e46ffd700 1 -- 172.21.15.16:0/598724568 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e500ca080 con 0x7f3e500b83f0 2023-06-08T04:02:13.473 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:02:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 -- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3e3006ace0 msgr2=0x7f3e3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3e3006ace0 0x7f3e3006d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e400011e0 tx=0x7f3e40009040 comp rx=0 tx=0).stop 2023-06-08T04:02:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 -- 172.21.15.16:0/598724568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e500b83f0 msgr2=0x7f3e5015da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e500b83f0 0x7f3e5015da80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800ec10 tx=0x7f3e38009e20 comp rx=0 tx=0).stop 2023-06-08T04:02:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 -- 172.21.15.16:0/598724568 shutdown_connections 2023-06-08T04:02:13.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3e3006ace0 0x7f3e3006d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e50160a60 0x7f3e5015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e500b4b50 0x7f3e501f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 --2- 172.21.15.16:0/598724568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e500b83f0 0x7f3e5015da80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 -- 172.21.15.16:0/598724568 >> 172.21.15.16:0/598724568 conn(0x7f3e500cf610 msgr2=0x7f3e50073360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:13.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 -- 172.21.15.16:0/598724568 shutdown_connections 2023-06-08T04:02:13.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.471+0000 7f3e54bff700 1 -- 172.21.15.16:0/598724568 wait complete. 2023-06-08T04:02:13.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:02:13.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.691+0000 7fa057fff700 1 Processor -- start 2023-06-08T04:02:13.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.691+0000 7fa057fff700 1 -- start start 2023-06-08T04:02:13.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.692+0000 7fa057fff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa050160a60 0x7fa0500b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.692+0000 7fa057fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 0x7fa0500d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.692+0000 7fa057fff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0500d0800 con 0x7fa0500b83f0 2023-06-08T04:02:13.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.692+0000 7fa057fff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa050160ed0 con 0x7fa050160a60 2023-06-08T04:02:13.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.692+0000 7fa057fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0500b4fd0 con 0x7fa0500b4b50 2023-06-08T04:02:13.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.693+0000 7fa05659c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 0x7fa0500d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.693+0000 7fa05559a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa050160a60 0x7fa0500b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.693+0000 7fa05659c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 0x7fa0500d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:35506/0 (socket says 172.21.15.16:35506) 2023-06-08T04:02:13.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.693+0000 7fa05659c700 1 -- 172.21.15.16:0/1002334251 learned_addr learned my addr 172.21.15.16:0/1002334251 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:13.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.693+0000 7fa05659c700 1 -- 172.21.15.16:0/1002334251 >> v2:172.21.15.169:3300/0 conn(0x7fa050160a60 msgr2=0x7fa0500b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:13.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.693+0000 7fa05659c700 1 --2- 172.21.15.16:0/1002334251 >> v2:172.21.15.169:3300/0 conn(0x7fa050160a60 0x7fa0500b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.693+0000 7fa05659c700 1 -- 172.21.15.16:0/1002334251 >> v1:172.21.15.169:6789/0 conn(0x7fa0500b83f0 legacy=0x7fa0500ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.693+0000 7fa05659c700 1 -- 172.21.15.16:0/1002334251 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0500cd1e0 con 0x7fa0500b4b50 2023-06-08T04:02:13.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.694+0000 7fa05659c700 1 --2- 172.21.15.16:0/1002334251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 0x7fa0500d0fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa048009e50 tx=0x7fa04800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a04cc0f31ceed0dc server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:13.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.694+0000 7fa054d99700 1 -- 172.21.15.16:0/1002334251 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04800e070 con 0x7fa0500b4b50 2023-06-08T04:02:13.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.694+0000 7fa054d99700 1 -- 172.21.15.16:0/1002334251 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04800b910 con 0x7fa0500b4b50 2023-06-08T04:02:13.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.694+0000 7fa054d99700 1 -- 172.21.15.16:0/1002334251 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04800bcc0 con 0x7fa0500b4b50 2023-06-08T04:02:13.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.695+0000 7fa057fff700 1 -- 172.21.15.16:0/1002334251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 msgr2=0x7fa0500d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.695+0000 7fa057fff700 1 --2- 172.21.15.16:0/1002334251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 0x7fa0500d0fc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa048009e50 tx=0x7fa04800b330 comp rx=0 tx=0).stop 2023-06-08T04:02:13.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.695+0000 7fa057fff700 1 -- 172.21.15.16:0/1002334251 shutdown_connections 2023-06-08T04:02:13.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.695+0000 7fa057fff700 1 --2- 172.21.15.16:0/1002334251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 0x7fa0500d0fc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.695+0000 7fa057fff700 1 --2- 172.21.15.16:0/1002334251 >> v2:172.21.15.169:3300/0 conn(0x7fa050160a60 0x7fa0500b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.695+0000 7fa057fff700 1 -- 172.21.15.16:0/1002334251 >> 172.21.15.16:0/1002334251 conn(0x7fa0500cf610 msgr2=0x7fa0500cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:13.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.695+0000 7fa057fff700 1 -- 172.21.15.16:0/1002334251 shutdown_connections 2023-06-08T04:02:13.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.695+0000 7fa057fff700 1 -- 172.21.15.16:0/1002334251 wait complete. 2023-06-08T04:02:13.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.697+0000 7fa057fff700 1 Processor -- start 2023-06-08T04:02:13.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.697+0000 7fa057fff700 1 -- start start 2023-06-08T04:02:13.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa057fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 0x7fa0501f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa057fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0500b83f0 0x7fa05015f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa057fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa050160a60 0x7fa050159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa057fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0501f5e90 con 0x7fa0500b83f0 2023-06-08T04:02:13.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa057fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05015f8a0 con 0x7fa050160a60 2023-06-08T04:02:13.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa057fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0501f5210 con 0x7fa0500b4b50 2023-06-08T04:02:13.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa05559a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0500b83f0 0x7fa05015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa05559a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0500b83f0 0x7fa05015f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48036/0 (socket says 172.21.15.16:48036) 2023-06-08T04:02:13.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa05559a700 1 -- 172.21.15.16:0/1972178094 learned_addr learned my addr 172.21.15.16:0/1972178094 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:13.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa055d9b700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 0x7fa0501f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa05659c700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa050160a60 0x7fa050159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa05559a700 1 -- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 msgr2=0x7fa0501f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa05559a700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 0x7fa0501f15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa05559a700 1 -- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa050160a60 msgr2=0x7fa050159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa05559a700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa050160a60 0x7fa050159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.698+0000 7fa05559a700 1 -- 172.21.15.16:0/1972178094 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa048009b30 con 0x7fa0500b83f0 2023-06-08T04:02:13.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.699+0000 7fa05659c700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa050160a60 0x7fa050159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:13.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.699+0000 7fa05559a700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0500b83f0 0x7fa05015f360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa04000e870 tx=0x7fa04000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:13.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.699+0000 7fa0467fc700 1 -- 172.21.15.16:0/1972178094 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040009590 con 0x7fa0500b83f0 2023-06-08T04:02:13.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.699+0000 7fa0467fc700 1 -- 172.21.15.16:0/1972178094 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04000ee70 con 0x7fa0500b83f0 2023-06-08T04:02:13.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.699+0000 7fa0467fc700 1 -- 172.21.15.16:0/1972178094 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04000ca50 con 0x7fa0500b83f0 2023-06-08T04:02:13.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.699+0000 7fa057fff700 1 -- 172.21.15.16:0/1972178094 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0501f54f0 con 0x7fa0500b83f0 2023-06-08T04:02:13.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.699+0000 7fa057fff700 1 -- 172.21.15.16:0/1972178094 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0501f5ab0 con 0x7fa0500b83f0 2023-06-08T04:02:13.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.700+0000 7fa057fff700 1 -- 172.21.15.16:0/1972178094 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0500740e0 con 0x7fa0500b83f0 2023-06-08T04:02:13.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.701+0000 7fa0467fc700 1 -- 172.21.15.16:0/1972178094 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa04000cbb0 con 0x7fa0500b83f0 2023-06-08T04:02:13.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.703+0000 7fa0467fc700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa03406ace0 0x7fa03406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:13.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.703+0000 7fa0467fc700 1 -- 172.21.15.16:0/1972178094 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa040089460 con 0x7fa0500b83f0 2023-06-08T04:02:13.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.703+0000 7fa055d9b700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa03406ace0 0x7fa03406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:13.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.704+0000 7fa055d9b700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa03406ace0 0x7fa03406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa04c000f60 tx=0x7fa04c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:13.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.707+0000 7fa0467fc700 1 -- 172.21.15.16:0/1972178094 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa040057f90 con 0x7fa0500b83f0 2023-06-08T04:02:13.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.914+0000 7fa057fff700 1 -- 172.21.15.16:0/1972178094 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa05015e730 con 0x7fa0500b83f0 2023-06-08T04:02:13.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.915+0000 7fa0467fc700 1 -- 172.21.15.16:0/1972178094 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa04000ce60 con 0x7fa0500b83f0 2023-06-08T04:02:13.919 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:02:13.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 -- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa03406ace0 msgr2=0x7fa03406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa03406ace0 0x7fa03406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa04c000f60 tx=0x7fa04c009040 comp rx=0 tx=0).stop 2023-06-08T04:02:13.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 -- 172.21.15.16:0/1972178094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0500b83f0 msgr2=0x7fa05015f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:13.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0500b83f0 0x7fa05015f360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa04000e870 tx=0x7fa04000ec30 comp rx=0 tx=0).stop 2023-06-08T04:02:13.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 -- 172.21.15.16:0/1972178094 shutdown_connections 2023-06-08T04:02:13.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa03406ace0 0x7fa03406d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa050160a60 0x7fa050159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0500b4b50 0x7fa0501f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 --2- 172.21.15.16:0/1972178094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0500b83f0 0x7fa05015f360 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:13.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 -- 172.21.15.16:0/1972178094 >> 172.21.15.16:0/1972178094 conn(0x7fa0500cf610 msgr2=0x7fa0500d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:13.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 -- 172.21.15.16:0/1972178094 shutdown_connections 2023-06-08T04:02:13.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:13.917+0000 7fa057fff700 1 -- 172.21.15.16:0/1972178094 wait complete. 2023-06-08T04:02:13.939 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T04:02:14.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.134+0000 7fafb1bff700 1 Processor -- start 2023-06-08T04:02:14.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.135+0000 7fafb1bff700 1 -- start start 2023-06-08T04:02:14.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.136+0000 7fafb1bff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fafac0b4d20 0x7fafac167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:14.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.136+0000 7fafb1bff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac0d0800 con 0x7fafac160a60 2023-06-08T04:02:14.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.136+0000 7fafb1bff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac0cd1e0 con 0x7fafac0b83f0 2023-06-08T04:02:14.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.136+0000 7fafb1bff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafac160ed0 con 0x7fafac0b4d20 2023-06-08T04:02:14.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.136+0000 7fafaaffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fafac160a60 0x7fafac0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59428/0 (socket says 172.21.15.16:59428) 2023-06-08T04:02:14.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.136+0000 7fafaaffd700 1 -- 172.21.15.16:0/3491035491 learned_addr learned my addr 172.21.15.16:0/3491035491 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:14.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.136+0000 7fafabfff700 1 --2- 172.21.15.16:0/3491035491 >> v2:172.21.15.169:3300/0 conn(0x7fafac0b4d20 0x7fafac167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:14.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.137+0000 7fafaa7fc700 1 -- 172.21.15.16:0/3491035491 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867847715 0 0) 0x7fafac0d0800 con 0x7fafac160a60 2023-06-08T04:02:14.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.137+0000 7fafaa7fc700 1 -- 172.21.15.16:0/3491035491 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf940035b0 con 0x7fafac160a60 2023-06-08T04:02:14.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.137+0000 7fafabfff700 1 -- 172.21.15.16:0/3491035491 >> v1:172.21.15.169:6789/0 conn(0x7fafac0b83f0 legacy=0x7fafac0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.137+0000 7fafabfff700 1 -- 172.21.15.16:0/3491035491 >> v1:172.21.15.16:6789/0 conn(0x7fafac160a60 legacy=0x7fafac0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.137+0000 7fafabfff700 1 -- 172.21.15.16:0/3491035491 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0cd4c0 con 0x7fafac0b4d20 2023-06-08T04:02:14.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.137+0000 7fafabfff700 1 --2- 172.21.15.16:0/3491035491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafac0b4d20 0x7fafac167260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009d90 tx=0x7fafa400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1dd8255a3d022 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:14.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.137+0000 7fafaa7fc700 1 -- 172.21.15.16:0/3491035491 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa400e070 con 0x7fafac0b4d20 2023-06-08T04:02:14.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.137+0000 7fafaa7fc700 1 -- 172.21.15.16:0/3491035491 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa400bb20 con 0x7fafac0b4d20 2023-06-08T04:02:14.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.137+0000 7fafaa7fc700 1 -- 172.21.15.16:0/3491035491 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4012430 con 0x7fafac0b4d20 2023-06-08T04:02:14.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.138+0000 7fafb1bff700 1 -- 172.21.15.16:0/3491035491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafac0b4d20 msgr2=0x7fafac167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.138+0000 7fafb1bff700 1 --2- 172.21.15.16:0/3491035491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafac0b4d20 0x7fafac167260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009d90 tx=0x7fafa400b330 comp rx=0 tx=0).stop 2023-06-08T04:02:14.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.138+0000 7fafb1bff700 1 -- 172.21.15.16:0/3491035491 shutdown_connections 2023-06-08T04:02:14.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.138+0000 7fafb1bff700 1 --2- 172.21.15.16:0/3491035491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafac0b4d20 0x7fafac167260 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.138+0000 7fafb1bff700 1 -- 172.21.15.16:0/3491035491 >> 172.21.15.16:0/3491035491 conn(0x7fafac0cf610 msgr2=0x7fafac0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:14.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.138+0000 7fafb1bff700 1 -- 172.21.15.16:0/3491035491 shutdown_connections 2023-06-08T04:02:14.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.138+0000 7fafb1bff700 1 -- 172.21.15.16:0/3491035491 wait complete. 2023-06-08T04:02:14.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.140+0000 7fafb1bff700 1 Processor -- start 2023-06-08T04:02:14.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.140+0000 7fafb1bff700 1 -- start start 2023-06-08T04:02:14.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafb1bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafac0b4d20 0x7fafac159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:14.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafb1bff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafac0b83f0 0x7fafac0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:14.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafb1bff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafac160a60 0x7fafac15ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:14.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafb1bff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0cb470 con 0x7fafac160a60 2023-06-08T04:02:14.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafb1bff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0cb750 con 0x7fafac0b83f0 2023-06-08T04:02:14.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafb1bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0cba30 con 0x7fafac0b4d20 2023-06-08T04:02:14.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafabfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafac160a60 0x7fafac15ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:14.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafabfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafac160a60 0x7fafac15ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48038/0 (socket says 172.21.15.16:48038) 2023-06-08T04:02:14.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafabfff700 1 -- 172.21.15.16:0/1512977521 learned_addr learned my addr 172.21.15.16:0/1512977521 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:14.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafabfff700 1 -- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafac0b4d20 msgr2=0x7fafac159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafabfff700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafac0b4d20 0x7fafac159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafabfff700 1 -- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafac0b83f0 msgr2=0x7fafac0cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafaaffd700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafac0b83f0 0x7fafac0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:14.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafabfff700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafac0b83f0 0x7fafac0cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.141+0000 7fafabfff700 1 -- 172.21.15.16:0/1512977521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4009a70 con 0x7fafac160a60 2023-06-08T04:02:14.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.142+0000 7fafabfff700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafac160a60 0x7fafac15ebd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fafa4014040 tx=0x7fafa4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:14.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.142+0000 7faf93fff700 1 -- 172.21.15.16:0/1512977521 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4012430 con 0x7fafac160a60 2023-06-08T04:02:14.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.142+0000 7faf93fff700 1 -- 172.21.15.16:0/1512977521 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa4020070 con 0x7fafac160a60 2023-06-08T04:02:14.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.142+0000 7fafb1bff700 1 -- 172.21.15.16:0/1512977521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac0cbd10 con 0x7fafac160a60 2023-06-08T04:02:14.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.142+0000 7faf93fff700 1 -- 172.21.15.16:0/1512977521 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4004280 con 0x7fafac160a60 2023-06-08T04:02:14.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.142+0000 7fafb1bff700 1 -- 172.21.15.16:0/1512977521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac159bb0 con 0x7fafac160a60 2023-06-08T04:02:14.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.143+0000 7fafb1bff700 1 -- 172.21.15.16:0/1512977521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac0740e0 con 0x7fafac160a60 2023-06-08T04:02:14.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.144+0000 7faf93fff700 1 -- 172.21.15.16:0/1512977521 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fafa40043e0 con 0x7fafac160a60 2023-06-08T04:02:14.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.145+0000 7faf93fff700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faf9806ace0 0x7faf9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:14.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.145+0000 7faf93fff700 1 -- 172.21.15.16:0/1512977521 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fafa4022070 con 0x7fafac160a60 2023-06-08T04:02:14.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.145+0000 7fafab7fe700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faf9806ace0 0x7faf9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:14.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.146+0000 7fafab7fe700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faf9806ace0 0x7faf9806d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faf9c000f60 tx=0x7faf9c007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:14.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.149+0000 7faf93fff700 1 -- 172.21.15.16:0/1512977521 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fafa4056680 con 0x7fafac160a60 2023-06-08T04:02:14.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.402+0000 7fafb1bff700 1 -- 172.21.15.16:0/1512977521 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafac0b4ae0 con 0x7fafac160a60 2023-06-08T04:02:14.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.403+0000 7faf93fff700 1 -- 172.21.15.16:0/1512977521 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7fafa4059ca0 con 0x7fafac160a60 2023-06-08T04:02:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:14.407 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3633702519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3633702519},{"type":"v1","addr":"172.21.15.16:6834","nonce":3633702519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/711045362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":711045362},{"type":"v1","addr":"172.21.15.169:6837","nonce":711045362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1926912680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1926912680},{"type":"v1","addr":"172.21.15.16:6835","nonce":1926912680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T04:01:57.284697+0000","modified":"2023-06-08T04:02:00.771168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6836/1286012043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1286012043},{"type":"v1","addr":"172.21.15.169:6836","nonce":1286012043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T04:02:14.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 -- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faf9806ace0 msgr2=0x7faf9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faf9806ace0 0x7faf9806d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faf9c000f60 tx=0x7faf9c007a40 comp rx=0 tx=0).stop 2023-06-08T04:02:14.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 -- 172.21.15.16:0/1512977521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafac160a60 msgr2=0x7fafac15ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafac160a60 0x7fafac15ebd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fafa4014040 tx=0x7fafa4004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 -- 172.21.15.16:0/1512977521 shutdown_connections 2023-06-08T04:02:14.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faf9806ace0 0x7faf9806d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafac160a60 0x7fafac15ebd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fafac0b4d20 0x7fafac159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 --2- 172.21.15.16:0/1512977521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fafac0b83f0 0x7fafac0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 -- 172.21.15.16:0/1512977521 >> 172.21.15.16:0/1512977521 conn(0x7fafac0cf610 msgr2=0x7fafac06b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:14.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 -- 172.21.15.16:0/1512977521 shutdown_connections 2023-06-08T04:02:14.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.405+0000 7fafb1bff700 1 -- 172.21.15.16:0/1512977521 wait complete. 2023-06-08T04:02:14.411 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-06-08T04:02:14.427 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:14.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.623+0000 7fabb2dff700 1 Processor -- start 2023-06-08T04:02:14.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.623+0000 7fabb2dff700 1 -- start start 2023-06-08T04:02:14.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.625+0000 7fabb2dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac0b4d20 0x7fabac167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:14.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.625+0000 7fabb2dff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabac0d0800 con 0x7fabac160a60 2023-06-08T04:02:14.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.625+0000 7fabb2dff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabac0cd1e0 con 0x7fabac0b83f0 2023-06-08T04:02:14.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.625+0000 7fabb2dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabac160ed0 con 0x7fabac0b4d20 2023-06-08T04:02:14.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.625+0000 7fababfff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fabac160a60 0x7fabac0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59430/0 (socket says 172.21.15.16:59430) 2023-06-08T04:02:14.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.625+0000 7fababfff700 1 -- 172.21.15.16:0/2061871400 learned_addr learned my addr 172.21.15.16:0/2061871400 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:14.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.625+0000 7fabb139c700 1 --2- 172.21.15.16:0/2061871400 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac0b4d20 0x7fabac167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:14.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.625+0000 7fabab7fe700 1 -- 172.21.15.16:0/2061871400 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772250824 0 0) 0x7fabac0d0800 con 0x7fabac160a60 2023-06-08T04:02:14.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.625+0000 7fabab7fe700 1 -- 172.21.15.16:0/2061871400 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab9c0035b0 con 0x7fabac160a60 2023-06-08T04:02:14.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.626+0000 7fabab7fe700 1 -- 172.21.15.16:0/2061871400 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043169011 0 0) 0x7fabac0cd1e0 con 0x7fabac0b83f0 2023-06-08T04:02:14.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.626+0000 7fabab7fe700 1 -- 172.21.15.16:0/2061871400 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabac0d0800 con 0x7fabac0b83f0 2023-06-08T04:02:14.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.626+0000 7fabab7fe700 1 -- 172.21.15.16:0/2061871400 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1969076317 0 0) 0x7fab9c0035b0 con 0x7fabac160a60 2023-06-08T04:02:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.626+0000 7fabb139c700 1 -- 172.21.15.16:0/2061871400 >> v1:172.21.15.169:6789/0 conn(0x7fabac0b83f0 legacy=0x7fabac0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.626+0000 7fabb139c700 1 -- 172.21.15.16:0/2061871400 >> v1:172.21.15.16:6789/0 conn(0x7fabac160a60 legacy=0x7fabac0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.626+0000 7fabb139c700 1 -- 172.21.15.16:0/2061871400 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac0cd4c0 con 0x7fabac0b4d20 2023-06-08T04:02:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.626+0000 7fabb139c700 1 --2- 172.21.15.16:0/2061871400 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac0b4d20 0x7fabac167260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faba4009dc0 tx=0x7faba400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c250389f382f200 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.626+0000 7fabab7fe700 1 -- 172.21.15.16:0/2061871400 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400e070 con 0x7fabac0b4d20 2023-06-08T04:02:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.626+0000 7fabab7fe700 1 -- 172.21.15.16:0/2061871400 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba4003a20 con 0x7fabac0b4d20 2023-06-08T04:02:14.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.626+0000 7fabab7fe700 1 -- 172.21.15.16:0/2061871400 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98001670 con 0x7fabac0b4d20 2023-06-08T04:02:14.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.627+0000 7fabb2dff700 1 -- 172.21.15.16:0/2061871400 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac0b4d20 msgr2=0x7fabac167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.627+0000 7fabb2dff700 1 --2- 172.21.15.16:0/2061871400 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac0b4d20 0x7fabac167260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faba4009dc0 tx=0x7faba400b330 comp rx=0 tx=0).stop 2023-06-08T04:02:14.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.627+0000 7fabb2dff700 1 -- 172.21.15.16:0/2061871400 shutdown_connections 2023-06-08T04:02:14.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.627+0000 7fabb2dff700 1 --2- 172.21.15.16:0/2061871400 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac0b4d20 0x7fabac167260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.627+0000 7fabb2dff700 1 -- 172.21.15.16:0/2061871400 >> 172.21.15.16:0/2061871400 conn(0x7fabac0cf610 msgr2=0x7fabac0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:14.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.627+0000 7fabb2dff700 1 -- 172.21.15.16:0/2061871400 shutdown_connections 2023-06-08T04:02:14.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.627+0000 7fabb2dff700 1 -- 172.21.15.16:0/2061871400 wait complete. 2023-06-08T04:02:14.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.629+0000 7fabb2dff700 1 Processor -- start 2023-06-08T04:02:14.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.629+0000 7fabb2dff700 1 -- start start 2023-06-08T04:02:14.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fabb2dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabac0b4d20 0x7fabac0b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:14.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fabb2dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac0b83f0 0x7fabac15d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:14.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fabb2dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac160a60 0x7fabac0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:14.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fabb2dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0ca450 con 0x7fabac0b83f0 2023-06-08T04:02:14.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fabb2dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac15e210 con 0x7fabac0b4d20 2023-06-08T04:02:14.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fabb2dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabac15dc90 con 0x7fabac160a60 2023-06-08T04:02:14.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fababfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac0b83f0 0x7fabac15d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:14.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fababfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac0b83f0 0x7fabac15d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48046/0 (socket says 172.21.15.16:48046) 2023-06-08T04:02:14.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fababfff700 1 -- 172.21.15.16:0/310084808 learned_addr learned my addr 172.21.15.16:0/310084808 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:14.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fabb0b9b700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabac0b4d20 0x7fabac0b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:14.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fabb139c700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac160a60 0x7fabac0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:14.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fababfff700 1 -- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac160a60 msgr2=0x7fabac0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fababfff700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac160a60 0x7fabac0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fababfff700 1 -- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabac0b4d20 msgr2=0x7fabac0b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.630+0000 7fababfff700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabac0b4d20 0x7fabac0b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.631+0000 7fababfff700 1 -- 172.21.15.16:0/310084808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4009a70 con 0x7fabac0b83f0 2023-06-08T04:02:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.631+0000 7fabb139c700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac160a60 0x7fabac0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.631+0000 7fababfff700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac0b83f0 0x7fabac15d750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab9800c500 tx=0x7fab9800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.631+0000 7faba97fa700 1 -- 172.21.15.16:0/310084808 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98004c80 con 0x7fabac0b83f0 2023-06-08T04:02:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.631+0000 7faba97fa700 1 -- 172.21.15.16:0/310084808 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98004de0 con 0x7fabac0b83f0 2023-06-08T04:02:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.631+0000 7fabb2dff700 1 -- 172.21.15.16:0/310084808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac15df30 con 0x7fabac0b83f0 2023-06-08T04:02:14.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.631+0000 7faba97fa700 1 -- 172.21.15.16:0/310084808 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98007310 con 0x7fabac0b83f0 2023-06-08T04:02:14.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.631+0000 7fabb2dff700 1 -- 172.21.15.16:0/310084808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac0ca070 con 0x7fabac0b83f0 2023-06-08T04:02:14.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.632+0000 7fabb2dff700 1 -- 172.21.15.16:0/310084808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac0740e0 con 0x7fabac0b83f0 2023-06-08T04:02:14.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.633+0000 7faba97fa700 1 -- 172.21.15.16:0/310084808 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab98007470 con 0x7fabac0b83f0 2023-06-08T04:02:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.634+0000 7faba97fa700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fab9006ace0 0x7fab9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.634+0000 7faba97fa700 1 -- 172.21.15.16:0/310084808 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab98089260 con 0x7fabac0b83f0 2023-06-08T04:02:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.635+0000 7fabb0b9b700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fab9006ace0 0x7fab9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:14.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.635+0000 7fabb0b9b700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fab9006ace0 0x7fab9006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faba00011e0 tx=0x7faba0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:14.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.638+0000 7faba97fa700 1 -- 172.21.15.16:0/310084808 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab98054300 con 0x7fabac0b83f0 2023-06-08T04:02:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.846+0000 7fabb2dff700 1 -- 172.21.15.16:0/310084808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabac073a90 con 0x7fabac0b83f0 2023-06-08T04:02:14.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.847+0000 7faba97fa700 1 -- 172.21.15.16:0/310084808 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7fab98057920 con 0x7fabac0b83f0 2023-06-08T04:02:14.852 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:14.852 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:14.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 -- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fab9006ace0 msgr2=0x7fab9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fab9006ace0 0x7fab9006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faba00011e0 tx=0x7faba0009040 comp rx=0 tx=0).stop 2023-06-08T04:02:14.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 -- 172.21.15.16:0/310084808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac0b83f0 msgr2=0x7fabac15d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:14.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac0b83f0 0x7fabac15d750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab9800c500 tx=0x7fab9800c8c0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 -- 172.21.15.16:0/310084808 shutdown_connections 2023-06-08T04:02:14.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fab9006ace0 0x7fab9006d190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fabac160a60 0x7fabac0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabac0b4d20 0x7fabac0b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 --2- 172.21.15.16:0/310084808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabac0b83f0 0x7fabac15d750 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:14.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 -- 172.21.15.16:0/310084808 >> 172.21.15.16:0/310084808 conn(0x7fabac0cf610 msgr2=0x7fabac0d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:14.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 -- 172.21.15.16:0/310084808 shutdown_connections 2023-06-08T04:02:14.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:14.850+0000 7fabb2dff700 1 -- 172.21.15.16:0/310084808 wait complete. 2023-06-08T04:02:14.873 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T04:02:15.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.070+0000 7f56d17ff700 1 Processor -- start 2023-06-08T04:02:15.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.070+0000 7f56d17ff700 1 -- start start 2023-06-08T04:02:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.071+0000 7f56d17ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56cc0b83f0 0x7f56cc160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.071+0000 7f56d17ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f56cc0ced40 0x7f56cc0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.071+0000 7f56d17ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc0d0800 con 0x7f56cc0b4b50 2023-06-08T04:02:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.071+0000 7f56d17ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc0b4fd0 con 0x7f56cc0b83f0 2023-06-08T04:02:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.071+0000 7f56d17ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc0cd1e0 con 0x7f56cc0ced40 2023-06-08T04:02:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.071+0000 7f56caffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56cc0b83f0 0x7f56cc160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.072+0000 7f56caffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56cc0b83f0 0x7f56cc160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48058/0 (socket says 172.21.15.16:48058) 2023-06-08T04:02:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.072+0000 7f56caffd700 1 -- 172.21.15.16:0/405591476 learned_addr learned my addr 172.21.15.16:0/405591476 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.072+0000 7f56caffd700 1 -- 172.21.15.16:0/405591476 >> v2:172.21.15.169:3300/0 conn(0x7f56cc0ced40 msgr2=0x7f56cc0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.072+0000 7f56caffd700 1 --2- 172.21.15.16:0/405591476 >> v2:172.21.15.169:3300/0 conn(0x7f56cc0ced40 0x7f56cc0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.072+0000 7f56caffd700 1 -- 172.21.15.16:0/405591476 >> v1:172.21.15.169:6789/0 conn(0x7f56cc0b4b50 legacy=0x7f56cc06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:15.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.072+0000 7f56caffd700 1 -- 172.21.15.16:0/405591476 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0cd4c0 con 0x7f56cc0b83f0 2023-06-08T04:02:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.072+0000 7f56caffd700 1 --2- 172.21.15.16:0/405591476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56cc0b83f0 0x7f56cc160a60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f56cc06c4e0 tx=0x7f56bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a353b50c8bda6fd6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.072+0000 7f56c9ffb700 1 -- 172.21.15.16:0/405591476 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc004230 con 0x7f56cc0b83f0 2023-06-08T04:02:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.072+0000 7f56c9ffb700 1 -- 172.21.15.16:0/405591476 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc004390 con 0x7f56cc0b83f0 2023-06-08T04:02:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.072+0000 7f56c9ffb700 1 -- 172.21.15.16:0/405591476 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0036a0 con 0x7f56cc0b83f0 2023-06-08T04:02:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.073+0000 7f56d17ff700 1 -- 172.21.15.16:0/405591476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56cc0b83f0 msgr2=0x7f56cc160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.073+0000 7f56d17ff700 1 --2- 172.21.15.16:0/405591476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56cc0b83f0 0x7f56cc160a60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f56cc06c4e0 tx=0x7f56bc009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.073+0000 7f56d17ff700 1 -- 172.21.15.16:0/405591476 shutdown_connections 2023-06-08T04:02:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.073+0000 7f56d17ff700 1 --2- 172.21.15.16:0/405591476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56cc0b83f0 0x7f56cc160a60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.073+0000 7f56d17ff700 1 --2- 172.21.15.16:0/405591476 >> v2:172.21.15.169:3300/0 conn(0x7f56cc0ced40 0x7f56cc0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.073+0000 7f56d17ff700 1 -- 172.21.15.16:0/405591476 >> 172.21.15.16:0/405591476 conn(0x7f56cc0cf610 msgr2=0x7f56cc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.073+0000 7f56d17ff700 1 -- 172.21.15.16:0/405591476 shutdown_connections 2023-06-08T04:02:15.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.073+0000 7f56d17ff700 1 -- 172.21.15.16:0/405591476 wait complete. 2023-06-08T04:02:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.075+0000 7f56d17ff700 1 Processor -- start 2023-06-08T04:02:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.075+0000 7f56d17ff700 1 -- start start 2023-06-08T04:02:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56d17ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56cc0b4b50 0x7f56cc14de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56d17ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56cc0b83f0 0x7f56cc0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56d17ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56cc0ced40 0x7f56cc0b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56d17ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0a95f0 con 0x7f56cc0ced40 2023-06-08T04:02:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56d17ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0c9d00 con 0x7f56cc0b83f0 2023-06-08T04:02:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56d17ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc15d810 con 0x7f56cc0b4b50 2023-06-08T04:02:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56cb7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56cc0ced40 0x7f56cc0b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56cb7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56cc0ced40 0x7f56cc0b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48060/0 (socket says 172.21.15.16:48060) 2023-06-08T04:02:15.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56cb7fe700 1 -- 172.21.15.16:0/2891556383 learned_addr learned my addr 172.21.15.16:0/2891556383 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56ca7fc700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56cc0b83f0 0x7f56cc0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56caffd700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56cc0b4b50 0x7f56cc14de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56cb7fe700 1 -- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56cc0b4b50 msgr2=0x7f56cc14de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56cb7fe700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56cc0b4b50 0x7f56cc14de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56cb7fe700 1 -- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56cc0b83f0 msgr2=0x7f56cc0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56cb7fe700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56cc0b83f0 0x7f56cc0caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.076+0000 7f56cb7fe700 1 -- 172.21.15.16:0/2891556383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc009550 con 0x7f56cc0ced40 2023-06-08T04:02:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.077+0000 7f56cb7fe700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56cc0ced40 0x7f56cc0b3610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56c400c7a0 tx=0x7f56c400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.077+0000 7f56b37fe700 1 -- 172.21.15.16:0/2891556383 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4003e10 con 0x7f56cc0ced40 2023-06-08T04:02:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.077+0000 7f56b37fe700 1 -- 172.21.15.16:0/2891556383 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c4005070 con 0x7f56cc0ced40 2023-06-08T04:02:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.077+0000 7f56d17ff700 1 -- 172.21.15.16:0/2891556383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc0c9fa0 con 0x7f56cc0ced40 2023-06-08T04:02:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.077+0000 7f56b37fe700 1 -- 172.21.15.16:0/2891556383 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4005420 con 0x7f56cc0ced40 2023-06-08T04:02:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.077+0000 7f56d17ff700 1 -- 172.21.15.16:0/2891556383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc0ca560 con 0x7f56cc0ced40 2023-06-08T04:02:15.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.078+0000 7f56d17ff700 1 -- 172.21.15.16:0/2891556383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc0740e0 con 0x7f56cc0ced40 2023-06-08T04:02:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.079+0000 7f56b37fe700 1 -- 172.21.15.16:0/2891556383 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56c4005580 con 0x7f56cc0ced40 2023-06-08T04:02:15.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.080+0000 7f56b37fe700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f56b806ace0 0x7f56b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.080+0000 7f56b37fe700 1 -- 172.21.15.16:0/2891556383 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56c40886d0 con 0x7f56cc0ced40 2023-06-08T04:02:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.080+0000 7f56caffd700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f56b806ace0 0x7f56b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.081+0000 7f56caffd700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f56b806ace0 0x7f56b806d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009130 tx=0x7f56bc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:15.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.084+0000 7f56b37fe700 1 -- 172.21.15.16:0/2891556383 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f56c40536e0 con 0x7f56cc0ced40 2023-06-08T04:02:15.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.341+0000 7f56d17ff700 1 -- 172.21.15.16:0/2891556383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56cc0b2200 con 0x7f56cc0ced40 2023-06-08T04:02:15.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.341+0000 7f56b37fe700 1 -- 172.21.15.16:0/2891556383 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f56c4056d00 con 0x7f56cc0ced40 2023-06-08T04:02:15.345 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:15.345 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3633702519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3633702519},{"type":"v1","addr":"172.21.15.16:6834","nonce":3633702519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/711045362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":711045362},{"type":"v1","addr":"172.21.15.169:6837","nonce":711045362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1926912680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1926912680},{"type":"v1","addr":"172.21.15.16:6835","nonce":1926912680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T04:01:57.284697+0000","modified":"2023-06-08T04:02:00.771168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6836/1286012043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1286012043},{"type":"v1","addr":"172.21.15.169:6836","nonce":1286012043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T04:02:15.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 -- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f56b806ace0 msgr2=0x7f56b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f56b806ace0 0x7f56b806d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009130 tx=0x7f56bc008030 comp rx=0 tx=0).stop 2023-06-08T04:02:15.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 -- 172.21.15.16:0/2891556383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56cc0ced40 msgr2=0x7f56cc0b3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56cc0ced40 0x7f56cc0b3610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56c400c7a0 tx=0x7f56c400cab0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 -- 172.21.15.16:0/2891556383 shutdown_connections 2023-06-08T04:02:15.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f56b806ace0 0x7f56b806d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56cc0ced40 0x7f56cc0b3610 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f56cc0b4b50 0x7f56cc14de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 --2- 172.21.15.16:0/2891556383 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56cc0b83f0 0x7f56cc0caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 -- 172.21.15.16:0/2891556383 >> 172.21.15.16:0/2891556383 conn(0x7f56cc0cf610 msgr2=0x7f56cc0b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:15.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 -- 172.21.15.16:0/2891556383 shutdown_connections 2023-06-08T04:02:15.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.344+0000 7f56d17ff700 1 -- 172.21.15.16:0/2891556383 wait complete. 2023-06-08T04:02:15.350 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-06-08T04:02:15.767 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-08T04:01:57.284697+0000', 'modified': '2023-06-08T04:02:00.771168+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.169:6836/1286012043', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 1286012043}, {'type': 'v1', 'addr': '172.21.15.169:6836', 'nonce': 1286012043}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-08T04:02:15.767 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-08T04:02:15.768 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-08T04:02:15.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.966+0000 7f7a291ff700 1 Processor -- start 2023-06-08T04:02:15.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.967+0000 7f7a291ff700 1 -- start start 2023-06-08T04:02:15.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.968+0000 7f7a291ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7a240b4d20 0x7f7a24167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.968+0000 7f7a291ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a240d0800 con 0x7f7a240b83f0 2023-06-08T04:02:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.968+0000 7f7a291ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a240cd1e0 con 0x7f7a24160a60 2023-06-08T04:02:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.968+0000 7f7a291ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a24160ed0 con 0x7f7a240b4d20 2023-06-08T04:02:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.969+0000 7f7a22d9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7a240b83f0 0x7f7a240ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59444/0 (socket says 172.21.15.16:59444) 2023-06-08T04:02:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.969+0000 7f7a22d9d700 1 -- 172.21.15.16:0/2232691438 learned_addr learned my addr 172.21.15.16:0/2232691438 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.969+0000 7f7a2359e700 1 --2- 172.21.15.16:0/2232691438 >> v2:172.21.15.169:3300/0 conn(0x7f7a240b4d20 0x7f7a24167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.969+0000 7f7a21d9b700 1 -- 172.21.15.16:0/2232691438 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627127129 0 0) 0x7f7a240d0800 con 0x7f7a240b83f0 2023-06-08T04:02:15.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.969+0000 7f7a21d9b700 1 -- 172.21.15.16:0/2232691438 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a0c0035b0 con 0x7f7a240b83f0 2023-06-08T04:02:15.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.969+0000 7f7a2359e700 1 -- 172.21.15.16:0/2232691438 >> v1:172.21.15.169:6789/0 conn(0x7f7a24160a60 legacy=0x7f7a240b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.969+0000 7f7a2359e700 1 -- 172.21.15.16:0/2232691438 >> v1:172.21.15.16:6789/0 conn(0x7f7a240b83f0 legacy=0x7f7a240ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.969+0000 7f7a2359e700 1 -- 172.21.15.16:0/2232691438 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a240cd4c0 con 0x7f7a240b4d20 2023-06-08T04:02:15.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.970+0000 7f7a2359e700 1 --2- 172.21.15.16:0/2232691438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a240b4d20 0x7f7a24167260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009d90 tx=0x7f7a1c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c18f26fe347d009 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:15.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.970+0000 7f7a21d9b700 1 -- 172.21.15.16:0/2232691438 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00e070 con 0x7f7a240b4d20 2023-06-08T04:02:15.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.970+0000 7f7a21d9b700 1 -- 172.21.15.16:0/2232691438 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c00bb20 con 0x7f7a240b4d20 2023-06-08T04:02:15.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.970+0000 7f7a21d9b700 1 -- 172.21.15.16:0/2232691438 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c012430 con 0x7f7a240b4d20 2023-06-08T04:02:15.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.970+0000 7f7a291ff700 1 -- 172.21.15.16:0/2232691438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a240b4d20 msgr2=0x7f7a24167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.970+0000 7f7a291ff700 1 --2- 172.21.15.16:0/2232691438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a240b4d20 0x7f7a24167260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009d90 tx=0x7f7a1c00b330 comp rx=0 tx=0).stop 2023-06-08T04:02:15.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.970+0000 7f7a291ff700 1 -- 172.21.15.16:0/2232691438 shutdown_connections 2023-06-08T04:02:15.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.970+0000 7f7a291ff700 1 --2- 172.21.15.16:0/2232691438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a240b4d20 0x7f7a24167260 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.970+0000 7f7a291ff700 1 -- 172.21.15.16:0/2232691438 >> 172.21.15.16:0/2232691438 conn(0x7f7a240cf610 msgr2=0x7f7a240cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:15.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.970+0000 7f7a291ff700 1 -- 172.21.15.16:0/2232691438 shutdown_connections 2023-06-08T04:02:15.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.970+0000 7f7a291ff700 1 -- 172.21.15.16:0/2232691438 wait complete. 2023-06-08T04:02:15.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.972+0000 7f7a291ff700 1 Processor -- start 2023-06-08T04:02:15.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.972+0000 7f7a291ff700 1 -- start start 2023-06-08T04:02:15.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.973+0000 7f7a291ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a240b4d20 0x7f7a2415db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.973+0000 7f7a291ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a240b83f0 0x7f7a2414d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.973+0000 7f7a291ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a24160a60 0x7f7a241595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.973+0000 7f7a291ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a241e5d30 con 0x7f7a24160a60 2023-06-08T04:02:15.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.973+0000 7f7a291ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a241f5280 con 0x7f7a240b83f0 2023-06-08T04:02:15.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.973+0000 7f7a291ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a241f5520 con 0x7f7a240b4d20 2023-06-08T04:02:15.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.974+0000 7f7a2359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a24160a60 0x7f7a241595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.974+0000 7f7a22d9d700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a240b4d20 0x7f7a2415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.974+0000 7f7a2359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a24160a60 0x7f7a241595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48068/0 (socket says 172.21.15.16:48068) 2023-06-08T04:02:15.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.974+0000 7f7a2359e700 1 -- 172.21.15.16:0/1758277555 learned_addr learned my addr 172.21.15.16:0/1758277555 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:15.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.974+0000 7f7a2259c700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a240b83f0 0x7f7a2414d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.974+0000 7f7a2359e700 1 -- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a240b4d20 msgr2=0x7f7a2415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.974+0000 7f7a2359e700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a240b4d20 0x7f7a2415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.974+0000 7f7a2359e700 1 -- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a240b83f0 msgr2=0x7f7a2414d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.974+0000 7f7a2359e700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a240b83f0 0x7f7a2414d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.974+0000 7f7a2359e700 1 -- 172.21.15.16:0/1758277555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c009a70 con 0x7f7a24160a60 2023-06-08T04:02:15.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.974+0000 7f7a2359e700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a24160a60 0x7f7a241595a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c014040 tx=0x7f7a1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:15.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.975+0000 7f7a0b7fe700 1 -- 172.21.15.16:0/1758277555 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c012430 con 0x7f7a24160a60 2023-06-08T04:02:15.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.975+0000 7f7a0b7fe700 1 -- 172.21.15.16:0/1758277555 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c020070 con 0x7f7a24160a60 2023-06-08T04:02:15.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.975+0000 7f7a0b7fe700 1 -- 172.21.15.16:0/1758277555 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c004280 con 0x7f7a24160a60 2023-06-08T04:02:15.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.975+0000 7f7a291ff700 1 -- 172.21.15.16:0/1758277555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a241f5800 con 0x7f7a24160a60 2023-06-08T04:02:15.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.975+0000 7f7a291ff700 1 -- 172.21.15.16:0/1758277555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a241f5dc0 con 0x7f7a24160a60 2023-06-08T04:02:15.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.977+0000 7f7a0b7fe700 1 -- 172.21.15.16:0/1758277555 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a1c0043e0 con 0x7f7a24160a60 2023-06-08T04:02:15.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.978+0000 7f7a0b7fe700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a1006ace0 0x7f7a1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.978+0000 7f7a0b7fe700 1 -- 172.21.15.16:0/1758277555 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a1c022070 con 0x7f7a24160a60 2023-06-08T04:02:15.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.978+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a1006ace0 0x7f7a1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.979+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a1006ace0 0x7f7a1006d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a14007fd0 tx=0x7f7a14007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:15.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.980+0000 7f7a3cadeb80 1 Processor -- start 2023-06-08T04:02:15.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.980+0000 7f7a3cadeb80 1 -- start start 2023-06-08T04:02:15.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a7ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a803ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a804010 0x55f57a7d7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57a6c2600 con 0x55f57a7d6dd0 2023-06-08T04:02:15.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57a731490 con 0x55f57a7f8b40 2023-06-08T04:02:15.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f57a72a760 con 0x55f57a804010 2023-06-08T04:02:15.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a2259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a803ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a2259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a803ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48072/0 (socket says 172.21.15.16:48072) 2023-06-08T04:02:15.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a2259c700 1 -- 172.21.15.16:0/1957858529 learned_addr learned my addr 172.21.15.16:0/1957858529 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:15.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/1957858529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a7ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a2359e700 1 --2- 172.21.15.16:0/1957858529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a804010 0x55f57a7d7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a2259c700 1 -- 172.21.15.16:0/1957858529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a804010 msgr2=0x55f57a7d7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:15.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a2259c700 1 --2- 172.21.15.16:0/1957858529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a804010 0x55f57a7d7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a2259c700 1 -- 172.21.15.16:0/1957858529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 msgr2=0x55f57a7ffde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:15.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a2259c700 1 --2- 172.21.15.16:0/1957858529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a7ffde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a2259c700 1 -- 172.21.15.16:0/1957858529 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f57a51e790 con 0x55f57a7d6dd0 2023-06-08T04:02:15.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.981+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/1957858529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a7ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:15.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.982+0000 7f7a2259c700 1 --2- 172.21.15.16:0/1957858529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a803ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001770 tx=0x7f7a18007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203b350c9d435f79 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:15.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.982+0000 7f7a08ff9700 1 -- 172.21.15.16:0/1957858529 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a180052e0 con 0x55f57a7d6dd0 2023-06-08T04:02:15.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.982+0000 7f7a08ff9700 1 -- 172.21.15.16:0/1957858529 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a18005440 con 0x55f57a7d6dd0 2023-06-08T04:02:15.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.982+0000 7f7a08ff9700 1 -- 172.21.15.16:0/1957858529 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a180038a0 con 0x55f57a7d6dd0 2023-06-08T04:02:15.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.982+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1957858529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 msgr2=0x55f57a803ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.982+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/1957858529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a803ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001770 tx=0x7f7a18007ec0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.983+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1957858529 shutdown_connections 2023-06-08T04:02:15.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.983+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/1957858529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a804010 0x55f57a7d7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.983+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/1957858529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a7ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.983+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/1957858529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a803ad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.983+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1957858529 >> 172.21.15.16:0/1957858529 conn(0x55f57a7ce430 msgr2=0x55f57a81e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:15.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.983+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1957858529 shutdown_connections 2023-06-08T04:02:15.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.983+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1957858529 wait complete. 2023-06-08T04:02:15.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.983+0000 7f7a3cadeb80 1 -- start start 2023-06-08T04:02:15.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.984+0000 7f7a3cadeb80 1 Processor -- start 2023-06-08T04:02:15.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a8018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a7f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a804010 0x55f57a81b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57a6e85b0 con 0x55f57a7d6dd0 2023-06-08T04:02:15.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57a6ce910 con 0x55f57a7f8b40 2023-06-08T04:02:15.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f57a51f390 con 0x55f57a804010 2023-06-08T04:02:15.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a3cadeb80 10 client.0 _ll_register_callbacks cb 0x55f57a732d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-08T04:02:15.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a22d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a8018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a22d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a8018c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48082/0 (socket says 172.21.15.16:48082) 2023-06-08T04:02:15.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a22d9d700 1 -- 172.21.15.16:0/2375392144 learned_addr learned my addr 172.21.15.16:0/2375392144 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:15.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a2259c700 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a7f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a2359e700 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a804010 0x55f57a81b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a22d9d700 1 -- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a804010 msgr2=0x55f57a81b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:15.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a804010 0x55f57a81b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a22d9d700 1 -- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 msgr2=0x55f57a7f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:15.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a7f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.985+0000 7f7a22d9d700 1 -- 172.21.15.16:0/2375392144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a240cd1e0 con 0x55f57a7d6dd0 2023-06-08T04:02:15.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.986+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a8018c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a14006630 tx=0x7f7a14001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8987f8c0593c18 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:15.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.986+0000 7f7a01ffb700 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2023-06-08T04:02:15.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.986+0000 7f7a01ffb700 1 -- 172.21.15.16:0/2375392144 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14026070 con 0x55f57a7d6dd0 2023-06-08T04:02:15.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.986+0000 7f7a01ffb700 1 -- 172.21.15.16:0/2375392144 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a1401b070 con 0x55f57a7d6dd0 2023-06-08T04:02:15.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.986+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2375392144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f57a7cba40 con 0x55f57a7d6dd0 2023-06-08T04:02:15.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.986+0000 7f7a01ffb700 1 -- 172.21.15.16:0/2375392144 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a14001580 con 0x55f57a7d6dd0 2023-06-08T04:02:15.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.986+0000 7f7a3cadeb80 10 client.4671 fetch_fsmap learned FSMap version 8 2023-06-08T04:02:15.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.986+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2375392144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55f57a60b0a0 con 0x55f57a7d6dd0 2023-06-08T04:02:15.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.987+0000 7f7a01ffb700 1 -- 172.21.15.16:0/2375392144 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14030020 con 0x55f57a7d6dd0 2023-06-08T04:02:15.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.987+0000 7f7a01ffb700 1 -- 172.21.15.16:0/2375392144 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7a14029020 con 0x55f57a7d6dd0 2023-06-08T04:02:15.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.987+0000 7f7a3cadeb80 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2023-06-08T04:02:15.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.987+0000 7f7a3cadeb80 10 client.4671 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-08T04:02:15.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.987+0000 7f7a3cadeb80 20 client.4671 populate_metadata read hostname 'smithi016' 2023-06-08T04:02:15.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.987+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:6834/1286012043,v1:172.21.15.169:6836/1286012043] conn(0x55f57a804db0 0x55f57a805180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:15.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.987+0000 7f7a3cadeb80 4 client.4671 mds_command: new command op to 4281 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-08T04:02:15.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.987+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2375392144 --> [v2:172.21.15.169:6834/1286012043,v1:172.21.15.169:6836/1286012043] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f57a7a8460 con 0x55f57a804db0 2023-06-08T04:02:15.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.987+0000 7f7a2259c700 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:6834/1286012043,v1:172.21.15.169:6836/1286012043] conn(0x55f57a804db0 0x55f57a805180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:15.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.988+0000 7f7a01ffb700 10 client.4671 ms_handle_connect on v2:172.21.15.169:6834/1286012043 2023-06-08T04:02:15.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.988+0000 7f7a2259c700 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:6834/1286012043,v1:172.21.15.169:6836/1286012043] conn(0x55f57a804db0 0x55f57a805180 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a39110f6039f7e14 server_cookie=f636f88ccd17ce73 in_seq=0 out_seq=0 2023-06-08T04:02:15.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a01ffb700 1 -- 172.21.15.16:0/2375392144 <== mds.0 v2:172.21.15.169:6834/1286012043 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f57a7a8460 con 0x55f57a804db0 2023-06-08T04:02:15.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a01ffb700 10 client.4671 handle_command_reply: tid=0 2023-06-08T04:02:15.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 1 client.4671 shutdown 2023-06-08T04:02:15.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2375392144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 msgr2=0x55f57a8018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:15.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a8018c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a14006630 tx=0x7f7a14001150 comp rx=0 tx=0).stop 2023-06-08T04:02:15.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2375392144 shutdown_connections 2023-06-08T04:02:15.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:6834/1286012043,v1:172.21.15.169:6836/1286012043] conn(0x55f57a804db0 0x55f57a805180 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a804010 0x55f57a81b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a7d6dd0 0x55f57a8018c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/2375392144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a7f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:15.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2375392144 >> 172.21.15.16:0/2375392144 conn(0x55f57a7ce430 msgr2=0x55f57a7d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:15.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a01ffb700 0 client.4671 ms_handle_reset on v2:172.21.15.169:6834/1286012043 2023-06-08T04:02:15.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2375392144 shutdown_connections 2023-06-08T04:02:15.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2375392144 wait complete. 2023-06-08T04:02:16.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:15.989+0000 7f7a3cadeb80 20 client.4671 trim_cache size 0 max 16384 2023-06-08T04:02:16.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.008+0000 7f7a3cadeb80 1 Processor -- start 2023-06-08T04:02:16.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.008+0000 7f7a3cadeb80 1 -- start start 2023-06-08T04:02:16.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7d6dd0 0x55f57a800830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a7f8b40 0x55f57a7d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7d3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57a7d4890 con 0x55f57a804010 2023-06-08T04:02:16.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57a7da9d0 con 0x55f57a7d6dd0 2023-06-08T04:02:16.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f57a8053c0 con 0x55f57a7f8b40 2023-06-08T04:02:16.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a2359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7d3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a2359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7d3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48092/0 (socket says 172.21.15.16:48092) 2023-06-08T04:02:16.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a2359e700 1 -- 172.21.15.16:0/2184921832 learned_addr learned my addr 172.21.15.16:0/2184921832 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:16.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a2259c700 1 --2- 172.21.15.16:0/2184921832 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a7f8b40 0x55f57a7d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/2184921832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7d6dd0 0x55f57a800830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a2359e700 1 -- 172.21.15.16:0/2184921832 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a7f8b40 msgr2=0x55f57a7d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:16.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a2359e700 1 --2- 172.21.15.16:0/2184921832 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a7f8b40 0x55f57a7d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a2359e700 1 -- 172.21.15.16:0/2184921832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7d6dd0 msgr2=0x55f57a800830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:16.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a2359e700 1 --2- 172.21.15.16:0/2184921832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7d6dd0 0x55f57a800830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.009+0000 7f7a2359e700 1 -- 172.21.15.16:0/2184921832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f57a7d5ed0 con 0x55f57a804010 2023-06-08T04:02:16.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.010+0000 7f7a2359e700 1 --2- 172.21.15.16:0/2184921832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7d3540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00b370 tx=0x7f7a1c0098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a920d698b158bf6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:16.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.010+0000 7f7a097fa700 1 -- 172.21.15.16:0/2184921832 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0620a0 con 0x55f57a804010 2023-06-08T04:02:16.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.010+0000 7f7a097fa700 1 -- 172.21.15.16:0/2184921832 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c05c030 con 0x55f57a804010 2023-06-08T04:02:16.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.010+0000 7f7a097fa700 1 -- 172.21.15.16:0/2184921832 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c061c10 con 0x55f57a804010 2023-06-08T04:02:16.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.010+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2184921832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 msgr2=0x55f57a7d3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:16.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.010+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/2184921832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7d3540 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00b370 tx=0x7f7a1c0098f0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.010+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2184921832 shutdown_connections 2023-06-08T04:02:16.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.010+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/2184921832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7d3540 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.010+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/2184921832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7d6dd0 0x55f57a800830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.010+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/2184921832 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a7f8b40 0x55f57a7d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.010+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2184921832 >> 172.21.15.16:0/2184921832 conn(0x55f57a7ce430 msgr2=0x55f57a805660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:16.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.011+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2184921832 shutdown_connections 2023-06-08T04:02:16.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.011+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/2184921832 wait complete. 2023-06-08T04:02:16.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.011+0000 7f7a3cadeb80 1 -- start start 2023-06-08T04:02:16.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.012+0000 7f7a3cadeb80 1 Processor -- start 2023-06-08T04:02:16.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.013+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a7d6dd0 0x55f57a7d40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.013+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a8693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.013+0000 7f7a3cadeb80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7f5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.013+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57a869930 con 0x55f57a804010 2023-06-08T04:02:16.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.013+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57a81cec0 con 0x55f57a7f8b40 2023-06-08T04:02:16.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.013+0000 7f7a3cadeb80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f57a7f5c70 con 0x55f57a7d6dd0 2023-06-08T04:02:16.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.013+0000 7f7a3cadeb80 10 client.0 _ll_register_callbacks cb 0x55f57a732d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-08T04:02:16.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a2359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a2359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7f5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48096/0 (socket says 172.21.15.16:48096) 2023-06-08T04:02:16.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a2359e700 1 -- 172.21.15.16:0/1133149206 learned_addr learned my addr 172.21.15.16:0/1133149206 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:16.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a2259c700 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a8693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a7d6dd0 0x55f57a7d40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a2359e700 1 -- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a7d6dd0 msgr2=0x55f57a7d40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:16.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a2359e700 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a7d6dd0 0x55f57a7d40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a2359e700 1 -- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 msgr2=0x55f57a8693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:16.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a2359e700 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a8693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a2359e700 1 -- 172.21.15.16:0/1133149206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a241f5dc0 con 0x55f57a804010 2023-06-08T04:02:16.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a2259c700 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a8693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:16.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a7d6dd0 0x55f57a7d40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:16.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a2359e700 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7f5470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c059a50 tx=0x7f7a1c00b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38cdbc71b31b599 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:16.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a01ffb700 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2023-06-08T04:02:16.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a01ffb700 1 -- 172.21.15.16:0/1133149206 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c004890 con 0x55f57a804010 2023-06-08T04:02:16.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a01ffb700 1 -- 172.21.15.16:0/1133149206 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a1c012e40 con 0x55f57a804010 2023-06-08T04:02:16.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1133149206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a18005440 con 0x55f57a804010 2023-06-08T04:02:16.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a01ffb700 1 -- 172.21.15.16:0/1133149206 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a1c055b40 con 0x55f57a804010 2023-06-08T04:02:16.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.014+0000 7f7a3cadeb80 10 client.4677 fetch_fsmap learned FSMap version 8 2023-06-08T04:02:16.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.015+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1133149206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55f57a6f0b10 con 0x55f57a804010 2023-06-08T04:02:16.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.015+0000 7f7a01ffb700 1 -- 172.21.15.16:0/1133149206 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a18005440 con 0x55f57a804010 2023-06-08T04:02:16.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.015+0000 7f7a01ffb700 1 -- 172.21.15.16:0/1133149206 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7a1c055ca0 con 0x55f57a804010 2023-06-08T04:02:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.015+0000 7f7a3cadeb80 10 client.4677 fetch_fsmap finished waiting for FSMap version 8 2023-06-08T04:02:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.015+0000 7f7a3cadeb80 10 client.4677 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-08T04:02:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.015+0000 7f7a3cadeb80 20 client.4677 populate_metadata read hostname 'smithi016' 2023-06-08T04:02:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.015+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:6834/1286012043,v1:172.21.15.169:6836/1286012043] conn(0x55f57a81c5d0 0x55f57a7d9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.015+0000 7f7a3cadeb80 4 client.4677 mds_command: new command op to 4281 tid=0[{"prefix": "status"}] 2023-06-08T04:02:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.015+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1133149206 --> [v2:172.21.15.169:6834/1286012043,v1:172.21.15.169:6836/1286012043] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f57a7238a0 con 0x55f57a81c5d0 2023-06-08T04:02:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.015+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:6834/1286012043,v1:172.21.15.169:6836/1286012043] conn(0x55f57a81c5d0 0x55f57a7d9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a22d9d700 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:6834/1286012043,v1:172.21.15.169:6836/1286012043] conn(0x55f57a81c5d0 0x55f57a7d9280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4ff4ae735238864 server_cookie=7e5f2bacbaddf0e1 in_seq=0 out_seq=0 2023-06-08T04:02:16.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a01ffb700 10 client.4677 ms_handle_connect on v2:172.21.15.169:6834/1286012043 2023-06-08T04:02:16.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a01ffb700 1 -- 172.21.15.16:0/1133149206 <== mds.0 v2:172.21.15.169:6834/1286012043 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f57a7238a0 con 0x55f57a81c5d0 2023-06-08T04:02:16.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a01ffb700 10 client.4677 handle_command_reply: tid=0 2023-06-08T04:02:16.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a3cadeb80 1 client.4677 shutdown 2023-06-08T04:02:16.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1133149206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 msgr2=0x55f57a7f5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:16.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7f5470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c059a50 tx=0x7f7a1c00b680 comp rx=0 tx=0).stop 2023-06-08T04:02:16.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1133149206 shutdown_connections 2023-06-08T04:02:16.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:6834/1286012043,v1:172.21.15.169:6836/1286012043] conn(0x55f57a81c5d0 0x55f57a7d9280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55f57a804010 0x55f57a7f5470 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55f57a7d6dd0 0x55f57a7d40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a01ffb700 0 client.4677 ms_handle_reset on v2:172.21.15.169:6834/1286012043 2023-06-08T04:02:16.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a3cadeb80 1 --2- 172.21.15.16:0/1133149206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f57a7f8b40 0x55f57a8693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1133149206 >> 172.21.15.16:0/1133149206 conn(0x55f57a7ce430 msgr2=0x55f57a8224f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:16.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.016+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1133149206 shutdown_connections 2023-06-08T04:02:16.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a3cadeb80 1 -- 172.21.15.16:0/1133149206 wait complete. 2023-06-08T04:02:16.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a3cadeb80 20 client.4677 trim_cache size 0 max 16384 2023-06-08T04:02:16.028 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-06-08T04:02:16.028 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "e063be5d-be19-46d2-af9e-e986de4a0b1c", 2023-06-08T04:02:16.028 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2023-06-08T04:02:16.028 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4281, 2023-06-08T04:02:16.029 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2023-06-08T04:02:16.029 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2023-06-08T04:02:16.029 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2023-06-08T04:02:16.029 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 18.729841441000001, 2023-06-08T04:02:16.029 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 8, 2023-06-08T04:02:16.029 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 21, 2023-06-08T04:02:16.029 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 21, 2023-06-08T04:02:16.029 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 25.094258172 2023-06-08T04:02:16.030 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-06-08T04:02:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a291ff700 1 -- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a1006ace0 msgr2=0x7f7a1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:16.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a291ff700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a1006ace0 0x7f7a1006d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7a14007fd0 tx=0x7f7a14007dc0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a291ff700 1 -- 172.21.15.16:0/1758277555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a24160a60 msgr2=0x7f7a241595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a291ff700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a24160a60 0x7f7a241595a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c014040 tx=0x7f7a1c004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a291ff700 1 -- 172.21.15.16:0/1758277555 shutdown_connections 2023-06-08T04:02:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a291ff700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a1006ace0 0x7f7a1006d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a291ff700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a24160a60 0x7f7a241595a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a291ff700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a240b4d20 0x7f7a2415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a291ff700 1 --2- 172.21.15.16:0/1758277555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a240b83f0 0x7f7a2414d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a291ff700 1 -- 172.21.15.16:0/1758277555 >> 172.21.15.16:0/1758277555 conn(0x7f7a240cf610 msgr2=0x7f7a240ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:16.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.017+0000 7f7a291ff700 1 -- 172.21.15.16:0/1758277555 shutdown_connections 2023-06-08T04:02:16.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.018+0000 7f7a291ff700 1 -- 172.21.15.16:0/1758277555 wait complete. 2023-06-08T04:02:16.038 INFO:teuthology.run_tasks:Running task kclient... 2023-06-08T04:02:16.064 INFO:tasks.kclient:Mounting kernel clients... 2023-06-08T04:02:16.064 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-08T04:02:16.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:16.065 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-06-08T04:02:16.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:16.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2023-06-08T04:02:16.185 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2023-06-08T04:02:16.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T04:02:16.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:16.189 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-06-08T04:02:16.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:16.235 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2023-06-08T04:02:16.307 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2023-06-08T04:02:16.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T04:02:16.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:16.310 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2023-06-08T04:02:16.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:16.362 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link delete ceph-brx 2023-06-08T04:02:16.439 INFO:teuthology.orchestra.run.smithi169.stderr:Cannot find device "ceph-brx" 2023-06-08T04:02:16.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T04:02:16.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:16.442 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2023-06-08T04:02:16.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:16.490 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link delete ceph-brx 2023-06-08T04:02:16.561 INFO:teuthology.orchestra.run.smithi169.stderr:Cannot find device "ceph-brx" 2023-06-08T04:02:16.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T04:02:16.564 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-06-08T04:02:16.565 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-08T04:02:16.565 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-08T04:02:16.565 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-08T04:02:16.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.764+0000 7fc58f1ff700 1 Processor -- start 2023-06-08T04:02:16.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.764+0000 7fc58f1ff700 1 -- start start 2023-06-08T04:02:16.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.765+0000 7fc58f1ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc58815a770 0x7fc5880ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.765+0000 7fc58f1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc588161d10 0x7fc5881640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.765+0000 7fc58f1ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc588070c90 con 0x7fc58815ab40 2023-06-08T04:02:16.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.765+0000 7fc58f1ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5880ce620 con 0x7fc58815a770 2023-06-08T04:02:16.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.765+0000 7fc58f1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880cbd30 con 0x7fc588161d10 2023-06-08T04:02:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.766+0000 7fc58cf9b700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc58815a770 0x7fc5880ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.766+0000 7fc58d79c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc588161d10 0x7fc5881640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.766+0000 7fc58d79c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc588161d10 0x7fc5881640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:35622/0 (socket says 172.21.15.16:35622) 2023-06-08T04:02:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.766+0000 7fc58cf9b700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc58815a770 0x7fc5880ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:58760/0 (socket says 172.21.15.16:58760) 2023-06-08T04:02:16.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.766+0000 7fc58d79c700 1 -- 172.21.15.16:0/4231458639 learned_addr learned my addr 172.21.15.16:0/4231458639 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.766+0000 7fc587fff700 1 --1- 172.21.15.16:0/4231458639 >> v1:172.21.15.169:6789/0 conn(0x7fc58815ab40 0x7fc58815afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:38172/0 (socket says 172.21.15.16:38172) 2023-06-08T04:02:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.766+0000 7fc58d79c700 1 -- 172.21.15.16:0/4231458639 >> v2:172.21.15.169:3300/0 conn(0x7fc58815a770 msgr2=0x7fc5880ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.766+0000 7fc58d79c700 1 --2- 172.21.15.16:0/4231458639 >> v2:172.21.15.169:3300/0 conn(0x7fc58815a770 0x7fc5880ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.766+0000 7fc58d79c700 1 -- 172.21.15.16:0/4231458639 >> v1:172.21.15.169:6789/0 conn(0x7fc58815ab40 legacy=0x7fc58815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.766+0000 7fc58d79c700 1 -- 172.21.15.16:0/4231458639 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5880c9110 con 0x7fc588161d10 2023-06-08T04:02:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.766+0000 7fc58cf9b700 1 --2- 172.21.15.16:0/4231458639 >> v2:172.21.15.169:3300/0 conn(0x7fc58815a770 0x7fc5880ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:02:16.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.767+0000 7fc58d79c700 1 --2- 172.21.15.16:0/4231458639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc588161d10 0x7fc5881640f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc580009e50 tx=0x7fc58000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d58a0b9c5ddbdc44 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.767+0000 7fc5877fe700 1 -- 172.21.15.16:0/4231458639 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58000e070 con 0x7fc588161d10 2023-06-08T04:02:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.767+0000 7fc5877fe700 1 -- 172.21.15.16:0/4231458639 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58000b910 con 0x7fc588161d10 2023-06-08T04:02:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.767+0000 7fc5877fe700 1 -- 172.21.15.16:0/4231458639 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58000bcc0 con 0x7fc588161d10 2023-06-08T04:02:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.767+0000 7fc58f1ff700 1 -- 172.21.15.16:0/4231458639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc588161d10 msgr2=0x7fc5881640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:16.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.767+0000 7fc58f1ff700 1 --2- 172.21.15.16:0/4231458639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc588161d10 0x7fc5881640f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc580009e50 tx=0x7fc58000b330 comp rx=0 tx=0).stop 2023-06-08T04:02:16.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.767+0000 7fc58f1ff700 1 -- 172.21.15.16:0/4231458639 shutdown_connections 2023-06-08T04:02:16.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.768+0000 7fc58f1ff700 1 --2- 172.21.15.16:0/4231458639 >> v2:172.21.15.169:3300/0 conn(0x7fc58815a770 0x7fc5880ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.768+0000 7fc58f1ff700 1 --2- 172.21.15.16:0/4231458639 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc588161d10 0x7fc5881640f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.768+0000 7fc58f1ff700 1 -- 172.21.15.16:0/4231458639 >> 172.21.15.16:0/4231458639 conn(0x7fc58806aa40 msgr2=0x7fc5880b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:16.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.768+0000 7fc58f1ff700 1 -- 172.21.15.16:0/4231458639 shutdown_connections 2023-06-08T04:02:16.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.768+0000 7fc58f1ff700 1 -- 172.21.15.16:0/4231458639 wait complete. 2023-06-08T04:02:16.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.770+0000 7fc58f1ff700 1 Processor -- start 2023-06-08T04:02:16.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.770+0000 7fc58f1ff700 1 -- start start 2023-06-08T04:02:16.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.771+0000 7fc58f1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc58815a770 0x7fc5880c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.771+0000 7fc58f1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc58815ab40 0x7fc5881591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58f1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc588161d10 0x7fc588159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58f1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881f5bf0 con 0x7fc588161d10 2023-06-08T04:02:16.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58f1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880c6300 con 0x7fc58815ab40 2023-06-08T04:02:16.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58f1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881f52c0 con 0x7fc58815a770 2023-06-08T04:02:16.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58d79c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc588161d10 0x7fc588159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58cf9b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc58815a770 0x7fc5880c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58cf9b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc58815a770 0x7fc5880c5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:35628/0 (socket says 172.21.15.16:35628) 2023-06-08T04:02:16.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58cf9b700 1 -- 172.21.15.16:0/2693224762 learned_addr learned my addr 172.21.15.16:0/2693224762 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:16.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc587fff700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc58815ab40 0x7fc5881591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58cf9b700 1 -- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc58815ab40 msgr2=0x7fc5881591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:16.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58cf9b700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc58815ab40 0x7fc5881591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58cf9b700 1 -- 172.21.15.16:0/2693224762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc588161d10 msgr2=0x7fc588159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:16.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58cf9b700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc588161d10 0x7fc588159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:16.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.772+0000 7fc58cf9b700 1 -- 172.21.15.16:0/2693224762 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0094a0 con 0x7fc58815a770 2023-06-08T04:02:16.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.773+0000 7fc58cf9b700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc58815a770 0x7fc5880c5840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00ebe0 tx=0x7fc57c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:16.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.773+0000 7fc5857fa700 1 -- 172.21.15.16:0/2693224762 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c009760 con 0x7fc58815a770 2023-06-08T04:02:16.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.773+0000 7fc5857fa700 1 -- 172.21.15.16:0/2693224762 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c00c850 con 0x7fc58815a770 2023-06-08T04:02:16.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.773+0000 7fc58f1ff700 1 -- 172.21.15.16:0/2693224762 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc580009b30 con 0x7fc58815a770 2023-06-08T04:02:16.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.773+0000 7fc5857fa700 1 -- 172.21.15.16:0/2693224762 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00cbe0 con 0x7fc58815a770 2023-06-08T04:02:16.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.773+0000 7fc58f1ff700 1 -- 172.21.15.16:0/2693224762 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5881f5880 con 0x7fc58815a770 2023-06-08T04:02:16.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.774+0000 7fc58f1ff700 1 -- 172.21.15.16:0/2693224762 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58814fe20 con 0x7fc58815a770 2023-06-08T04:02:16.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.775+0000 7fc5857fa700 1 -- 172.21.15.16:0/2693224762 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc57c00cd40 con 0x7fc58815a770 2023-06-08T04:02:16.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.776+0000 7fc5857fa700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc56c06ace0 0x7fc56c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:16.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.776+0000 7fc5857fa700 1 -- 172.21.15.16:0/2693224762 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc57c089810 con 0x7fc58815a770 2023-06-08T04:02:16.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.776+0000 7fc587fff700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc56c06ace0 0x7fc56c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:16.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.777+0000 7fc587fff700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc56c06ace0 0x7fc56c06d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc5880b40e0 tx=0x7fc574007ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:16.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:16.781+0000 7fc5857fa700 1 -- 172.21.15.16:0/2693224762 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc57c0548b0 con 0x7fc58815a770 2023-06-08T04:02:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.033+0000 7fc58f1ff700 1 -- 172.21.15.16:0/2693224762 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc5880740e0 con 0x7fc58815a770 2023-06-08T04:02:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.034+0000 7fc5857fa700 1 -- 172.21.15.16:0/2693224762 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc57c057ed0 con 0x7fc58815a770 2023-06-08T04:02:17.037 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-08T04:02:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 -- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc56c06ace0 msgr2=0x7fc56c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc56c06ace0 0x7fc56c06d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc5880b40e0 tx=0x7fc574007ed0 comp rx=0 tx=0).stop 2023-06-08T04:02:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 -- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc58815a770 msgr2=0x7fc5880c5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc58815a770 0x7fc5880c5840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00ebe0 tx=0x7fc57c00eef0 comp rx=0 tx=0).stop 2023-06-08T04:02:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 -- 172.21.15.16:0/2693224762 shutdown_connections 2023-06-08T04:02:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc56c06ace0 0x7fc56c06d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc588161d10 0x7fc588159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc58815a770 0x7fc5880c5840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 --2- 172.21.15.16:0/2693224762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc58815ab40 0x7fc5881591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 -- 172.21.15.16:0/2693224762 >> 172.21.15.16:0/2693224762 conn(0x7fc58806aa40 msgr2=0x7fc58815cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:17.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 -- 172.21.15.16:0/2693224762 shutdown_connections 2023-06-08T04:02:17.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:17.036+0000 7fc58f1ff700 1 -- 172.21.15.16:0/2693224762 wait complete. 2023-06-08T04:02:17.058 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-08T04:02:17.058 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-08T04:02:17.058 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2023-06-08T04:02:17.059 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-08T04:02:17.059 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-08T04:02:17.059 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-08T04:02:17.059 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-08T04:02:17.059 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-08T04:02:17.059 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-08T04:02:17.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:17.060 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2023-06-08T04:02:17.105 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T04:02:17.105 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T04:02:17.106 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T04:02:17.106 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:17.106 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-06-08T04:02:17.106 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:17.106 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:17.106 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:17.106 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2023-06-08T04:02:17.107 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:17.107 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:17.107 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2023-06-08T04:02:17.107 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-08T04:02:17.107 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:17.107 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2023-06-08T04:02:17.107 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-08T04:02:17.107 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 41971sec preferred_lft 41971sec 2023-06-08T04:02:17.108 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2023-06-08T04:02:17.108 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:17.108 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:17.108 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:17.108 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2023-06-08T04:02:17.109 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-08T04:02:17.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:17.110 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-06-08T04:02:17.110 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-06-08T04:02:17.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2023-06-08T04:02:17.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2023-06-08T04:02:17.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2023-06-08T04:02:17.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-08T04:02:17.111 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-06-08T04:02:17.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:17.540 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-08T04:02:17.653 INFO:teuthology.orchestra.run.smithi016.stdout:1 2023-06-08T04:02:17.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:17.656 DEBUG:teuthology.orchestra.run.smithi016:> route 2023-06-08T04:02:17.730 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2023-06-08T04:02:17.730 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-08T04:02:17.730 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-08T04:02:17.730 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-08T04:02:17.731 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-08T04:02:17.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:17.732 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-06-08T04:02:17.732 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-06-08T04:02:17.732 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-08T04:02:17.733 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-08T04:02:17.733 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-08T04:02:17.733 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-06-08T04:02:18.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:18.421 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-06-08T04:02:18.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:18.468 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2023-06-08T04:02:18.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:18.519 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-06-08T04:02:18.519 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-06-08T04:02:18.519 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-08T04:02:18.520 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-08T04:02:18.520 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-06-08T04:02:18.664 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-08T04:02:18.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:18.665 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-06-08T04:02:18.665 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-06-08T04:02:18.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-08T04:02:18.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-08T04:02:18.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-08T04:02:18.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-08T04:02:18.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-08T04:02:18.667 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-06-08T04:02:18.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:18.942 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-06-08T04:02:18.942 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-06-08T04:02:18.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2023-06-08T04:02:18.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2023-06-08T04:02:18.943 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-06-08T04:02:19.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T04:02:19.123 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-08T04:02:19.168 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-08T04:02:19.169 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T04:02:19.169 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-08T04:02:19.253 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-08T04:02:19.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:19.253 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-08T04:02:19.398 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-08T04:02:19.399 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-08T04:02:19.399 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-06-08T04:02:19.836 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-08T04:02:19.836 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-08T04:02:19.836 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-06-08T04:02:19.836 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.169:3300,172.21.15.169:3301" 2023-06-08T04:02:19.836 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T04:02:19.861 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-08T04:02:19.862 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-08T04:02:19.862 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-06-08T04:02:19.862 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.169:3300,172.21.15.169:3301" 2023-06-08T04:02:19.862 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T04:02:19.862 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.169:6789,172.21.15.169:6790" 2023-06-08T04:02:19.862 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.169:6789,172.21.15.169:6790:/ 2023-06-08T04:02:19.863 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e063be5d-be19-46d2-af9e-e986de4a0b1c" will pass to kernel 2023-06-08T04:02:19.868 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-08T04:02:19.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:19.869 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-08T04:02:19.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:19.940 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:20.065 INFO:teuthology.orchestra.run.smithi016.stdout:client4683 2023-06-08T04:02:20.066 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:02:20.066 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:20.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:20.111 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:20.260 INFO:teuthology.orchestra.run.smithi016.stdout:client4683 2023-06-08T04:02:20.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:20.261 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:20.369 INFO:teuthology.orchestra.run.smithi016.stdout:client4683 2023-06-08T04:02:20.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:20.370 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e063be5d-be19-46d2-af9e-e986de4a0b1c.client4683/status') 2023-06-08T04:02:20.496 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.4683 (3)192.168.0.1:0/905175413 2023-06-08T04:02:20.497 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2023-06-08T04:02:20.497 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2023-06-08T04:02:20.497 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2023-06-08T04:02:20.498 INFO:teuthology.orchestra.run.smithi016.stderr:68 bytes copied, 6.3218e-05 s, 1.1 MB/s 2023-06-08T04:02:20.499 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-06-08T04:02:20.499 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-08T04:02:20.500 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-08T04:02:20.500 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-08T04:02:20.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.697+0000 7fe6de3ff700 1 Processor -- start 2023-06-08T04:02:20.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.697+0000 7fe6de3ff700 1 -- start start 2023-06-08T04:02:20.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.698+0000 7fe6de3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80b83f0 0x7fe6d8160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:20.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.698+0000 7fe6de3ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe6d80b4d20 0x7fe6d80d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:20.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.698+0000 7fe6de3ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d80d0800 con 0x7fe6d80ced40 2023-06-08T04:02:20.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.698+0000 7fe6de3ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d80cd1e0 con 0x7fe6d80b4d20 2023-06-08T04:02:20.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.698+0000 7fe6de3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80cd4c0 con 0x7fe6d80b83f0 2023-06-08T04:02:20.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6cffff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe6d80ced40 0x7fe6d80b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59452/0 (socket says 172.21.15.16:59452) 2023-06-08T04:02:20.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6cffff700 1 -- 172.21.15.16:0/2860633847 learned_addr learned my addr 172.21.15.16:0/2860633847 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:20.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6d7fff700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80b83f0 0x7fe6d8160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:20.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6dc99c700 1 --2- 172.21.15.16:0/2860633847 >> v2:172.21.15.169:3300/0 conn(0x7fe6d80b4d20 0x7fe6d80d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:20.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399256408 0 0) 0x7fe6d80d0800 con 0x7fe6d80ced40 2023-06-08T04:02:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c40035b0 con 0x7fe6d80ced40 2023-06-08T04:02:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4293026928 0 0) 0x7fe6c40035b0 con 0x7fe6d80ced40 2023-06-08T04:02:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80b83f0 msgr2=0x7fe6d8160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6d77fe700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80b83f0 0x7fe6d8160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 >> v2:172.21.15.169:3300/0 conn(0x7fe6d80b4d20 msgr2=0x7fe6d80d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6d77fe700 1 --2- 172.21.15.16:0/2860633847 >> v2:172.21.15.169:3300/0 conn(0x7fe6d80b4d20 0x7fe6d80d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d80d0aa0 con 0x7fe6d80ced40 2023-06-08T04:02:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.699+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7fe6c0001670 con 0x7fe6d80ced40 2023-06-08T04:02:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 >> v1:172.21.15.16:6789/0 conn(0x7fe6d80ced40 legacy=0x7fe6d80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6d77fe700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80b83f0 0x7fe6c4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6d77fe700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 0x7fe6c4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6d77fe700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6c4004d90 0x7fe6c4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80cd1e0 con 0x7fe6c4003f80 2023-06-08T04:02:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80cd4c0 con 0x7fe6c4004d90 2023-06-08T04:02:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c400ba40 con 0x7fe6d80b83f0 2023-06-08T04:02:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6cffff700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 0x7fe6c4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6d7fff700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80b83f0 0x7fe6c4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6dc99c700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6c4004d90 0x7fe6c4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6cffff700 1 -- 172.21.15.16:0/2860633847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80b83f0 msgr2=0x7fe6c4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6cffff700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80b83f0 0x7fe6c4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6cffff700 1 -- 172.21.15.16:0/2860633847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6c4004d90 msgr2=0x7fe6c4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6cffff700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6c4004d90 0x7fe6c4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:20.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.700+0000 7fe6cffff700 1 -- 172.21.15.16:0/2860633847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c40035b0 con 0x7fe6c4003f80 2023-06-08T04:02:20.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.701+0000 7fe6cffff700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 0x7fe6c4004850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000c320 tx=0x7fe6c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd95f0f4c7a8799a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:20.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.701+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c000ce00 con 0x7fe6c4003f80 2023-06-08T04:02:20.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.701+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c0005960 con 0x7fe6c4003f80 2023-06-08T04:02:20.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.701+0000 7fe6d77fe700 1 -- 172.21.15.16:0/2860633847 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0005d10 con 0x7fe6c4003f80 2023-06-08T04:02:20.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.701+0000 7fe6de3ff700 1 -- 172.21.15.16:0/2860633847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 msgr2=0x7fe6c4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:20.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.701+0000 7fe6de3ff700 1 --2- 172.21.15.16:0/2860633847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 0x7fe6c4004850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe6c000c320 tx=0x7fe6c4005880 comp rx=0 tx=0).stop 2023-06-08T04:02:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.701+0000 7fe6dc99c700 1 -- 172.21.15.16:0/2860633847 reap_dead start 2023-06-08T04:02:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.701+0000 7fe6de3ff700 1 -- 172.21.15.16:0/2860633847 shutdown_connections 2023-06-08T04:02:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.701+0000 7fe6de3ff700 1 -- 172.21.15.16:0/2860633847 >> 172.21.15.16:0/2860633847 conn(0x7fe6d80cf610 msgr2=0x7fe6d80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.701+0000 7fe6de3ff700 1 -- 172.21.15.16:0/2860633847 shutdown_connections 2023-06-08T04:02:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.702+0000 7fe6de3ff700 1 -- 172.21.15.16:0/2860633847 wait complete. 2023-06-08T04:02:20.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.703+0000 7fe6de3ff700 1 Processor -- start 2023-06-08T04:02:20.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.704+0000 7fe6de3ff700 1 -- start start 2023-06-08T04:02:20.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6de3ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 0x7fe6d81f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:20.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6de3ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6d80c9c60 0x7fe6d80b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:20.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6de3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80c8640 0x7fe6d80c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:20.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6de3ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80c9020 con 0x7fe6c4003f80 2023-06-08T04:02:20.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6de3ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d81f66e0 con 0x7fe6d80c9c60 2023-06-08T04:02:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6de3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80cb200 con 0x7fe6d80c8640 2023-06-08T04:02:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6d7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 0x7fe6d81f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6d7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 0x7fe6d81f61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48124/0 (socket says 172.21.15.16:48124) 2023-06-08T04:02:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6d7fff700 1 -- 172.21.15.16:0/3671273986 learned_addr learned my addr 172.21.15.16:0/3671273986 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6cffff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6d80c9c60 0x7fe6d80b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6dc99c700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80c8640 0x7fe6d80c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6d7fff700 1 -- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80c8640 msgr2=0x7fe6d80c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:20.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6d7fff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80c8640 0x7fe6d80c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:20.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6d7fff700 1 -- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6d80c9c60 msgr2=0x7fe6d80b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:20.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6d7fff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6d80c9c60 0x7fe6d80b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:20.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6d7fff700 1 -- 172.21.15.16:0/3671273986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8157840 con 0x7fe6c4003f80 2023-06-08T04:02:20.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.705+0000 7fe6d7fff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 0x7fe6d81f61a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8011aa0 tx=0x7fe6c8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:20.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.706+0000 7fe6d57fa700 1 -- 172.21.15.16:0/3671273986 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800f980 con 0x7fe6c4003f80 2023-06-08T04:02:20.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.706+0000 7fe6d57fa700 1 -- 172.21.15.16:0/3671273986 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c800fae0 con 0x7fe6c4003f80 2023-06-08T04:02:20.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.706+0000 7fe6d57fa700 1 -- 172.21.15.16:0/3671273986 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c800fe90 con 0x7fe6c4003f80 2023-06-08T04:02:20.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.706+0000 7fe6de3ff700 1 -- 172.21.15.16:0/3671273986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d80ca160 con 0x7fe6c4003f80 2023-06-08T04:02:20.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.706+0000 7fe6de3ff700 1 -- 172.21.15.16:0/3671273986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d80ca720 con 0x7fe6c4003f80 2023-06-08T04:02:20.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.707+0000 7fe6de3ff700 1 -- 172.21.15.16:0/3671273986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d80b23b0 con 0x7fe6c4003f80 2023-06-08T04:02:20.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.708+0000 7fe6d57fa700 1 -- 172.21.15.16:0/3671273986 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe6c8014440 con 0x7fe6c4003f80 2023-06-08T04:02:20.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.709+0000 7fe6d57fa700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe6b806ace0 0x7fe6b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:20.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.709+0000 7fe6d57fa700 1 -- 172.21.15.16:0/3671273986 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6c8089c50 con 0x7fe6c4003f80 2023-06-08T04:02:20.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.709+0000 7fe6cffff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe6b806ace0 0x7fe6b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:20.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.710+0000 7fe6cffff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe6b806ace0 0x7fe6b806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0000c00 tx=0x7fe6c000a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:20.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.713+0000 7fe6d57fa700 1 -- 172.21.15.16:0/3671273986 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe6c8054d20 con 0x7fe6c4003f80 2023-06-08T04:02:20.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.969+0000 7fe6de3ff700 1 -- 172.21.15.16:0/3671273986 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6d80740e0 con 0x7fe6c4003f80 2023-06-08T04:02:20.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.969+0000 7fe6d57fa700 1 -- 172.21.15.16:0/3671273986 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe6c8022070 con 0x7fe6c4003f80 2023-06-08T04:02:20.973 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-08T04:02:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.971+0000 7fe6de3ff700 1 -- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe6b806ace0 msgr2=0x7fe6b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.971+0000 7fe6de3ff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe6b806ace0 0x7fe6b806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0000c00 tx=0x7fe6c000a000 comp rx=0 tx=0).stop 2023-06-08T04:02:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.971+0000 7fe6de3ff700 1 -- 172.21.15.16:0/3671273986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 msgr2=0x7fe6d81f61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.971+0000 7fe6de3ff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 0x7fe6d81f61a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8011aa0 tx=0x7fe6c8011e60 comp rx=0 tx=0).stop 2023-06-08T04:02:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.971+0000 7fe6de3ff700 1 -- 172.21.15.16:0/3671273986 shutdown_connections 2023-06-08T04:02:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.971+0000 7fe6de3ff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe6b806ace0 0x7fe6b806d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.971+0000 7fe6de3ff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6d80c8640 0x7fe6d80c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.971+0000 7fe6de3ff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6c4003f80 0x7fe6d81f61a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:20.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.971+0000 7fe6de3ff700 1 --2- 172.21.15.16:0/3671273986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6d80c9c60 0x7fe6d80b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:20.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.971+0000 7fe6de3ff700 1 -- 172.21.15.16:0/3671273986 >> 172.21.15.16:0/3671273986 conn(0x7fe6d80cf610 msgr2=0x7fe6d8158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:20.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.972+0000 7fe6de3ff700 1 -- 172.21.15.16:0/3671273986 shutdown_connections 2023-06-08T04:02:20.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:20.972+0000 7fe6de3ff700 1 -- 172.21.15.16:0/3671273986 wait complete. 2023-06-08T04:02:20.993 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-08T04:02:20.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-08T04:02:20.993 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2023-06-08T04:02:20.994 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-08T04:02:20.994 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-08T04:02:20.994 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-08T04:02:20.994 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-08T04:02:20.994 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-08T04:02:20.995 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-08T04:02:20.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:20.995 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2023-06-08T04:02:21.041 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T04:02:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T04:02:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T04:02:21.041 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-06-08T04:02:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.042 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2023-06-08T04:02:21.042 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:21.042 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2023-06-08T04:02:21.043 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-08T04:02:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2023-06-08T04:02:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-08T04:02:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 41967sec preferred_lft 41967sec 2023-06-08T04:02:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2023-06-08T04:02:21.043 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.044 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2023-06-08T04:02:21.044 INFO:teuthology.orchestra.run.smithi016.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T04:02:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 7a:5e:3d:99:68:e0 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-08T04:02:21.044 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::868:a5ff:febc:6f06/64 scope link 2023-06-08T04:02:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.045 INFO:teuthology.orchestra.run.smithi016.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-08T04:02:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 7a:5e:3d:99:68:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-08T04:02:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::785e:3dff:fe99:68e0/64 scope link 2023-06-08T04:02:21.045 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:21.046 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-08T04:02:21.113 INFO:teuthology.orchestra.run.smithi016.stdout:1 2023-06-08T04:02:21.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:21.116 DEBUG:teuthology.orchestra.run.smithi016:> route 2023-06-08T04:02:21.165 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2023-06-08T04:02:21.165 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-08T04:02:21.165 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-08T04:02:21.165 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-08T04:02:21.165 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-08T04:02:21.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:21.166 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-06-08T04:02:21.167 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-06-08T04:02:21.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-08T04:02:21.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-08T04:02:21.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-08T04:02:21.167 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-06-08T04:02:21.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:21.341 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-06-08T04:02:21.386 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-08T04:02:21.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:21.388 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2023-06-08T04:02:21.433 INFO:teuthology.orchestra.run.smithi016.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-08T04:02:21.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:21.434 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-06-08T04:02:21.435 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-06-08T04:02:21.435 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-08T04:02:21.435 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-08T04:02:21.435 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-06-08T04:02:21.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:21.616 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-08T04:02:21.687 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T04:02:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T04:02:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T04:02:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-06-08T04:02:21.688 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.688 INFO:teuthology.orchestra.run.smithi016.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T04:02:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether ee:bf:20:ef:6e:1f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-08T04:02:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-08T04:02:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ecbf:20ff:feef:6e1f/64 scope link 2023-06-08T04:02:21.689 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:21.691 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-08T04:02:21.761 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T04:02:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T04:02:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T04:02:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-06-08T04:02:21.762 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.762 INFO:teuthology.orchestra.run.smithi016.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T04:02:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether ee:bf:20:ef:6e:1f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-08T04:02:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-08T04:02:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ecbf:20ff:feef:6e1f/64 scope link 2023-06-08T04:02:21.763 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:21.764 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-08T04:02:21.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:21.765 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-06-08T04:02:21.765 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-06-08T04:02:21.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-08T04:02:21.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-08T04:02:21.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-08T04:02:21.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-08T04:02:21.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-08T04:02:21.767 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-06-08T04:02:22.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:22.010 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-06-08T04:02:22.011 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-06-08T04:02:22.011 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.1 up 2023-06-08T04:02:22.011 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.1 master ceph-brx 2023-06-08T04:02:22.011 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-06-08T04:02:22.191 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T04:02:22.191 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-08T04:02:22.237 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-08T04:02:22.237 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T04:02:22.238 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-08T04:02:22.322 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-08T04:02:22.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:22.322 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-08T04:02:22.468 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-08T04:02:22.468 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-06-08T04:02:22.469 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-06-08T04:02:22.484 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-08T04:02:22.485 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-06-08T04:02:22.485 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-06-08T04:02:22.485 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.169:3300,172.21.15.169:3301" 2023-06-08T04:02:22.485 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T04:02:22.507 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-08T04:02:22.507 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-06-08T04:02:22.507 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-06-08T04:02:22.507 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.169:3300,172.21.15.169:3301" 2023-06-08T04:02:22.508 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T04:02:22.508 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.169:6789,172.21.15.169:6790" 2023-06-08T04:02:22.508 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.169:6789,172.21.15.169:6790:/ 2023-06-08T04:02:22.508 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=e063be5d-be19-46d2-af9e-e986de4a0b1c" will pass to kernel 2023-06-08T04:02:22.513 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-08T04:02:22.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:22.513 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-08T04:02:22.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:22.583 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:22.671 INFO:teuthology.orchestra.run.smithi016.stdout:client4550 2023-06-08T04:02:22.671 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:02:22.671 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:22.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:22.717 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:22.843 INFO:teuthology.orchestra.run.smithi016.stdout:client4550 2023-06-08T04:02:22.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:22.844 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:22.932 INFO:teuthology.orchestra.run.smithi016.stdout:client4550 2023-06-08T04:02:22.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:22.933 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e063be5d-be19-46d2-af9e-e986de4a0b1c.client4550/status') 2023-06-08T04:02:23.040 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.4550 (3)172.21.15.16:0/2254396434 2023-06-08T04:02:23.040 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2023-06-08T04:02:23.040 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2023-06-08T04:02:23.040 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2023-06-08T04:02:23.041 INFO:teuthology.orchestra.run.smithi016.stderr:70 bytes copied, 5.4633e-05 s, 1.3 MB/s 2023-06-08T04:02:23.042 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-06-08T04:02:23.043 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-08T04:02:23.043 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-08T04:02:23.043 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-08T04:02:23.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.240+0000 7f63097ff700 1 Processor -- start 2023-06-08T04:02:23.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.240+0000 7f63097ff700 1 -- start start 2023-06-08T04:02:23.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.241+0000 7f63097ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6304160a60 0x7f63040b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:23.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.241+0000 7f63097ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f63040b4b50 0x7f63040d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:23.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.241+0000 7f63097ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63040d0800 con 0x7f63040b83f0 2023-06-08T04:02:23.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.241+0000 7f63097ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6304160ed0 con 0x7f63040b4b50 2023-06-08T04:02:23.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.241+0000 7f63097ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63040b4fd0 con 0x7f6304160a60 2023-06-08T04:02:23.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f6302ffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f63040b83f0 0x7f63040ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43880/0 (socket says 172.21.15.16:43880) 2023-06-08T04:02:23.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f6302ffd700 1 -- 172.21.15.16:0/2037333308 learned_addr learned my addr 172.21.15.16:0/2037333308 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:23.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910753662 0 0) 0x7f63040d0800 con 0x7f63040b83f0 2023-06-08T04:02:23.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f00035b0 con 0x7f63040b83f0 2023-06-08T04:02:23.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f63037fe700 1 --2- 172.21.15.16:0/2037333308 >> v2:172.21.15.169:3300/0 conn(0x7f63040b4b50 0x7f63040d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:23.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f62fbfff700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6304160a60 0x7f63040b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:23.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 979741123 0 0) 0x7f62f00035b0 con 0x7f63040b83f0 2023-06-08T04:02:23.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6304160a60 msgr2=0x7f63040b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:23.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f63027fc700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6304160a60 0x7f63040b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:23.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 >> v2:172.21.15.169:3300/0 conn(0x7f63040b4b50 msgr2=0x7f63040d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:23.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f63027fc700 1 --2- 172.21.15.16:0/2037333308 >> v2:172.21.15.169:3300/0 conn(0x7f63040b4b50 0x7f63040d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:23.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63040cd1e0 con 0x7f63040b83f0 2023-06-08T04:02:23.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.242+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7f62f4001670 con 0x7f63040b83f0 2023-06-08T04:02:23.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 >> v1:172.21.15.16:6789/0 conn(0x7f63040b83f0 legacy=0x7f63040ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:23.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f63027fc700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62f0003a00 0x7f62f0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:23.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f63027fc700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f0004850 0x7f62f0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:23.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f63027fc700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6304160a60 0x7f62f0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:23.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63040b4fd0 con 0x7f62f0003a00 2023-06-08T04:02:23.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f000ba10 con 0x7f62f0004850 2023-06-08T04:02:23.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f000bb80 con 0x7f6304160a60 2023-06-08T04:02:23.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f6302ffd700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62f0003a00 0x7f62f0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:23.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f62fbfff700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f0004850 0x7f62f0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:23.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f63037fe700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6304160a60 0x7f62f0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:23.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f6302ffd700 1 -- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6304160a60 msgr2=0x7f62f0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:23.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f6302ffd700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6304160a60 0x7f62f0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:23.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f6302ffd700 1 -- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f0004850 msgr2=0x7f62f0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:23.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f6302ffd700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f0004850 0x7f62f0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:23.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f6302ffd700 1 -- 172.21.15.16:0/2037333308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f00035b0 con 0x7f62f0003a00 2023-06-08T04:02:23.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f62fbfff700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62f0004850 0x7f62f0004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:23.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.243+0000 7f6302ffd700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62f0003a00 0x7f62f0003e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f62f400c190 tx=0x7f62f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b33a5084a6378b3 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:23.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.244+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4007b70 con 0x7f62f0003a00 2023-06-08T04:02:23.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.244+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f400cd30 con 0x7f62f0003a00 2023-06-08T04:02:23.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.244+0000 7f63027fc700 1 -- 172.21.15.16:0/2037333308 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f400cea0 con 0x7f62f0003a00 2023-06-08T04:02:23.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.244+0000 7f63097ff700 1 -- 172.21.15.16:0/2037333308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62f0003a00 msgr2=0x7f62f0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:23.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.244+0000 7f63097ff700 1 --2- 172.21.15.16:0/2037333308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62f0003a00 0x7f62f0003e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f62f400c190 tx=0x7f62f0005880 comp rx=0 tx=0).stop 2023-06-08T04:02:23.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.244+0000 7f63037fe700 1 -- 172.21.15.16:0/2037333308 reap_dead start 2023-06-08T04:02:23.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.244+0000 7f63097ff700 1 -- 172.21.15.16:0/2037333308 shutdown_connections 2023-06-08T04:02:23.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.244+0000 7f63097ff700 1 -- 172.21.15.16:0/2037333308 >> 172.21.15.16:0/2037333308 conn(0x7f63040cf610 msgr2=0x7f63040cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:23.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.244+0000 7f63097ff700 1 -- 172.21.15.16:0/2037333308 shutdown_connections 2023-06-08T04:02:23.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.244+0000 7f63097ff700 1 -- 172.21.15.16:0/2037333308 wait complete. 2023-06-08T04:02:23.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.246+0000 7f63097ff700 1 Processor -- start 2023-06-08T04:02:23.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.246+0000 7f63097ff700 1 -- start start 2023-06-08T04:02:23.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.247+0000 7f63097ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62f0003a00 0x7f63040b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:23.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.247+0000 7f63097ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63040b5ca0 0x7f63040b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:23.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.247+0000 7f63097ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f630414bce0 0x7f630414c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:23.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.247+0000 7f63097ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63040b6650 con 0x7f63040b5ca0 2023-06-08T04:02:23.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.247+0000 7f63097ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63040b15d0 con 0x7f630414bce0 2023-06-08T04:02:23.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.247+0000 7f63097ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6304149ba0 con 0x7f62f0003a00 2023-06-08T04:02:23.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.247+0000 7f62fbfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63040b5ca0 0x7f63040b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:23.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f62fbfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63040b5ca0 0x7f63040b6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37994/0 (socket says 172.21.15.16:37994) 2023-06-08T04:02:23.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f62fbfff700 1 -- 172.21.15.16:0/2359659816 learned_addr learned my addr 172.21.15.16:0/2359659816 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:23.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f6302ffd700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62f0003a00 0x7f63040b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:23.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f63037fe700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f630414bce0 0x7f630414c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:23.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f62fbfff700 1 -- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62f0003a00 msgr2=0x7f63040b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:23.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f62fbfff700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62f0003a00 0x7f63040b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:23.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f62fbfff700 1 -- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f630414bce0 msgr2=0x7f630414c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:23.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f62fbfff700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f630414bce0 0x7f630414c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:23.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f62fbfff700 1 -- 172.21.15.16:0/2359659816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304149e80 con 0x7f63040b5ca0 2023-06-08T04:02:23.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f62fbfff700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63040b5ca0 0x7f63040b6110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f62ec010880 tx=0x7f62ec010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:23.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f62fb7fe700 1 -- 172.21.15.16:0/2359659816 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec010e80 con 0x7f63040b5ca0 2023-06-08T04:02:23.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f62fb7fe700 1 -- 172.21.15.16:0/2359659816 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec004020 con 0x7f63040b5ca0 2023-06-08T04:02:23.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f62fb7fe700 1 -- 172.21.15.16:0/2359659816 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0043b0 con 0x7f63040b5ca0 2023-06-08T04:02:23.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.248+0000 7f63097ff700 1 -- 172.21.15.16:0/2359659816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630414a160 con 0x7f63040b5ca0 2023-06-08T04:02:23.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.249+0000 7f63097ff700 1 -- 172.21.15.16:0/2359659816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63040ca630 con 0x7f63040b5ca0 2023-06-08T04:02:23.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.250+0000 7f63097ff700 1 -- 172.21.15.16:0/2359659816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63040740e0 con 0x7f63040b5ca0 2023-06-08T04:02:23.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.251+0000 7f62fb7fe700 1 -- 172.21.15.16:0/2359659816 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62ec00e870 con 0x7f63040b5ca0 2023-06-08T04:02:23.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.252+0000 7f62fb7fe700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f62e406ace0 0x7f62e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:23.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.252+0000 7f62fb7fe700 1 -- 172.21.15.16:0/2359659816 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62ec089770 con 0x7f63040b5ca0 2023-06-08T04:02:23.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.252+0000 7f6302ffd700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f62e406ace0 0x7f62e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:23.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.253+0000 7f6302ffd700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f62e406ace0 0x7f62e406d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f62f4015040 tx=0x7f62f400a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:23.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.257+0000 7f62fb7fe700 1 -- 172.21.15.16:0/2359659816 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f62ec0582b0 con 0x7f63040b5ca0 2023-06-08T04:02:23.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.513+0000 7f63097ff700 1 -- 172.21.15.16:0/2359659816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f630406c000 con 0x7f63040b5ca0 2023-06-08T04:02:23.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.513+0000 7f62fb7fe700 1 -- 172.21.15.16:0/2359659816 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f62ec057e40 con 0x7f63040b5ca0 2023-06-08T04:02:23.518 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-08T04:02:23.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 -- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f62e406ace0 msgr2=0x7f62e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:23.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f62e406ace0 0x7f62e406d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f62f4015040 tx=0x7f62f400a000 comp rx=0 tx=0).stop 2023-06-08T04:02:23.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 -- 172.21.15.16:0/2359659816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63040b5ca0 msgr2=0x7f63040b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:23.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63040b5ca0 0x7f63040b6110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f62ec010880 tx=0x7f62ec010c40 comp rx=0 tx=0).stop 2023-06-08T04:02:23.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 -- 172.21.15.16:0/2359659816 shutdown_connections 2023-06-08T04:02:23.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f62e406ace0 0x7f62e406d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:23.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f630414bce0 0x7f630414c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:23.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62f0003a00 0x7f63040b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:23.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 --2- 172.21.15.16:0/2359659816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63040b5ca0 0x7f63040b6110 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:23.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 -- 172.21.15.16:0/2359659816 >> 172.21.15.16:0/2359659816 conn(0x7f63040cf610 msgr2=0x7f63040b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:23.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 -- 172.21.15.16:0/2359659816 shutdown_connections 2023-06-08T04:02:23.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:23.516+0000 7f63097ff700 1 -- 172.21.15.16:0/2359659816 wait complete. 2023-06-08T04:02:23.537 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-08T04:02:23.538 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-08T04:02:23.538 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi169.front.sepia.ceph.com 2023-06-08T04:02:23.538 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-08T04:02:23.538 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-08T04:02:23.539 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-08T04:02:23.539 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-08T04:02:23.539 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-08T04:02:23.539 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-08T04:02:23.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:23.540 DEBUG:teuthology.orchestra.run.smithi169:> ip addr 2023-06-08T04:02:23.591 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T04:02:23.591 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T04:02:23.591 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T04:02:23.591 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:23.592 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2023-06-08T04:02:23.592 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:23.592 INFO:teuthology.orchestra.run.smithi169.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:23.592 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b4 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:23.592 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f0 2023-06-08T04:02:23.592 INFO:teuthology.orchestra.run.smithi169.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:23.593 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b5 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:23.593 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f1 2023-06-08T04:02:23.593 INFO:teuthology.orchestra.run.smithi169.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:23.593 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4c brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:23.594 INFO:teuthology.orchestra.run.smithi169.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-08T04:02:23.594 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4d brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:23.594 INFO:teuthology.orchestra.run.smithi169.stdout: inet 172.21.15.169/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-08T04:02:23.594 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft 41964sec preferred_lft 41964sec 2023-06-08T04:02:23.594 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::ec4:7aff:fe88:7f4d/64 scope link 2023-06-08T04:02:23.594 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:23.595 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-08T04:02:23.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:23.596 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2023-06-08T04:02:23.596 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2023-06-08T04:02:23.596 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add name ceph-brx type bridge 2023-06-08T04:02:23.596 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip addr flush dev ceph-brx 2023-06-08T04:02:23.597 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set ceph-brx up 2023-06-08T04:02:23.597 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-08T04:02:23.597 DEBUG:teuthology.orchestra.run.smithi169:> ') 2023-06-08T04:02:24.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:24.013 DEBUG:teuthology.orchestra.run.smithi169:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-08T04:02:24.122 INFO:teuthology.orchestra.run.smithi169.stdout:1 2023-06-08T04:02:24.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:24.125 DEBUG:teuthology.orchestra.run.smithi169:> route 2023-06-08T04:02:24.192 INFO:teuthology.orchestra.run.smithi169.stdout:Kernel IP routing table 2023-06-08T04:02:24.192 INFO:teuthology.orchestra.run.smithi169.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-08T04:02:24.192 INFO:teuthology.orchestra.run.smithi169.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-08T04:02:24.193 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-08T04:02:24.193 INFO:teuthology.orchestra.run.smithi169.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-08T04:02:24.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:24.194 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2023-06-08T04:02:24.194 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2023-06-08T04:02:24.194 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-08T04:02:24.195 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-08T04:02:24.195 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-08T04:02:24.195 DEBUG:teuthology.orchestra.run.smithi169:> ') 2023-06-08T04:02:24.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:24.860 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2023-06-08T04:02:24.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:24.907 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list-id 2023-06-08T04:02:24.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:24.954 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2023-06-08T04:02:24.955 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2023-06-08T04:02:24.955 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-08T04:02:24.955 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-08T04:02:24.955 DEBUG:teuthology.orchestra.run.smithi169:> ') 2023-06-08T04:02:25.136 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-08T04:02:25.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:25.136 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2023-06-08T04:02:25.137 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2023-06-08T04:02:25.137 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-08T04:02:25.137 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-08T04:02:25.137 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-08T04:02:25.138 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-08T04:02:25.138 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-08T04:02:25.138 DEBUG:teuthology.orchestra.run.smithi169:> ') 2023-06-08T04:02:25.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:25.445 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2023-06-08T04:02:25.445 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2023-06-08T04:02:25.445 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set brx.0 up 2023-06-08T04:02:25.446 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set dev brx.0 master ceph-brx 2023-06-08T04:02:25.446 DEBUG:teuthology.orchestra.run.smithi169:> ') 2023-06-08T04:02:25.624 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T04:02:25.624 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-08T04:02:25.670 INFO:teuthology.orchestra.run.smithi169.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-08T04:02:25.670 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T04:02:25.670 DEBUG:teuthology.orchestra.run.smithi169:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-08T04:02:25.754 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-08T04:02:25.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:25.755 DEBUG:teuthology.orchestra.run.smithi169:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-08T04:02:25.900 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-08T04:02:25.900 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-06-08T04:02:25.900 INFO:teuthology.orchestra.run.smithi169.stdout:invalid new device string format 2023-06-08T04:02:26.335 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-08T04:02:26.335 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-06-08T04:02:26.335 INFO:teuthology.orchestra.run.smithi169.stdout:invalid new device string format 2023-06-08T04:02:26.335 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.169:3300,172.21.15.169:3301" 2023-06-08T04:02:26.335 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T04:02:26.358 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-08T04:02:26.358 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-06-08T04:02:26.359 INFO:teuthology.orchestra.run.smithi169.stdout:invalid new device string format 2023-06-08T04:02:26.359 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.169:3300,172.21.15.169:3301" 2023-06-08T04:02:26.359 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T04:02:26.359 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.169:6789,172.21.15.169:6790" 2023-06-08T04:02:26.359 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.169:6789,172.21.15.169:6790:/ 2023-06-08T04:02:26.359 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=e063be5d-be19-46d2-af9e-e986de4a0b1c" will pass to kernel 2023-06-08T04:02:26.363 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-08T04:02:26.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:26.364 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-08T04:02:26.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:26.433 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:26.568 INFO:teuthology.orchestra.run.smithi169.stdout:client4657 2023-06-08T04:02:26.569 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:02:26.569 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:26.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:26.615 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:26.742 INFO:teuthology.orchestra.run.smithi169.stdout:client4657 2023-06-08T04:02:26.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:26.743 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:26.830 INFO:teuthology.orchestra.run.smithi169.stdout:client4657 2023-06-08T04:02:26.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:26.830 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e063be5d-be19-46d2-af9e-e986de4a0b1c.client4657/status') 2023-06-08T04:02:26.939 INFO:teuthology.orchestra.run.smithi169.stdout:instance: client.4657 (3)192.168.0.1:0/4087893289 2023-06-08T04:02:26.939 INFO:teuthology.orchestra.run.smithi169.stdout:blocklisted: false 2023-06-08T04:02:26.939 INFO:teuthology.orchestra.run.smithi169.stderr:0+1 records in 2023-06-08T04:02:26.939 INFO:teuthology.orchestra.run.smithi169.stderr:0+1 records out 2023-06-08T04:02:26.939 INFO:teuthology.orchestra.run.smithi169.stderr:69 bytes copied, 5.5318e-05 s, 1.2 MB/s 2023-06-08T04:02:26.941 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-06-08T04:02:26.942 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-08T04:02:26.942 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-08T04:02:26.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-08T04:02:27.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.149+0000 7efe5dfff700 1 Processor -- start 2023-06-08T04:02:27.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.149+0000 7efe5dfff700 1 -- start start 2023-06-08T04:02:27.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.151+0000 7efe5dfff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efe580b4d20 0x7efe58167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:27.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.151+0000 7efe5dfff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe580d0800 con 0x7efe580b83f0 2023-06-08T04:02:27.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.151+0000 7efe5dfff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe580cd1e0 con 0x7efe58160a60 2023-06-08T04:02:27.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.151+0000 7efe5dfff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe58160ed0 con 0x7efe580b4d20 2023-06-08T04:02:27.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.151+0000 7efe577fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7efe580b83f0 0x7efe580ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43884/0 (socket says 172.21.15.16:43884) 2023-06-08T04:02:27.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.151+0000 7efe577fe700 1 -- 172.21.15.16:0/3549209375 learned_addr learned my addr 172.21.15.16:0/3549209375 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:27.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.152+0000 7efe57fff700 1 --2- 172.21.15.16:0/3549209375 >> v2:172.21.15.169:3300/0 conn(0x7efe580b4d20 0x7efe58167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:27.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.152+0000 7efe567fc700 1 -- 172.21.15.16:0/3549209375 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056627591 0 0) 0x7efe580d0800 con 0x7efe580b83f0 2023-06-08T04:02:27.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.152+0000 7efe567fc700 1 -- 172.21.15.16:0/3549209375 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe400035b0 con 0x7efe580b83f0 2023-06-08T04:02:27.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.152+0000 7efe567fc700 1 -- 172.21.15.16:0/3549209375 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467114576 0 0) 0x7efe580cd1e0 con 0x7efe58160a60 2023-06-08T04:02:27.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.152+0000 7efe567fc700 1 -- 172.21.15.16:0/3549209375 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe580d0800 con 0x7efe58160a60 2023-06-08T04:02:27.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.152+0000 7efe57fff700 1 -- 172.21.15.16:0/3549209375 >> v1:172.21.15.169:6789/0 conn(0x7efe58160a60 legacy=0x7efe580b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:27.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.152+0000 7efe57fff700 1 -- 172.21.15.16:0/3549209375 >> v1:172.21.15.16:6789/0 conn(0x7efe580b83f0 legacy=0x7efe580ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:27.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.152+0000 7efe57fff700 1 -- 172.21.15.16:0/3549209375 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe580cd4c0 con 0x7efe580b4d20 2023-06-08T04:02:27.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.152+0000 7efe57fff700 1 --2- 172.21.15.16:0/3549209375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe580b4d20 0x7efe58167260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe50009d90 tx=0x7efe5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f22f08b593112f85 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:27.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.153+0000 7efe567fc700 1 -- 172.21.15.16:0/3549209375 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5000e070 con 0x7efe580b4d20 2023-06-08T04:02:27.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.153+0000 7efe567fc700 1 -- 172.21.15.16:0/3549209375 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5000bb20 con 0x7efe580b4d20 2023-06-08T04:02:27.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.153+0000 7efe567fc700 1 -- 172.21.15.16:0/3549209375 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50012430 con 0x7efe580b4d20 2023-06-08T04:02:27.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.153+0000 7efe5dfff700 1 -- 172.21.15.16:0/3549209375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe580b4d20 msgr2=0x7efe58167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:27.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.153+0000 7efe5dfff700 1 --2- 172.21.15.16:0/3549209375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe580b4d20 0x7efe58167260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe50009d90 tx=0x7efe5000b330 comp rx=0 tx=0).stop 2023-06-08T04:02:27.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.153+0000 7efe5dfff700 1 -- 172.21.15.16:0/3549209375 shutdown_connections 2023-06-08T04:02:27.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.153+0000 7efe5dfff700 1 --2- 172.21.15.16:0/3549209375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe580b4d20 0x7efe58167260 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:27.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.153+0000 7efe5dfff700 1 -- 172.21.15.16:0/3549209375 >> 172.21.15.16:0/3549209375 conn(0x7efe580cf610 msgr2=0x7efe580cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:27.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.153+0000 7efe5dfff700 1 -- 172.21.15.16:0/3549209375 shutdown_connections 2023-06-08T04:02:27.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.153+0000 7efe5dfff700 1 -- 172.21.15.16:0/3549209375 wait complete. 2023-06-08T04:02:27.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.155+0000 7efe5dfff700 1 Processor -- start 2023-06-08T04:02:27.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.155+0000 7efe5dfff700 1 -- start start 2023-06-08T04:02:27.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.156+0000 7efe5dfff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe580b4d20 0x7efe580c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:27.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.156+0000 7efe5dfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe580b83f0 0x7efe5815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:27.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.156+0000 7efe5dfff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe58160a60 0x7efe5815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:27.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.156+0000 7efe5dfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe580ca870 con 0x7efe580b83f0 2023-06-08T04:02:27.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.156+0000 7efe5dfff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe581e7700 con 0x7efe580b4d20 2023-06-08T04:02:27.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.156+0000 7efe5dfff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe580c8ef0 con 0x7efe58160a60 2023-06-08T04:02:27.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe56ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe580b83f0 0x7efe5815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:27.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe56ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe580b83f0 0x7efe5815e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38002/0 (socket says 172.21.15.16:38002) 2023-06-08T04:02:27.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe56ffd700 1 -- 172.21.15.16:0/2196551434 learned_addr learned my addr 172.21.15.16:0/2196551434 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:27.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe577fe700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe580b4d20 0x7efe580c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:27.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe57fff700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe58160a60 0x7efe5815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:27.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe56ffd700 1 -- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe58160a60 msgr2=0x7efe5815eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:27.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe56ffd700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe58160a60 0x7efe5815eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:27.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe56ffd700 1 -- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe580b4d20 msgr2=0x7efe580c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:27.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe56ffd700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe580b4d20 0x7efe580c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:27.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe56ffd700 1 -- 172.21.15.16:0/2196551434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50009a70 con 0x7efe580b83f0 2023-06-08T04:02:27.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe577fe700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe580b4d20 0x7efe580c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:27.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.157+0000 7efe56ffd700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe580b83f0 0x7efe5815e570 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c550 tx=0x7efe4c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:27.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.158+0000 7efe3ffff700 1 -- 172.21.15.16:0/2196551434 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0052d0 con 0x7efe580b83f0 2023-06-08T04:02:27.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.158+0000 7efe3ffff700 1 -- 172.21.15.16:0/2196551434 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c005430 con 0x7efe580b83f0 2023-06-08T04:02:27.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.158+0000 7efe3ffff700 1 -- 172.21.15.16:0/2196551434 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0038c0 con 0x7efe580b83f0 2023-06-08T04:02:27.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.158+0000 7efe5dfff700 1 -- 172.21.15.16:0/2196551434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe581e6b80 con 0x7efe580b83f0 2023-06-08T04:02:27.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.158+0000 7efe5dfff700 1 -- 172.21.15.16:0/2196551434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe581e7140 con 0x7efe580b83f0 2023-06-08T04:02:27.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.159+0000 7efe5dfff700 1 -- 172.21.15.16:0/2196551434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe580cab30 con 0x7efe580b83f0 2023-06-08T04:02:27.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.160+0000 7efe3ffff700 1 -- 172.21.15.16:0/2196551434 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe4c003a20 con 0x7efe580b83f0 2023-06-08T04:02:27.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.161+0000 7efe3ffff700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe4406ace0 0x7efe4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:27.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.161+0000 7efe3ffff700 1 -- 172.21.15.16:0/2196551434 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efe4c088a80 con 0x7efe580b83f0 2023-06-08T04:02:27.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.161+0000 7efe577fe700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe4406ace0 0x7efe4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:27.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.162+0000 7efe577fe700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe4406ace0 0x7efe4406d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efe480011e0 tx=0x7efe48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:27.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.165+0000 7efe3ffff700 1 -- 172.21.15.16:0/2196551434 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efe4c053a10 con 0x7efe580b83f0 2023-06-08T04:02:27.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.419+0000 7efe5dfff700 1 -- 172.21.15.16:0/2196551434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efe580740e0 con 0x7efe580b83f0 2023-06-08T04:02:27.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.419+0000 7efe3ffff700 1 -- 172.21.15.16:0/2196551434 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7efe4c057030 con 0x7efe580b83f0 2023-06-08T04:02:27.424 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-08T04:02:27.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 -- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe4406ace0 msgr2=0x7efe4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:27.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe4406ace0 0x7efe4406d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efe480011e0 tx=0x7efe48009040 comp rx=0 tx=0).stop 2023-06-08T04:02:27.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 -- 172.21.15.16:0/2196551434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe580b83f0 msgr2=0x7efe5815e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:27.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe580b83f0 0x7efe5815e570 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c550 tx=0x7efe4c00c860 comp rx=0 tx=0).stop 2023-06-08T04:02:27.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 -- 172.21.15.16:0/2196551434 shutdown_connections 2023-06-08T04:02:27.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7efe4406ace0 0x7efe4406d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:27.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efe58160a60 0x7efe5815eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:27.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe580b4d20 0x7efe580c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:27.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 --2- 172.21.15.16:0/2196551434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe580b83f0 0x7efe5815e570 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:27.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 -- 172.21.15.16:0/2196551434 >> 172.21.15.16:0/2196551434 conn(0x7efe580cf610 msgr2=0x7efe580b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:27.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 -- 172.21.15.16:0/2196551434 shutdown_connections 2023-06-08T04:02:27.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:27.422+0000 7efe5dfff700 1 -- 172.21.15.16:0/2196551434 wait complete. 2023-06-08T04:02:27.444 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-08T04:02:27.444 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-08T04:02:27.444 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi169.front.sepia.ceph.com 2023-06-08T04:02:27.444 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-08T04:02:27.445 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-08T04:02:27.445 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-08T04:02:27.445 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-08T04:02:27.445 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-08T04:02:27.445 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-08T04:02:27.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:27.446 DEBUG:teuthology.orchestra.run.smithi169:> ip addr 2023-06-08T04:02:27.494 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T04:02:27.494 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T04:02:27.495 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T04:02:27.495 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:27.495 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2023-06-08T04:02:27.495 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:27.495 INFO:teuthology.orchestra.run.smithi169.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:27.495 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b4 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:27.495 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f0 2023-06-08T04:02:27.495 INFO:teuthology.orchestra.run.smithi169.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:27.496 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b5 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:27.496 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f1 2023-06-08T04:02:27.496 INFO:teuthology.orchestra.run.smithi169.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:02:27.496 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4c brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:27.496 INFO:teuthology.orchestra.run.smithi169.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-08T04:02:27.496 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4d brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:27.496 INFO:teuthology.orchestra.run.smithi169.stdout: inet 172.21.15.169/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-08T04:02:27.497 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft 41960sec preferred_lft 41960sec 2023-06-08T04:02:27.497 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::ec4:7aff:fe88:7f4d/64 scope link 2023-06-08T04:02:27.497 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:27.497 INFO:teuthology.orchestra.run.smithi169.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T04:02:27.497 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 46:a0:14:3d:c7:36 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:02:27.497 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-08T04:02:27.497 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:27.497 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::8cf0:7cff:fe77:32dc/64 scope link 2023-06-08T04:02:27.498 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:27.498 INFO:teuthology.orchestra.run.smithi169.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-08T04:02:27.498 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 46:a0:14:3d:c7:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-08T04:02:27.498 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::44a0:14ff:fe3d:c736/64 scope link 2023-06-08T04:02:27.498 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:27.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:27.499 DEBUG:teuthology.orchestra.run.smithi169:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-08T04:02:27.568 INFO:teuthology.orchestra.run.smithi169.stdout:1 2023-06-08T04:02:27.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:27.571 DEBUG:teuthology.orchestra.run.smithi169:> route 2023-06-08T04:02:27.620 INFO:teuthology.orchestra.run.smithi169.stdout:Kernel IP routing table 2023-06-08T04:02:27.621 INFO:teuthology.orchestra.run.smithi169.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-08T04:02:27.621 INFO:teuthology.orchestra.run.smithi169.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-08T04:02:27.621 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-08T04:02:27.622 INFO:teuthology.orchestra.run.smithi169.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-08T04:02:27.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:27.623 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2023-06-08T04:02:27.623 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2023-06-08T04:02:27.623 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-08T04:02:27.623 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-08T04:02:27.623 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-08T04:02:27.624 DEBUG:teuthology.orchestra.run.smithi169:> ') 2023-06-08T04:02:27.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:27.793 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2023-06-08T04:02:27.839 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-08T04:02:27.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:27.841 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list-id 2023-06-08T04:02:27.886 INFO:teuthology.orchestra.run.smithi169.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-08T04:02:27.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:27.888 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2023-06-08T04:02:27.888 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2023-06-08T04:02:27.888 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-08T04:02:27.889 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-08T04:02:27.889 DEBUG:teuthology.orchestra.run.smithi169:> ') 2023-06-08T04:02:28.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:28.030 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-08T04:02:28.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:02:28.099 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:02:28.101 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T04:02:28.101 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T04:02:28.101 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T04:02:28.102 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:28.102 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2023-06-08T04:02:28.102 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:28.102 INFO:teuthology.orchestra.run.smithi169.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T04:02:28.102 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 72:f0:eb:e7:6a:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-08T04:02:28.103 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-08T04:02:28.103 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:28.103 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::70f0:ebff:fee7:6ab7/64 scope link 2023-06-08T04:02:28.103 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:28.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:28.104 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-08T04:02:28.176 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T04:02:28.177 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T04:02:28.177 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T04:02:28.177 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:28.177 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2023-06-08T04:02:28.178 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:28.178 INFO:teuthology.orchestra.run.smithi169.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T04:02:28.178 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 72:f0:eb:e7:6a:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-08T04:02:28.178 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-08T04:02:28.179 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:28.179 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::70f0:ebff:fee7:6ab7/64 scope link 2023-06-08T04:02:28.179 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:02:28.180 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-08T04:02:28.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:28.181 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2023-06-08T04:02:28.182 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2023-06-08T04:02:28.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-08T04:02:28.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-08T04:02:28.183 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-08T04:02:28.183 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-08T04:02:28.184 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-08T04:02:28.184 DEBUG:teuthology.orchestra.run.smithi169:> ') 2023-06-08T04:02:28.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:28.480 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2023-06-08T04:02:28.481 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2023-06-08T04:02:28.481 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set brx.1 up 2023-06-08T04:02:28.481 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set dev brx.1 master ceph-brx 2023-06-08T04:02:28.481 DEBUG:teuthology.orchestra.run.smithi169:> ') 2023-06-08T04:02:28.660 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T04:02:28.661 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-08T04:02:28.706 INFO:teuthology.orchestra.run.smithi169.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-08T04:02:28.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T04:02:28.707 DEBUG:teuthology.orchestra.run.smithi169:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-08T04:02:28.752 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-08T04:02:28.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:28.753 DEBUG:teuthology.orchestra.run.smithi169:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-08T04:02:28.897 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-08T04:02:28.898 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-06-08T04:02:28.898 INFO:teuthology.orchestra.run.smithi169.stdout:invalid new device string format 2023-06-08T04:02:28.913 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-08T04:02:28.913 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-06-08T04:02:28.913 INFO:teuthology.orchestra.run.smithi169.stdout:invalid new device string format 2023-06-08T04:02:28.913 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.169:3300,172.21.15.169:3301" 2023-06-08T04:02:28.914 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T04:02:28.937 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-08T04:02:28.937 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-06-08T04:02:28.937 INFO:teuthology.orchestra.run.smithi169.stdout:invalid new device string format 2023-06-08T04:02:28.937 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.169:3300,172.21.15.169:3301" 2023-06-08T04:02:28.937 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T04:02:28.937 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.169:6789,172.21.15.169:6790" 2023-06-08T04:02:28.938 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.169:6789,172.21.15.169:6790:/ 2023-06-08T04:02:28.938 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=e063be5d-be19-46d2-af9e-e986de4a0b1c" will pass to kernel 2023-06-08T04:02:28.941 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-08T04:02:28.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:28.942 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-08T04:02:29.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:29.011 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:29.098 INFO:teuthology.orchestra.run.smithi169.stdout:client4704 2023-06-08T04:02:29.099 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:02:29.099 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:29.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:29.145 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:29.273 INFO:teuthology.orchestra.run.smithi169.stdout:client4704 2023-06-08T04:02:29.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:29.274 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:02:29.362 INFO:teuthology.orchestra.run.smithi169.stdout:client4704 2023-06-08T04:02:29.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:29.363 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e063be5d-be19-46d2-af9e-e986de4a0b1c.client4704/status') 2023-06-08T04:02:29.470 INFO:teuthology.orchestra.run.smithi169.stdout:instance: client.4704 (3)172.21.15.169:0/2002488519 2023-06-08T04:02:29.471 INFO:teuthology.orchestra.run.smithi169.stdout:blocklisted: false 2023-06-08T04:02:29.471 INFO:teuthology.orchestra.run.smithi169.stderr:0+1 records in 2023-06-08T04:02:29.471 INFO:teuthology.orchestra.run.smithi169.stderr:0+1 records out 2023-06-08T04:02:29.472 INFO:teuthology.orchestra.run.smithi169.stderr:71 bytes copied, 5.1044e-05 s, 1.4 MB/s 2023-06-08T04:02:29.473 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-08T04:02:29.492 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:29.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.699+0000 7f11389ff700 1 Processor -- start 2023-06-08T04:02:29.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.700+0000 7f11389ff700 1 -- start start 2023-06-08T04:02:29.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.701+0000 7f11389ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f11340b83f0 0x7f1134160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:29.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.701+0000 7f11389ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f11340ced40 0x7f11340b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:29.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.701+0000 7f11389ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11340d0800 con 0x7f11340b4b50 2023-06-08T04:02:29.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.701+0000 7f11389ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11340b4fd0 con 0x7f11340ced40 2023-06-08T04:02:29.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.701+0000 7f11389ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11340cd1e0 con 0x7f11340b83f0 2023-06-08T04:02:29.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.701+0000 7f112bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f11340ced40 0x7f11340b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:29.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.701+0000 7f112bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f11340ced40 0x7f11340b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38018/0 (socket says 172.21.15.16:38018) 2023-06-08T04:02:29.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.701+0000 7f1132d9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f11340b4b50 0x7f113406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43886/0 (socket says 172.21.15.16:43886) 2023-06-08T04:02:29.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.701+0000 7f112bfff700 1 -- 172.21.15.16:0/425374253 learned_addr learned my addr 172.21.15.16:0/425374253 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:29.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.701+0000 7f113259c700 1 --2- 172.21.15.16:0/425374253 >> v2:172.21.15.169:3300/0 conn(0x7f11340b83f0 0x7f1134160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:29.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.702+0000 7f112bfff700 1 -- 172.21.15.16:0/425374253 >> v2:172.21.15.169:3300/0 conn(0x7f11340b83f0 msgr2=0x7f1134160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:29.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.702+0000 7f112bfff700 1 --2- 172.21.15.16:0/425374253 >> v2:172.21.15.169:3300/0 conn(0x7f11340b83f0 0x7f1134160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:29.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.702+0000 7f112bfff700 1 -- 172.21.15.16:0/425374253 >> v1:172.21.15.16:6789/0 conn(0x7f11340b4b50 legacy=0x7f113406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:29.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.702+0000 7f112bfff700 1 -- 172.21.15.16:0/425374253 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11340cd4c0 con 0x7f11340ced40 2023-06-08T04:02:29.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.702+0000 7f1131d9b700 1 -- 172.21.15.16:0/425374253 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607210291 0 0) 0x7f11340d0800 con 0x7f11340b4b50 2023-06-08T04:02:29.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.702+0000 7f112bfff700 1 --2- 172.21.15.16:0/425374253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11340ced40 0x7f11340b4610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f113406ca80 tx=0x7f111c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fa480535361bfd server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:29.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.702+0000 7f1131d9b700 1 -- 172.21.15.16:0/425374253 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011830 con 0x7f11340ced40 2023-06-08T04:02:29.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.702+0000 7f1131d9b700 1 -- 172.21.15.16:0/425374253 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c011990 con 0x7f11340ced40 2023-06-08T04:02:29.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.702+0000 7f1131d9b700 1 -- 172.21.15.16:0/425374253 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011d20 con 0x7f11340ced40 2023-06-08T04:02:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.703+0000 7f11389ff700 1 -- 172.21.15.16:0/425374253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11340ced40 msgr2=0x7f11340b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.703+0000 7f11389ff700 1 --2- 172.21.15.16:0/425374253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11340ced40 0x7f11340b4610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f113406ca80 tx=0x7f111c009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.703+0000 7f11389ff700 1 -- 172.21.15.16:0/425374253 shutdown_connections 2023-06-08T04:02:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.703+0000 7f11389ff700 1 --2- 172.21.15.16:0/425374253 >> v2:172.21.15.169:3300/0 conn(0x7f11340b83f0 0x7f1134160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.703+0000 7f11389ff700 1 --2- 172.21.15.16:0/425374253 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11340ced40 0x7f11340b4610 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.703+0000 7f11389ff700 1 -- 172.21.15.16:0/425374253 >> 172.21.15.16:0/425374253 conn(0x7f11340cf610 msgr2=0x7f11340cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.703+0000 7f11389ff700 1 -- 172.21.15.16:0/425374253 shutdown_connections 2023-06-08T04:02:29.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.703+0000 7f11389ff700 1 -- 172.21.15.16:0/425374253 wait complete. 2023-06-08T04:02:29.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.705+0000 7f11389ff700 1 Processor -- start 2023-06-08T04:02:29.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.705+0000 7f11389ff700 1 -- start start 2023-06-08T04:02:29.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f11389ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11340b4b50 0x7f11340cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:29.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f11389ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11340b83f0 0x7f1134154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:29.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f11389ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11340ced40 0x7f113415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:29.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f11389ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1134154980 con 0x7f11340ced40 2023-06-08T04:02:29.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f11389ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113415d2c0 con 0x7f11340b4b50 2023-06-08T04:02:29.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f11389ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113415d5a0 con 0x7f11340b83f0 2023-06-08T04:02:29.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f1132d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11340ced40 0x7f113415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:29.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f1132d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11340ced40 0x7f113415ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38024/0 (socket says 172.21.15.16:38024) 2023-06-08T04:02:29.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f1132d9d700 1 -- 172.21.15.16:0/945905811 learned_addr learned my addr 172.21.15.16:0/945905811 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:29.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f113259c700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11340b4b50 0x7f11340cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:29.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f1132d9d700 1 -- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11340b83f0 msgr2=0x7f1134154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:29.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f1132d9d700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11340b83f0 0x7f1134154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:29.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f1132d9d700 1 -- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11340b4b50 msgr2=0x7f11340cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:29.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f1132d9d700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11340b4b50 0x7f11340cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:29.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.706+0000 7f1132d9d700 1 -- 172.21.15.16:0/945905811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c009550 con 0x7f11340ced40 2023-06-08T04:02:29.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.707+0000 7f1132d9d700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11340ced40 0x7f113415ca30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f112c002230 tx=0x7f112c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:29.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.707+0000 7f112affd700 1 -- 172.21.15.16:0/945905811 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c00ac20 con 0x7f11340ced40 2023-06-08T04:02:29.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.707+0000 7f112affd700 1 -- 172.21.15.16:0/945905811 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c00ada0 con 0x7f11340ced40 2023-06-08T04:02:29.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.707+0000 7f11389ff700 1 -- 172.21.15.16:0/945905811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113415d880 con 0x7f11340ced40 2023-06-08T04:02:29.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.707+0000 7f112affd700 1 -- 172.21.15.16:0/945905811 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c007310 con 0x7f11340ced40 2023-06-08T04:02:29.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.707+0000 7f11389ff700 1 -- 172.21.15.16:0/945905811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113415dfb0 con 0x7f11340ced40 2023-06-08T04:02:29.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.708+0000 7f11389ff700 1 -- 172.21.15.16:0/945905811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11340740e0 con 0x7f11340ced40 2023-06-08T04:02:29.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.709+0000 7f112affd700 1 -- 172.21.15.16:0/945905811 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f112c007470 con 0x7f11340ced40 2023-06-08T04:02:29.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.710+0000 7f112affd700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f111406ace0 0x7f111406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:29.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.710+0000 7f112affd700 1 -- 172.21.15.16:0/945905811 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f112c089090 con 0x7f11340ced40 2023-06-08T04:02:29.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.711+0000 7f113259c700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f111406ace0 0x7f111406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:29.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.711+0000 7f113259c700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f111406ace0 0x7f111406d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1124009a90 tx=0x7f1124008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:29.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.714+0000 7f112affd700 1 -- 172.21.15.16:0/945905811 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f112c054130 con 0x7f11340ced40 2023-06-08T04:02:29.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.925+0000 7f11389ff700 1 -- 172.21.15.16:0/945905811 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f113415e1d0 con 0x7f11340ced40 2023-06-08T04:02:29.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.927+0000 7f112affd700 1 -- 172.21.15.16:0/945905811 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7f112c018090 con 0x7f11340ced40 2023-06-08T04:02:29.931 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:29.931 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:29.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.929+0000 7f11389ff700 1 -- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f111406ace0 msgr2=0x7f111406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:29.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.929+0000 7f11389ff700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f111406ace0 0x7f111406d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1124009a90 tx=0x7f1124008040 comp rx=0 tx=0).stop 2023-06-08T04:02:29.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.929+0000 7f11389ff700 1 -- 172.21.15.16:0/945905811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11340ced40 msgr2=0x7f113415ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:29.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.929+0000 7f11389ff700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11340ced40 0x7f113415ca30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f112c002230 tx=0x7f112c00a060 comp rx=0 tx=0).stop 2023-06-08T04:02:29.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.929+0000 7f11389ff700 1 -- 172.21.15.16:0/945905811 shutdown_connections 2023-06-08T04:02:29.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.929+0000 7f11389ff700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f111406ace0 0x7f111406d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:29.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.929+0000 7f11389ff700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11340ced40 0x7f113415ca30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:29.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.929+0000 7f11389ff700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11340b4b50 0x7f11340cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:29.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.929+0000 7f11389ff700 1 --2- 172.21.15.16:0/945905811 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11340b83f0 0x7f1134154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:29.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.929+0000 7f11389ff700 1 -- 172.21.15.16:0/945905811 >> 172.21.15.16:0/945905811 conn(0x7f11340cf610 msgr2=0x7f113415c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:29.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.930+0000 7f11389ff700 1 -- 172.21.15.16:0/945905811 shutdown_connections 2023-06-08T04:02:29.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:29.930+0000 7f11389ff700 1 -- 172.21.15.16:0/945905811 wait complete. 2023-06-08T04:02:29.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:01:54.980592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:01:56.264608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:02:29.952 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:02:30.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.152+0000 7f5fcd1ff700 1 Processor -- start 2023-06-08T04:02:30.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.153+0000 7f5fcd1ff700 1 -- start start 2023-06-08T04:02:30.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.154+0000 7f5fcd1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fc80b83f0 0x7f5fc8160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.154+0000 7f5fcd1ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5fc80ced40 0x7f5fc80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.154+0000 7f5fcd1ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5fc80b4b50 0x7f5fc806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.154+0000 7f5fcd1ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc80b4fd0 con 0x7f5fc80ced40 2023-06-08T04:02:30.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.154+0000 7f5fcd1ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc80d0800 con 0x7f5fc80b4b50 2023-06-08T04:02:30.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.154+0000 7f5fcd1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80cd1e0 con 0x7f5fc80b83f0 2023-06-08T04:02:30.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.154+0000 7f5fbffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5fc80ced40 0x7f5fc80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.154+0000 7f5fbffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5fc80ced40 0x7f5fc80b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38036/0 (socket says 172.21.15.16:38036) 2023-06-08T04:02:30.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.154+0000 7f5fbffff700 1 -- 172.21.15.16:0/2987514770 learned_addr learned my addr 172.21.15.16:0/2987514770 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:30.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fc6d9d700 1 --2- 172.21.15.16:0/2987514770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fc80b83f0 0x7f5fc8160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fc759e700 1 --2- 172.21.15.16:0/2987514770 >> v2:172.21.15.169:3300/0 conn(0x7f5fc80b4b50 0x7f5fc806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fbffff700 1 -- 172.21.15.16:0/2987514770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fc80b83f0 msgr2=0x7f5fc8160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:30.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fbffff700 1 --2- 172.21.15.16:0/2987514770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fc80b83f0 0x7f5fc8160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fbffff700 1 -- 172.21.15.16:0/2987514770 >> v2:172.21.15.169:3300/0 conn(0x7f5fc80b4b50 msgr2=0x7f5fc806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:30.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fbffff700 1 --2- 172.21.15.16:0/2987514770 >> v2:172.21.15.169:3300/0 conn(0x7f5fc80b4b50 0x7f5fc806b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fbffff700 1 -- 172.21.15.16:0/2987514770 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc80cd4c0 con 0x7f5fc80ced40 2023-06-08T04:02:30.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fc759e700 1 --2- 172.21.15.16:0/2987514770 >> v2:172.21.15.169:3300/0 conn(0x7f5fc80b4b50 0x7f5fc806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:30.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fc6d9d700 1 --2- 172.21.15.16:0/2987514770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fc80b83f0 0x7f5fc8160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:30.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fbffff700 1 --2- 172.21.15.16:0/2987514770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80ced40 0x7f5fc80b4610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8073cb0 tx=0x7f5fb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9707f6aabd7d85 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:30.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fc659c700 1 -- 172.21.15.16:0/2987514770 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000b870 con 0x7f5fc80ced40 2023-06-08T04:02:30.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fc659c700 1 -- 172.21.15.16:0/2987514770 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb000b9d0 con 0x7f5fc80ced40 2023-06-08T04:02:30.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.155+0000 7f5fc659c700 1 -- 172.21.15.16:0/2987514770 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000bd60 con 0x7f5fc80ced40 2023-06-08T04:02:30.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.156+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/2987514770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80ced40 msgr2=0x7f5fc80b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:30.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.156+0000 7f5fcd1ff700 1 --2- 172.21.15.16:0/2987514770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80ced40 0x7f5fc80b4610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8073cb0 tx=0x7f5fb0009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.156+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/2987514770 shutdown_connections 2023-06-08T04:02:30.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.156+0000 7f5fcd1ff700 1 --2- 172.21.15.16:0/2987514770 >> v2:172.21.15.169:3300/0 conn(0x7f5fc80b4b50 0x7f5fc806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.156+0000 7f5fcd1ff700 1 --2- 172.21.15.16:0/2987514770 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fc80b83f0 0x7f5fc8160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.156+0000 7f5fcd1ff700 1 --2- 172.21.15.16:0/2987514770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80ced40 0x7f5fc80b4610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.156+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/2987514770 >> 172.21.15.16:0/2987514770 conn(0x7f5fc80cf610 msgr2=0x7f5fc80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:30.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.156+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/2987514770 shutdown_connections 2023-06-08T04:02:30.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.156+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/2987514770 wait complete. 2023-06-08T04:02:30.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.158+0000 7f5fcd1ff700 1 Processor -- start 2023-06-08T04:02:30.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.158+0000 7f5fcd1ff700 1 -- start start 2023-06-08T04:02:30.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fcd1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fc80b4b50 0x7f5fc815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fcd1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b83f0 0x7f5fc815efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fcd1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fc80ced40 0x7f5fc80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fcd1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80cb2e0 con 0x7f5fc80b83f0 2023-06-08T04:02:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fcd1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80ca710 con 0x7f5fc80ced40 2023-06-08T04:02:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fcd1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80ca9b0 con 0x7f5fc80b4b50 2023-06-08T04:02:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fbffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b83f0 0x7f5fc815efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fbffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b83f0 0x7f5fc815efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38050/0 (socket says 172.21.15.16:38050) 2023-06-08T04:02:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fbffff700 1 -- 172.21.15.16:0/78623765 learned_addr learned my addr 172.21.15.16:0/78623765 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:30.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fc759e700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fc80ced40 0x7f5fc80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fc6d9d700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fc80b4b50 0x7f5fc815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fbffff700 1 -- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fc80b4b50 msgr2=0x7f5fc815a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:30.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fbffff700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fc80b4b50 0x7f5fc815a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fbffff700 1 -- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fc80ced40 msgr2=0x7f5fc80cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:30.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fbffff700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fc80ced40 0x7f5fc80cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.160+0000 7f5fbffff700 1 -- 172.21.15.16:0/78623765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0009550 con 0x7f5fc80b83f0 2023-06-08T04:02:30.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.161+0000 7f5fbffff700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b83f0 0x7f5fc815efd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0014040 tx=0x7f5fb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:30.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.161+0000 7f5fbf7fe700 1 -- 172.21.15.16:0/78623765 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0004520 con 0x7f5fc80b83f0 2023-06-08T04:02:30.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.161+0000 7f5fbf7fe700 1 -- 172.21.15.16:0/78623765 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb001e070 con 0x7f5fc80b83f0 2023-06-08T04:02:30.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.161+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/78623765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc80cac90 con 0x7f5fc80b83f0 2023-06-08T04:02:30.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.161+0000 7f5fbf7fe700 1 -- 172.21.15.16:0/78623765 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00038e0 con 0x7f5fc80b83f0 2023-06-08T04:02:30.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.161+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/78623765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc815ab30 con 0x7f5fc80b83f0 2023-06-08T04:02:30.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.162+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/78623765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc80740e0 con 0x7f5fc80b83f0 2023-06-08T04:02:30.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.163+0000 7f5fbf7fe700 1 -- 172.21.15.16:0/78623765 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5fb0003a40 con 0x7f5fc80b83f0 2023-06-08T04:02:30.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.164+0000 7f5fbf7fe700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5fa806ace0 0x7f5fa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.165+0000 7f5fbf7fe700 1 -- 172.21.15.16:0/78623765 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fb0020070 con 0x7f5fc80b83f0 2023-06-08T04:02:30.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.165+0000 7f5fc6d9d700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5fa806ace0 0x7f5fa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.166+0000 7f5fc6d9d700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5fa806ace0 0x7f5fa806d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8006fd0 tx=0x7f5fb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:30.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.169+0000 7f5fbf7fe700 1 -- 172.21.15.16:0/78623765 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5fb0055b80 con 0x7f5fc80b83f0 2023-06-08T04:02:30.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.376+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/78623765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5fc815c210 con 0x7f5fc80b83f0 2023-06-08T04:02:30.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.376+0000 7f5fbf7fe700 1 -- 172.21.15.16:0/78623765 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5fb00150a0 con 0x7f5fc80b83f0 2023-06-08T04:02:30.380 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:02:30.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.378+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5fa806ace0 msgr2=0x7f5fa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:30.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.378+0000 7f5fcd1ff700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5fa806ace0 0x7f5fa806d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8006fd0 tx=0x7f5fb8008040 comp rx=0 tx=0).stop 2023-06-08T04:02:30.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.378+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/78623765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b83f0 msgr2=0x7f5fc815efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:30.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.378+0000 7f5fcd1ff700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b83f0 0x7f5fc815efd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0014040 tx=0x7f5fb0004750 comp rx=0 tx=0).stop 2023-06-08T04:02:30.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.378+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/78623765 shutdown_connections 2023-06-08T04:02:30.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.378+0000 7f5fcd1ff700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5fa806ace0 0x7f5fa806d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.378+0000 7f5fcd1ff700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5fc80ced40 0x7f5fc80cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.378+0000 7f5fcd1ff700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5fc80b4b50 0x7f5fc815a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.378+0000 7f5fcd1ff700 1 --2- 172.21.15.16:0/78623765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b83f0 0x7f5fc815efd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.378+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/78623765 >> 172.21.15.16:0/78623765 conn(0x7f5fc80cf610 msgr2=0x7f5fc80b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:30.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.379+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/78623765 shutdown_connections 2023-06-08T04:02:30.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.379+0000 7f5fcd1ff700 1 -- 172.21.15.16:0/78623765 wait complete. 2023-06-08T04:02:30.400 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:02:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.600+0000 7fadb07ff700 1 Processor -- start 2023-06-08T04:02:30.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.600+0000 7fadb07ff700 1 -- start start 2023-06-08T04:02:30.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadb07ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fada8160a60 0x7fada80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadb07ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fada80b4b50 0x7fada80d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadb07ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada80d0800 con 0x7fada80b83f0 2023-06-08T04:02:30.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadb07ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada8160ed0 con 0x7fada8160a60 2023-06-08T04:02:30.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadb07ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada80b4fd0 con 0x7fada80b4b50 2023-06-08T04:02:30.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadadd9a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fada8160a60 0x7fada80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadadd9a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fada8160a60 0x7fada80b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38066/0 (socket says 172.21.15.16:38066) 2023-06-08T04:02:30.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadadd9a700 1 -- 172.21.15.16:0/85385648 learned_addr learned my addr 172.21.15.16:0/85385648 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:30.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadadd9a700 1 -- 172.21.15.16:0/85385648 >> v2:172.21.15.169:3300/0 conn(0x7fada80b4b50 msgr2=0x7fada80d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:30.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadaed9c700 1 --2- 172.21.15.16:0/85385648 >> v2:172.21.15.169:3300/0 conn(0x7fada80b4b50 0x7fada80d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadadd9a700 1 --2- 172.21.15.16:0/85385648 >> v2:172.21.15.169:3300/0 conn(0x7fada80b4b50 0x7fada80d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadadd9a700 1 -- 172.21.15.16:0/85385648 >> v1:172.21.15.169:6789/0 conn(0x7fada80b83f0 legacy=0x7fada80ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:30.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadadd9a700 1 -- 172.21.15.16:0/85385648 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada80cd1e0 con 0x7fada8160a60 2023-06-08T04:02:30.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.602+0000 7fadaed9c700 1 --2- 172.21.15.16:0/85385648 >> v2:172.21.15.169:3300/0 conn(0x7fada80b4b50 0x7fada80d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:30.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.603+0000 7fadadd9a700 1 --2- 172.21.15.16:0/85385648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada8160a60 0x7fada80b4610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fada80b2590 tx=0x7fad98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949b246cd87eb27c server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:30.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.603+0000 7fadad599700 1 -- 172.21.15.16:0/85385648 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98004230 con 0x7fada8160a60 2023-06-08T04:02:30.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.603+0000 7fadad599700 1 -- 172.21.15.16:0/85385648 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad98004390 con 0x7fada8160a60 2023-06-08T04:02:30.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.603+0000 7fadad599700 1 -- 172.21.15.16:0/85385648 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad980036a0 con 0x7fada8160a60 2023-06-08T04:02:30.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.603+0000 7fadb07ff700 1 -- 172.21.15.16:0/85385648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada8160a60 msgr2=0x7fada80b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:30.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.603+0000 7fadb07ff700 1 --2- 172.21.15.16:0/85385648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada8160a60 0x7fada80b4610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fada80b2590 tx=0x7fad98009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.603+0000 7fadb07ff700 1 -- 172.21.15.16:0/85385648 shutdown_connections 2023-06-08T04:02:30.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.603+0000 7fadb07ff700 1 --2- 172.21.15.16:0/85385648 >> v2:172.21.15.169:3300/0 conn(0x7fada80b4b50 0x7fada80d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.603+0000 7fadb07ff700 1 --2- 172.21.15.16:0/85385648 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada8160a60 0x7fada80b4610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.603+0000 7fadb07ff700 1 -- 172.21.15.16:0/85385648 >> 172.21.15.16:0/85385648 conn(0x7fada80cf610 msgr2=0x7fada80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:30.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.604+0000 7fadb07ff700 1 -- 172.21.15.16:0/85385648 shutdown_connections 2023-06-08T04:02:30.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.604+0000 7fadb07ff700 1 -- 172.21.15.16:0/85385648 wait complete. 2023-06-08T04:02:30.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.605+0000 7fadb07ff700 1 Processor -- start 2023-06-08T04:02:30.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.605+0000 7fadb07ff700 1 -- start start 2023-06-08T04:02:30.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.606+0000 7fadb07ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fada80b4b50 0x7fada814c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.606+0000 7fadb07ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fada80b83f0 0x7fada80a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.606+0000 7fadb07ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada8160a60 0x7fada806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadb07ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada80b28b0 con 0x7fada8160a60 2023-06-08T04:02:30.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadb07ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada80b2b90 con 0x7fada80b83f0 2023-06-08T04:02:30.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadb07ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada80b2e70 con 0x7fada80b4b50 2023-06-08T04:02:30.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadaed9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada8160a60 0x7fada806b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadaed9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada8160a60 0x7fada806b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38080/0 (socket says 172.21.15.16:38080) 2023-06-08T04:02:30.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadaed9c700 1 -- 172.21.15.16:0/3246605449 learned_addr learned my addr 172.21.15.16:0/3246605449 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:30.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadadd9a700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fada80b83f0 0x7fada80a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadae59b700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fada80b4b50 0x7fada814c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadaed9c700 1 -- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fada80b4b50 msgr2=0x7fada814c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:30.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadaed9c700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fada80b4b50 0x7fada814c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadaed9c700 1 -- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fada80b83f0 msgr2=0x7fada80a9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:30.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadaed9c700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fada80b83f0 0x7fada80a9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadaed9c700 1 -- 172.21.15.16:0/3246605449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98009550 con 0x7fada8160a60 2023-06-08T04:02:30.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadae59b700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fada80b4b50 0x7fada814c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:30.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.607+0000 7fadaed9c700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada8160a60 0x7fada806b9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fada000cef0 tx=0x7fada000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:30.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.608+0000 7fad9effd700 1 -- 172.21.15.16:0/3246605449 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada000adb0 con 0x7fada8160a60 2023-06-08T04:02:30.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.608+0000 7fad9effd700 1 -- 172.21.15.16:0/3246605449 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada0015440 con 0x7fada8160a60 2023-06-08T04:02:30.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.608+0000 7fad9effd700 1 -- 172.21.15.16:0/3246605449 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada00157f0 con 0x7fada8160a60 2023-06-08T04:02:30.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.608+0000 7fadb07ff700 1 -- 172.21.15.16:0/3246605449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada814e900 con 0x7fada8160a60 2023-06-08T04:02:30.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.608+0000 7fadb07ff700 1 -- 172.21.15.16:0/3246605449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada814f100 con 0x7fada8160a60 2023-06-08T04:02:30.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.609+0000 7fadb07ff700 1 -- 172.21.15.16:0/3246605449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada814ef50 con 0x7fada8160a60 2023-06-08T04:02:30.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.610+0000 7fad9effd700 1 -- 172.21.15.16:0/3246605449 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fada000d430 con 0x7fada8160a60 2023-06-08T04:02:30.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.611+0000 7fad9effd700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fad8c06ace0 0x7fad8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:30.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.611+0000 7fad9effd700 1 -- 172.21.15.16:0/3246605449 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fada0089a00 con 0x7fada8160a60 2023-06-08T04:02:30.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.611+0000 7fadae59b700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fad8c06ace0 0x7fad8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:30.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.612+0000 7fadae59b700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fad8c06ace0 0x7fad8c06d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fada80b35b0 tx=0x7fada4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:30.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.616+0000 7fad9effd700 1 -- 172.21.15.16:0/3246605449 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fada0054aa0 con 0x7fada8160a60 2023-06-08T04:02:30.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.821+0000 7fadb07ff700 1 -- 172.21.15.16:0/3246605449 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fada814e750 con 0x7fada8160a60 2023-06-08T04:02:30.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.822+0000 7fad9effd700 1 -- 172.21.15.16:0/3246605449 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fada001a0a0 con 0x7fada8160a60 2023-06-08T04:02:30.826 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:02:30.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 -- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fad8c06ace0 msgr2=0x7fad8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:30.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fad8c06ace0 0x7fad8c06d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fada80b35b0 tx=0x7fada4009040 comp rx=0 tx=0).stop 2023-06-08T04:02:30.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 -- 172.21.15.16:0/3246605449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada8160a60 msgr2=0x7fada806b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:30.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada8160a60 0x7fada806b9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fada000cef0 tx=0x7fada000cf20 comp rx=0 tx=0).stop 2023-06-08T04:02:30.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 -- 172.21.15.16:0/3246605449 shutdown_connections 2023-06-08T04:02:30.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fad8c06ace0 0x7fad8c06d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fada8160a60 0x7fada806b9c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fada80b4b50 0x7fada814c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 --2- 172.21.15.16:0/3246605449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fada80b83f0 0x7fada80a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:30.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 -- 172.21.15.16:0/3246605449 >> 172.21.15.16:0/3246605449 conn(0x7fada80cf610 msgr2=0x7fada806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:30.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 -- 172.21.15.16:0/3246605449 shutdown_connections 2023-06-08T04:02:30.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:30.824+0000 7fadb07ff700 1 -- 172.21.15.16:0/3246605449 wait complete. 2023-06-08T04:02:30.846 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:02:31.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.047+0000 7f085f3ff700 1 Processor -- start 2023-06-08T04:02:31.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.047+0000 7f085f3ff700 1 -- start start 2023-06-08T04:02:31.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.048+0000 7f085f3ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0858160a60 0x7f08580b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.048+0000 7f085f3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08580b4b50 0x7f08580d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.048+0000 7f085f3ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08580d0800 con 0x7f08580b83f0 2023-06-08T04:02:31.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.048+0000 7f085f3ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0858160ed0 con 0x7f0858160a60 2023-06-08T04:02:31.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.048+0000 7f085f3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580b4fd0 con 0x7f08580b4b50 2023-06-08T04:02:31.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.048+0000 7f085d19b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f08580b83f0 0x7f08580ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43890/0 (socket says 172.21.15.16:43890) 2023-06-08T04:02:31.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.048+0000 7f085d19b700 1 -- 172.21.15.16:0/2458170275 learned_addr learned my addr 172.21.15.16:0/2458170275 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:31.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.048+0000 7f085c99a700 1 --2- 172.21.15.16:0/2458170275 >> v2:172.21.15.169:3300/0 conn(0x7f0858160a60 0x7f08580b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.048+0000 7f085d99c700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08580b4b50 0x7f08580d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935563434 0 0) 0x7f08580d0800 con 0x7f08580b83f0 2023-06-08T04:02:31.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08440035b0 con 0x7f08580b83f0 2023-06-08T04:02:31.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3129196659 0 0) 0x7f08440035b0 con 0x7f08580b83f0 2023-06-08T04:02:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08580b4b50 msgr2=0x7f08580d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08580b4b50 0x7f08580d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 >> v2:172.21.15.169:3300/0 conn(0x7f0858160a60 msgr2=0x7f08580b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 --2- 172.21.15.16:0/2458170275 >> v2:172.21.15.169:3300/0 conn(0x7f0858160a60 0x7f08580b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580cd1e0 con 0x7f08580b83f0 2023-06-08T04:02:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7f0854001670 con 0x7f08580b83f0 2023-06-08T04:02:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f085c99a700 1 --2- 172.21.15.16:0/2458170275 >> v2:172.21.15.169:3300/0 conn(0x7f0858160a60 0x7f08580b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:02:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 >> v1:172.21.15.16:6789/0 conn(0x7f08580b83f0 legacy=0x7f08580ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08580b4b50 0x7f0844003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0844003f80 0x7f0844004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0844004d90 0x7f0844005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08580b4fd0 con 0x7f0844003f80 2023-06-08T04:02:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084400ba10 con 0x7f0844004d90 2023-06-08T04:02:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084400bb80 con 0x7f08580b4b50 2023-06-08T04:02:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f085c99a700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0844003f80 0x7f0844004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.049+0000 7f085d19b700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08580b4b50 0x7f0844003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f085d99c700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0844004d90 0x7f0844005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f085c99a700 1 -- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08580b4b50 msgr2=0x7f0844003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f085c99a700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08580b4b50 0x7f0844003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f085c99a700 1 -- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0844004d90 msgr2=0x7f0844005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f085c99a700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0844004d90 0x7f0844005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f085c99a700 1 -- 172.21.15.16:0/2458170275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08440035b0 con 0x7f0844003f80 2023-06-08T04:02:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f085d19b700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08580b4b50 0x7f0844003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f085d99c700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0844004d90 0x7f0844005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f085c99a700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0844003f80 0x7f0844004850 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0848009d30 tx=0x7f0844005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e8b51e9ff55a9a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848009e80 con 0x7f0844003f80 2023-06-08T04:02:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084800e940 con 0x7f0844003f80 2023-06-08T04:02:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.050+0000 7f084ffff700 1 -- 172.21.15.16:0/2458170275 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800ecd0 con 0x7f0844003f80 2023-06-08T04:02:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.051+0000 7f085f3ff700 1 -- 172.21.15.16:0/2458170275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0844003f80 msgr2=0x7f0844004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.051+0000 7f085f3ff700 1 --2- 172.21.15.16:0/2458170275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0844003f80 0x7f0844004850 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0848009d30 tx=0x7f0844005880 comp rx=0 tx=0).stop 2023-06-08T04:02:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.051+0000 7f085d99c700 1 -- 172.21.15.16:0/2458170275 reap_dead start 2023-06-08T04:02:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.051+0000 7f085f3ff700 1 -- 172.21.15.16:0/2458170275 shutdown_connections 2023-06-08T04:02:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.051+0000 7f085f3ff700 1 -- 172.21.15.16:0/2458170275 >> 172.21.15.16:0/2458170275 conn(0x7f08580cf610 msgr2=0x7f08580cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.051+0000 7f085f3ff700 1 -- 172.21.15.16:0/2458170275 shutdown_connections 2023-06-08T04:02:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.051+0000 7f085f3ff700 1 -- 172.21.15.16:0/2458170275 wait complete. 2023-06-08T04:02:31.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.053+0000 7f085f3ff700 1 Processor -- start 2023-06-08T04:02:31.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.053+0000 7f085f3ff700 1 -- start start 2023-06-08T04:02:31.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085f3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0844003f80 0x7f0858148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085f3ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08581488b0 0x7f08581e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085f3ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08581e7e10 0x7f085814b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085f3ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858148d20 con 0x7f08581e7e10 2023-06-08T04:02:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085f3ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08581e8280 con 0x7f08581488b0 2023-06-08T04:02:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085f3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085815d1c0 con 0x7f0844003f80 2023-06-08T04:02:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085d99c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08581e7e10 0x7f085814b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085d99c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08581e7e10 0x7f085814b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38092/0 (socket says 172.21.15.16:38092) 2023-06-08T04:02:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085d99c700 1 -- 172.21.15.16:0/4084858765 learned_addr learned my addr 172.21.15.16:0/4084858765 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085c99a700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08581488b0 0x7f08581e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085d19b700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0844003f80 0x7f0858148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085d99c700 1 -- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0844003f80 msgr2=0x7f0858148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085d99c700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0844003f80 0x7f0858148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085d99c700 1 -- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08581488b0 msgr2=0x7f08581e78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085d99c700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08581488b0 0x7f08581e78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085d99c700 1 -- 172.21.15.16:0/4084858765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08581e84b0 con 0x7f08581e7e10 2023-06-08T04:02:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.054+0000 7f085d19b700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0844003f80 0x7f0858148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.055+0000 7f085d99c700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08581e7e10 0x7f085814b7f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f085806a1b0 tx=0x7f08500104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.055+0000 7f084dffb700 1 -- 172.21.15.16:0/4084858765 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085001b070 con 0x7f08581e7e10 2023-06-08T04:02:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.055+0000 7f084dffb700 1 -- 172.21.15.16:0/4084858765 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085000f040 con 0x7f08581e7e10 2023-06-08T04:02:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.055+0000 7f085f3ff700 1 -- 172.21.15.16:0/4084858765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08581e8790 con 0x7f08581e7e10 2023-06-08T04:02:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.055+0000 7f084dffb700 1 -- 172.21.15.16:0/4084858765 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000e050 con 0x7f08581e7e10 2023-06-08T04:02:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.055+0000 7f085f3ff700 1 -- 172.21.15.16:0/4084858765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085815d410 con 0x7f08581e7e10 2023-06-08T04:02:31.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.056+0000 7f085f3ff700 1 -- 172.21.15.16:0/4084858765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085815d5a0 con 0x7f08581e7e10 2023-06-08T04:02:31.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.057+0000 7f084dffb700 1 -- 172.21.15.16:0/4084858765 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0850015440 con 0x7f08581e7e10 2023-06-08T04:02:31.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.059+0000 7f084dffb700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f083c06ace0 0x7f083c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.059+0000 7f084dffb700 1 -- 172.21.15.16:0/4084858765 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08500894c0 con 0x7f08581e7e10 2023-06-08T04:02:31.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.059+0000 7f085d19b700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f083c06ace0 0x7f083c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.060+0000 7f085d19b700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f083c06ace0 0x7f083c06d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0854001010 tx=0x7f0854009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:31.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.063+0000 7f084dffb700 1 -- 172.21.15.16:0/4084858765 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0850054560 con 0x7f08581e7e10 2023-06-08T04:02:31.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.271+0000 7f085f3ff700 1 -- 172.21.15.16:0/4084858765 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08580740e0 con 0x7f08581e7e10 2023-06-08T04:02:31.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.272+0000 7f084dffb700 1 -- 172.21.15.16:0/4084858765 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0850007ea0 con 0x7f08581e7e10 2023-06-08T04:02:31.276 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:02:31.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.274+0000 7f085f3ff700 1 -- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f083c06ace0 msgr2=0x7f083c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.274+0000 7f085f3ff700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f083c06ace0 0x7f083c06d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0854001010 tx=0x7f0854009040 comp rx=0 tx=0).stop 2023-06-08T04:02:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.274+0000 7f085f3ff700 1 -- 172.21.15.16:0/4084858765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08581e7e10 msgr2=0x7f085814b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.274+0000 7f085f3ff700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08581e7e10 0x7f085814b7f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f085806a1b0 tx=0x7f08500104a0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.274+0000 7f085f3ff700 1 -- 172.21.15.16:0/4084858765 shutdown_connections 2023-06-08T04:02:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.274+0000 7f085f3ff700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f083c06ace0 0x7f083c06d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.274+0000 7f085f3ff700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08581e7e10 0x7f085814b7f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.274+0000 7f085f3ff700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0844003f80 0x7f0858148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.274+0000 7f085f3ff700 1 --2- 172.21.15.16:0/4084858765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08581488b0 0x7f08581e78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.274+0000 7f085f3ff700 1 -- 172.21.15.16:0/4084858765 >> 172.21.15.16:0/4084858765 conn(0x7f08580cf610 msgr2=0x7f08580cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.274+0000 7f085f3ff700 1 -- 172.21.15.16:0/4084858765 shutdown_connections 2023-06-08T04:02:31.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.275+0000 7f085f3ff700 1 -- 172.21.15.16:0/4084858765 wait complete. 2023-06-08T04:02:31.296 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:02:31.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.494+0000 7f0258fff700 1 Processor -- start 2023-06-08T04:02:31.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.495+0000 7f0258fff700 1 -- start start 2023-06-08T04:02:31.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.496+0000 7f0258fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0254160a60 0x7f02540b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.496+0000 7f0258fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f02540b4b50 0x7f02540d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.496+0000 7f0258fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02540d0800 con 0x7f02540b83f0 2023-06-08T04:02:31.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.496+0000 7f0258fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0254160ed0 con 0x7f02540b4b50 2023-06-08T04:02:31.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.496+0000 7f0258fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02540b4fd0 con 0x7f0254160a60 2023-06-08T04:02:31.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.496+0000 7f025259c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f02540b83f0 0x7f02540ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43900/0 (socket says 172.21.15.16:43900) 2023-06-08T04:02:31.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.496+0000 7f025259c700 1 -- 172.21.15.16:0/2151359456 learned_addr learned my addr 172.21.15.16:0/2151359456 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:31.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.496+0000 7f0252d9d700 1 --2- 172.21.15.16:0/2151359456 >> v2:172.21.15.16:3300/0 conn(0x7f02540b4b50 0x7f02540d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.496+0000 7f024bfff700 1 --2- 172.21.15.16:0/2151359456 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0254160a60 0x7f02540b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.497+0000 7f0252d9d700 1 -- 172.21.15.16:0/2151359456 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0254160a60 msgr2=0x7f02540b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:31.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.497+0000 7f0252d9d700 1 --2- 172.21.15.16:0/2151359456 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0254160a60 0x7f02540b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.497+0000 7f0252d9d700 1 -- 172.21.15.16:0/2151359456 >> v1:172.21.15.16:6789/0 conn(0x7f02540b83f0 legacy=0x7f02540ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.497+0000 7f0252d9d700 1 -- 172.21.15.16:0/2151359456 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02540cd1e0 con 0x7f02540b4b50 2023-06-08T04:02:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.497+0000 7f0251d9b700 1 -- 172.21.15.16:0/2151359456 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206439736 0 0) 0x7f02540d0800 con 0x7f02540b83f0 2023-06-08T04:02:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.497+0000 7f0252d9d700 1 --2- 172.21.15.16:0/2151359456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02540b4b50 0x7f02540d0fc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f024c009d90 tx=0x7f024c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d72265d2ca1b1db server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.497+0000 7f0251d9b700 1 -- 172.21.15.16:0/2151359456 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c00e070 con 0x7f02540b4b50 2023-06-08T04:02:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.497+0000 7f0251d9b700 1 -- 172.21.15.16:0/2151359456 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c00bbd0 con 0x7f02540b4b50 2023-06-08T04:02:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.497+0000 7f0251d9b700 1 -- 172.21.15.16:0/2151359456 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c012430 con 0x7f02540b4b50 2023-06-08T04:02:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.498+0000 7f0258fff700 1 -- 172.21.15.16:0/2151359456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02540b4b50 msgr2=0x7f02540d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.498+0000 7f0258fff700 1 --2- 172.21.15.16:0/2151359456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02540b4b50 0x7f02540d0fc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f024c009d90 tx=0x7f024c00b330 comp rx=0 tx=0).stop 2023-06-08T04:02:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.498+0000 7f0258fff700 1 -- 172.21.15.16:0/2151359456 shutdown_connections 2023-06-08T04:02:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.498+0000 7f0258fff700 1 --2- 172.21.15.16:0/2151359456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02540b4b50 0x7f02540d0fc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.498+0000 7f0258fff700 1 --2- 172.21.15.16:0/2151359456 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0254160a60 0x7f02540b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.498+0000 7f0258fff700 1 -- 172.21.15.16:0/2151359456 >> 172.21.15.16:0/2151359456 conn(0x7f02540cf610 msgr2=0x7f02540cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.498+0000 7f0258fff700 1 -- 172.21.15.16:0/2151359456 shutdown_connections 2023-06-08T04:02:31.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.498+0000 7f0258fff700 1 -- 172.21.15.16:0/2151359456 wait complete. 2023-06-08T04:02:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.499+0000 7f0258fff700 1 Processor -- start 2023-06-08T04:02:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.500+0000 7f0258fff700 1 -- start start 2023-06-08T04:02:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.500+0000 7f0258fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02540b4b50 0x7f0254159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.500+0000 7f0258fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02540b83f0 0x7f02540a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.500+0000 7f0258fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0254160a60 0x7f025415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f0258fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0254159f60 con 0x7f02540b4b50 2023-06-08T04:02:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f0258fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02541f1940 con 0x7f02540b83f0 2023-06-08T04:02:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f0258fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02541f1bc0 con 0x7f0254160a60 2023-06-08T04:02:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f025259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02540b4b50 0x7f0254159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f025259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02540b4b50 0x7f0254159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38102/0 (socket says 172.21.15.16:38102) 2023-06-08T04:02:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f025259c700 1 -- 172.21.15.16:0/3125373637 learned_addr learned my addr 172.21.15.16:0/3125373637 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f0252d9d700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0254160a60 0x7f025415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f024bfff700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02540b83f0 0x7f02540a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f025259c700 1 -- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0254160a60 msgr2=0x7f025415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f025259c700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0254160a60 0x7f025415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f025259c700 1 -- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02540b83f0 msgr2=0x7f02540a9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f025259c700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02540b83f0 0x7f02540a9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f025259c700 1 -- 172.21.15.16:0/3125373637 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c009a70 con 0x7f02540b4b50 2023-06-08T04:02:31.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f0252d9d700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0254160a60 0x7f025415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:31.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f024bfff700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02540b83f0 0x7f02540a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:31.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.501+0000 7f025259c700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02540b4b50 0x7f0254159a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f02440011e0 tx=0x7f024400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.502+0000 7f024affd700 1 -- 172.21.15.16:0/3125373637 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0244004c80 con 0x7f02540b4b50 2023-06-08T04:02:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.502+0000 7f024affd700 1 -- 172.21.15.16:0/3125373637 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0244004e00 con 0x7f02540b4b50 2023-06-08T04:02:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.502+0000 7f024affd700 1 -- 172.21.15.16:0/3125373637 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0244007310 con 0x7f02540b4b50 2023-06-08T04:02:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.502+0000 7f0258fff700 1 -- 172.21.15.16:0/3125373637 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02541f2940 con 0x7f02540b4b50 2023-06-08T04:02:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.502+0000 7f0258fff700 1 -- 172.21.15.16:0/3125373637 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02541f2140 con 0x7f02540b4b50 2023-06-08T04:02:31.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.503+0000 7f0258fff700 1 -- 172.21.15.16:0/3125373637 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02540740e0 con 0x7f02540b4b50 2023-06-08T04:02:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.504+0000 7f024affd700 1 -- 172.21.15.16:0/3125373637 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0244007470 con 0x7f02540b4b50 2023-06-08T04:02:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.505+0000 7f024affd700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f023406ace0 0x7f023406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.505+0000 7f024affd700 1 -- 172.21.15.16:0/3125373637 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02440892c0 con 0x7f02540b4b50 2023-06-08T04:02:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.505+0000 7f024bfff700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f023406ace0 0x7f023406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.506+0000 7f024bfff700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f023406ace0 0x7f023406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f02540b4580 tx=0x7f023c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:31.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.509+0000 7f024affd700 1 -- 172.21.15.16:0/3125373637 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f02440542d0 con 0x7f02540b4b50 2023-06-08T04:02:31.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.714+0000 7f0258fff700 1 -- 172.21.15.16:0/3125373637 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02540cfd60 con 0x7f02540b4b50 2023-06-08T04:02:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.714+0000 7f024affd700 1 -- 172.21.15.16:0/3125373637 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02440578f0 con 0x7f02540b4b50 2023-06-08T04:02:31.718 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:02:31.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.716+0000 7f0258fff700 1 -- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f023406ace0 msgr2=0x7f023406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.716+0000 7f0258fff700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f023406ace0 0x7f023406d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f02540b4580 tx=0x7f023c008040 comp rx=0 tx=0).stop 2023-06-08T04:02:31.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.716+0000 7f0258fff700 1 -- 172.21.15.16:0/3125373637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02540b4b50 msgr2=0x7f0254159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.716+0000 7f0258fff700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02540b4b50 0x7f0254159a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f02440011e0 tx=0x7f024400cae0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.716+0000 7f0258fff700 1 -- 172.21.15.16:0/3125373637 shutdown_connections 2023-06-08T04:02:31.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.716+0000 7f0258fff700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f023406ace0 0x7f023406d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.716+0000 7f0258fff700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0254160a60 0x7f025415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.716+0000 7f0258fff700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02540b4b50 0x7f0254159a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.716+0000 7f0258fff700 1 --2- 172.21.15.16:0/3125373637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02540b83f0 0x7f02540a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.716+0000 7f0258fff700 1 -- 172.21.15.16:0/3125373637 >> 172.21.15.16:0/3125373637 conn(0x7f02540cf610 msgr2=0x7f02540d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:31.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.717+0000 7f0258fff700 1 -- 172.21.15.16:0/3125373637 shutdown_connections 2023-06-08T04:02:31.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.717+0000 7f0258fff700 1 -- 172.21.15.16:0/3125373637 wait complete. 2023-06-08T04:02:31.738 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:31.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.935+0000 7f24c83ff700 1 Processor -- start 2023-06-08T04:02:31.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.935+0000 7f24c83ff700 1 -- start start 2023-06-08T04:02:31.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.936+0000 7f24c83ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f24c015fb60 0x7f24c00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.936+0000 7f24c83ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24c006a4c0 0x7f24c00cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.936+0000 7f24c83ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c00af3f0 con 0x7f24c00b0940 2023-06-08T04:02:31.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.936+0000 7f24c83ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c00b0e40 con 0x7f24c015fb60 2023-06-08T04:02:31.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.936+0000 7f24c83ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00af1e0 con 0x7f24c006a4c0 2023-06-08T04:02:31.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.937+0000 7f24c619b700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f24c015fb60 0x7f24c00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.937+0000 7f24c699c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24c006a4c0 0x7f24c00cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.937+0000 7f24c619b700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f24c015fb60 0x7f24c00c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:59206/0 (socket says 172.21.15.16:59206) 2023-06-08T04:02:31.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.937+0000 7f24c619b700 1 -- 172.21.15.16:0/2807345938 learned_addr learned my addr 172.21.15.16:0/2807345938 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:31.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.937+0000 7f24c619b700 1 -- 172.21.15.16:0/2807345938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24c006a4c0 msgr2=0x7f24c00cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:31.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.937+0000 7f24c619b700 1 --2- 172.21.15.16:0/2807345938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24c006a4c0 0x7f24c00cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.937+0000 7f24c619b700 1 -- 172.21.15.16:0/2807345938 >> v1:172.21.15.169:6789/0 conn(0x7f24c00b0940 legacy=0x7f24c0069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.937+0000 7f24c619b700 1 -- 172.21.15.16:0/2807345938 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c00af6d0 con 0x7f24c015fb60 2023-06-08T04:02:31.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.938+0000 7f24c619b700 1 --2- 172.21.15.16:0/2807345938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c015fb60 0x7f24c00c9ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0098f0 tx=0x7f24bc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fefaf02c1d97f0e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:31.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.938+0000 7f24c5199700 1 -- 172.21.15.16:0/2807345938 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc011830 con 0x7f24c015fb60 2023-06-08T04:02:31.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.938+0000 7f24c5199700 1 -- 172.21.15.16:0/2807345938 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc011990 con 0x7f24c015fb60 2023-06-08T04:02:31.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.938+0000 7f24c5199700 1 -- 172.21.15.16:0/2807345938 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc011d20 con 0x7f24c015fb60 2023-06-08T04:02:31.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.938+0000 7f24c83ff700 1 -- 172.21.15.16:0/2807345938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c015fb60 msgr2=0x7f24c00c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.938+0000 7f24c83ff700 1 --2- 172.21.15.16:0/2807345938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c015fb60 0x7f24c00c9ed0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0098f0 tx=0x7f24bc009c00 comp rx=0 tx=0).stop 2023-06-08T04:02:31.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.938+0000 7f24c83ff700 1 -- 172.21.15.16:0/2807345938 shutdown_connections 2023-06-08T04:02:31.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.938+0000 7f24c83ff700 1 --2- 172.21.15.16:0/2807345938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c015fb60 0x7f24c00c9ed0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.938+0000 7f24c83ff700 1 --2- 172.21.15.16:0/2807345938 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24c006a4c0 0x7f24c00cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.938+0000 7f24c83ff700 1 -- 172.21.15.16:0/2807345938 >> 172.21.15.16:0/2807345938 conn(0x7f24c0098a50 msgr2=0x7f24c00cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:31.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.938+0000 7f24c83ff700 1 -- 172.21.15.16:0/2807345938 shutdown_connections 2023-06-08T04:02:31.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.939+0000 7f24c83ff700 1 -- 172.21.15.16:0/2807345938 wait complete. 2023-06-08T04:02:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.940+0000 7f24c83ff700 1 Processor -- start 2023-06-08T04:02:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.940+0000 7f24c83ff700 1 -- start start 2023-06-08T04:02:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.941+0000 7f24c83ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24c006a4c0 0x7f24c015da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.941+0000 7f24c83ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c00b0940 0x7f24c00c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.941+0000 7f24c83ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24c015fb60 0x7f24c015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.941+0000 7f24c83ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00b4060 con 0x7f24c015fb60 2023-06-08T04:02:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.941+0000 7f24c83ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00c7810 con 0x7f24c00b0940 2023-06-08T04:02:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.941+0000 7f24c83ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c015d7f0 con 0x7f24c006a4c0 2023-06-08T04:02:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.942+0000 7f24c699c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24c015fb60 0x7f24c015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.942+0000 7f24c699c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24c015fb60 0x7f24c015d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38116/0 (socket says 172.21.15.16:38116) 2023-06-08T04:02:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.942+0000 7f24c699c700 1 -- 172.21.15.16:0/3139139718 learned_addr learned my addr 172.21.15.16:0/3139139718 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.942+0000 7f24c619b700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24c006a4c0 0x7f24c015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.942+0000 7f24c599a700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c00b0940 0x7f24c00c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.942+0000 7f24c699c700 1 -- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24c006a4c0 msgr2=0x7f24c015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.942+0000 7f24c699c700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24c006a4c0 0x7f24c015da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.942+0000 7f24c699c700 1 -- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c00b0940 msgr2=0x7f24c00c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:31.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.942+0000 7f24c699c700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c00b0940 0x7f24c00c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:31.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.942+0000 7f24c699c700 1 -- 172.21.15.16:0/3139139718 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc009550 con 0x7f24c015fb60 2023-06-08T04:02:31.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.942+0000 7f24c699c700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24c015fb60 0x7f24c015d2b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f24b800ef90 tx=0x7f24b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:31.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.943+0000 7f24b6ffd700 1 -- 172.21.15.16:0/3139139718 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b800cc90 con 0x7f24c015fb60 2023-06-08T04:02:31.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.943+0000 7f24b6ffd700 1 -- 172.21.15.16:0/3139139718 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b800f040 con 0x7f24c015fb60 2023-06-08T04:02:31.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.943+0000 7f24c83ff700 1 -- 172.21.15.16:0/3139139718 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c00c7a90 con 0x7f24c015fb60 2023-06-08T04:02:31.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.943+0000 7f24b6ffd700 1 -- 172.21.15.16:0/3139139718 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8014480 con 0x7f24c015fb60 2023-06-08T04:02:31.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.943+0000 7f24c83ff700 1 -- 172.21.15.16:0/3139139718 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c00b3c80 con 0x7f24c015fb60 2023-06-08T04:02:31.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.944+0000 7f24c83ff700 1 -- 172.21.15.16:0/3139139718 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c00b1060 con 0x7f24c015fb60 2023-06-08T04:02:31.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.945+0000 7f24b6ffd700 1 -- 172.21.15.16:0/3139139718 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24b80145e0 con 0x7f24c015fb60 2023-06-08T04:02:31.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.946+0000 7f24b6ffd700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f24a406ace0 0x7f24a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.946+0000 7f24b6ffd700 1 -- 172.21.15.16:0/3139139718 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24b808a160 con 0x7f24c015fb60 2023-06-08T04:02:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.946+0000 7f24c619b700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f24a406ace0 0x7f24a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.947+0000 7f24c619b700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f24a406ace0 0x7f24a406d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f24bc014040 tx=0x7f24bc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:31.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:31.951+0000 7f24b6ffd700 1 -- 172.21.15.16:0/3139139718 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f24b8055170 con 0x7f24c015fb60 2023-06-08T04:02:32.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.161+0000 7f24c83ff700 1 -- 172.21.15.16:0/3139139718 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24c00c7fb0 con 0x7f24c015fb60 2023-06-08T04:02:32.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.162+0000 7f24b6ffd700 1 -- 172.21.15.16:0/3139139718 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7f24c00c7fb0 con 0x7f24c015fb60 2023-06-08T04:02:32.167 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:32.167 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:32.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 -- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f24a406ace0 msgr2=0x7f24a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f24a406ace0 0x7f24a406d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f24bc014040 tx=0x7f24bc008030 comp rx=0 tx=0).stop 2023-06-08T04:02:32.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 -- 172.21.15.16:0/3139139718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24c015fb60 msgr2=0x7f24c015d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24c015fb60 0x7f24c015d2b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f24b800ef90 tx=0x7f24b800c3a0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 -- 172.21.15.16:0/3139139718 shutdown_connections 2023-06-08T04:02:32.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f24a406ace0 0x7f24a406d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f24c015fb60 0x7f24c015d2b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f24c006a4c0 0x7f24c015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 --2- 172.21.15.16:0/3139139718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c00b0940 0x7f24c00c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 -- 172.21.15.16:0/3139139718 >> 172.21.15.16:0/3139139718 conn(0x7f24c0098a50 msgr2=0x7f24c00ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:32.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 -- 172.21.15.16:0/3139139718 shutdown_connections 2023-06-08T04:02:32.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.165+0000 7f24c83ff700 1 -- 172.21.15.16:0/3139139718 wait complete. 2023-06-08T04:02:32.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:01:54.980592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:01:56.264608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:02:32.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:02:32.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.387+0000 7fe5459ff700 1 Processor -- start 2023-06-08T04:02:32.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.387+0000 7fe5459ff700 1 -- start start 2023-06-08T04:02:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.388+0000 7fe5459ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5400b83f0 0x7fe540160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.388+0000 7fe5459ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe5400b4d20 0x7fe5400d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.388+0000 7fe5459ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5400d0800 con 0x7fe5400ced40 2023-06-08T04:02:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.388+0000 7fe5459ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5400cd1e0 con 0x7fe5400b4d20 2023-06-08T04:02:32.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.388+0000 7fe5459ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400cd4c0 con 0x7fe5400b83f0 2023-06-08T04:02:32.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.389+0000 7fe53f7fe700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe5400b4d20 0x7fe5400d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.389+0000 7fe53effd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5400b83f0 0x7fe540160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.389+0000 7fe53f7fe700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe5400b4d20 0x7fe5400d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:34680/0 (socket says 172.21.15.16:34680) 2023-06-08T04:02:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.389+0000 7fe53f7fe700 1 -- 172.21.15.16:0/596852658 learned_addr learned my addr 172.21.15.16:0/596852658 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.389+0000 7fe53effd700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5400b83f0 0x7fe540160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:40426/0 (socket says 172.21.15.16:40426) 2023-06-08T04:02:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.389+0000 7fe53f7fe700 1 -- 172.21.15.16:0/596852658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5400b83f0 msgr2=0x7fe540160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.389+0000 7fe53f7fe700 1 --2- 172.21.15.16:0/596852658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5400b83f0 0x7fe540160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.389+0000 7fe53f7fe700 1 -- 172.21.15.16:0/596852658 >> v1:172.21.15.169:6789/0 conn(0x7fe5400ced40 legacy=0x7fe5400b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.389+0000 7fe53f7fe700 1 -- 172.21.15.16:0/596852658 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5400d0aa0 con 0x7fe5400b4d20 2023-06-08T04:02:32.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe53f7fe700 1 --2- 172.21.15.16:0/596852658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5400b4d20 0x7fe5400d0fc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe538009e50 tx=0x7fe53800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8407201acf7f2a21 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:32.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe53dffb700 1 -- 172.21.15.16:0/596852658 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53800e070 con 0x7fe5400b4d20 2023-06-08T04:02:32.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe53dffb700 1 -- 172.21.15.16:0/596852658 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53800b910 con 0x7fe5400b4d20 2023-06-08T04:02:32.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe53dffb700 1 -- 172.21.15.16:0/596852658 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53800bcc0 con 0x7fe5400b4d20 2023-06-08T04:02:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe5459ff700 1 -- 172.21.15.16:0/596852658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5400b4d20 msgr2=0x7fe5400d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe5459ff700 1 --2- 172.21.15.16:0/596852658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5400b4d20 0x7fe5400d0fc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe538009e50 tx=0x7fe53800b330 comp rx=0 tx=0).stop 2023-06-08T04:02:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe5459ff700 1 -- 172.21.15.16:0/596852658 shutdown_connections 2023-06-08T04:02:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe5459ff700 1 --2- 172.21.15.16:0/596852658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5400b4d20 0x7fe5400d0fc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe5459ff700 1 --2- 172.21.15.16:0/596852658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5400b83f0 0x7fe540160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe5459ff700 1 -- 172.21.15.16:0/596852658 >> 172.21.15.16:0/596852658 conn(0x7fe5400cf610 msgr2=0x7fe5400cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:32.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe5459ff700 1 -- 172.21.15.16:0/596852658 shutdown_connections 2023-06-08T04:02:32.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.390+0000 7fe5459ff700 1 -- 172.21.15.16:0/596852658 wait complete. 2023-06-08T04:02:32.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.392+0000 7fe5459ff700 1 Processor -- start 2023-06-08T04:02:32.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.392+0000 7fe5459ff700 1 -- start start 2023-06-08T04:02:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.393+0000 7fe5459ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5400b4d20 0x7fe5400b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.393+0000 7fe5459ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5400b83f0 0x7fe54015dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.393+0000 7fe5459ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5400ced40 0x7fe5401e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.393+0000 7fe5459ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54015c9d0 con 0x7fe5400ced40 2023-06-08T04:02:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.393+0000 7fe5459ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54015cbe0 con 0x7fe5400b4d20 2023-06-08T04:02:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.393+0000 7fe5459ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54015cec0 con 0x7fe5400b83f0 2023-06-08T04:02:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53f7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5400ced40 0x7fe5401e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53f7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5400ced40 0x7fe5401e5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59944/0 (socket says 172.21.15.16:59944) 2023-06-08T04:02:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53effd700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5400b4d20 0x7fe5400b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53f7fe700 1 -- 172.21.15.16:0/944552069 learned_addr learned my addr 172.21.15.16:0/944552069 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53e7fc700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5400b83f0 0x7fe54015dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53f7fe700 1 -- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5400b83f0 msgr2=0x7fe54015dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53f7fe700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5400b83f0 0x7fe54015dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53f7fe700 1 -- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5400b4d20 msgr2=0x7fe5400b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53f7fe700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5400b4d20 0x7fe5400b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53f7fe700 1 -- 172.21.15.16:0/944552069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe538009b30 con 0x7fe5400ced40 2023-06-08T04:02:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53effd700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5400b4d20 0x7fe5400b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:02:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.394+0000 7fe53f7fe700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5400ced40 0x7fe5401e5d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe54006aca0 tx=0x7fe538004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.395+0000 7fe527fff700 1 -- 172.21.15.16:0/944552069 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538004800 con 0x7fe5400ced40 2023-06-08T04:02:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.395+0000 7fe527fff700 1 -- 172.21.15.16:0/944552069 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe538004960 con 0x7fe5400ced40 2023-06-08T04:02:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.395+0000 7fe5459ff700 1 -- 172.21.15.16:0/944552069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54015d1a0 con 0x7fe5400ced40 2023-06-08T04:02:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.395+0000 7fe527fff700 1 -- 172.21.15.16:0/944552069 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53801c680 con 0x7fe5400ced40 2023-06-08T04:02:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.395+0000 7fe5459ff700 1 -- 172.21.15.16:0/944552069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54015d760 con 0x7fe5400ced40 2023-06-08T04:02:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.396+0000 7fe5459ff700 1 -- 172.21.15.16:0/944552069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54015d8f0 con 0x7fe5400ced40 2023-06-08T04:02:32.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.397+0000 7fe527fff700 1 -- 172.21.15.16:0/944552069 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe53801c7e0 con 0x7fe5400ced40 2023-06-08T04:02:32.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.397+0000 7fe527fff700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe52c06ace0 0x7fe52c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.398+0000 7fe527fff700 1 -- 172.21.15.16:0/944552069 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe53808b0d0 con 0x7fe5400ced40 2023-06-08T04:02:32.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.398+0000 7fe53effd700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe52c06ace0 0x7fe52c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.399+0000 7fe53effd700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe52c06ace0 0x7fe52c06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe530009fd0 tx=0x7fe530009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:32.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.402+0000 7fe527fff700 1 -- 172.21.15.16:0/944552069 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe538056170 con 0x7fe5400ced40 2023-06-08T04:02:32.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.612+0000 7fe5459ff700 1 -- 172.21.15.16:0/944552069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe5400740e0 con 0x7fe5400ced40 2023-06-08T04:02:32.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.612+0000 7fe527fff700 1 -- 172.21.15.16:0/944552069 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe538059790 con 0x7fe5400ced40 2023-06-08T04:02:32.616 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:02:32.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 -- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe52c06ace0 msgr2=0x7fe52c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe52c06ace0 0x7fe52c06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe530009fd0 tx=0x7fe530009210 comp rx=0 tx=0).stop 2023-06-08T04:02:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 -- 172.21.15.16:0/944552069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5400ced40 msgr2=0x7fe5401e5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5400ced40 0x7fe5401e5d10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe54006aca0 tx=0x7fe538004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 -- 172.21.15.16:0/944552069 shutdown_connections 2023-06-08T04:02:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe52c06ace0 0x7fe52c06d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5400ced40 0x7fe5401e5d10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5400b4d20 0x7fe5400b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 --2- 172.21.15.16:0/944552069 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe5400b83f0 0x7fe54015dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 -- 172.21.15.16:0/944552069 >> 172.21.15.16:0/944552069 conn(0x7fe5400cf610 msgr2=0x7fe5400b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 -- 172.21.15.16:0/944552069 shutdown_connections 2023-06-08T04:02:32.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.614+0000 7fe5459ff700 1 -- 172.21.15.16:0/944552069 wait complete. 2023-06-08T04:02:32.636 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:02:32.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.835+0000 7fb4921ff700 1 Processor -- start 2023-06-08T04:02:32.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.835+0000 7fb4921ff700 1 -- start start 2023-06-08T04:02:32.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.836+0000 7fb4921ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb48c160a60 0x7fb48c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.836+0000 7fb4921ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb48c0b4b50 0x7fb48c0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.836+0000 7fb4921ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48c0d0800 con 0x7fb48c0b83f0 2023-06-08T04:02:32.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.836+0000 7fb4921ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48c160ed0 con 0x7fb48c0b4b50 2023-06-08T04:02:32.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.836+0000 7fb4921ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0b4fd0 con 0x7fb48c160a60 2023-06-08T04:02:32.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.837+0000 7fb48bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb48c0b4b50 0x7fb48c0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.837+0000 7fb48bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb48c0b4b50 0x7fb48c0d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59946/0 (socket says 172.21.15.16:59946) 2023-06-08T04:02:32.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.837+0000 7fb48bfff700 1 -- 172.21.15.16:0/1807617216 learned_addr learned my addr 172.21.15.16:0/1807617216 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:32.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.837+0000 7fb48b7fe700 1 --1- 172.21.15.16:0/1807617216 >> v1:172.21.15.16:6789/0 conn(0x7fb48c0b83f0 0x7fb48c0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59784/0 (socket says 172.21.15.16:59784) 2023-06-08T04:02:32.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.837+0000 7fb48affd700 1 --2- 172.21.15.16:0/1807617216 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb48c160a60 0x7fb48c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.837+0000 7fb48bfff700 1 -- 172.21.15.16:0/1807617216 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb48c160a60 msgr2=0x7fb48c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.837+0000 7fb48bfff700 1 --2- 172.21.15.16:0/1807617216 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb48c160a60 0x7fb48c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.837+0000 7fb48bfff700 1 -- 172.21.15.16:0/1807617216 >> v1:172.21.15.16:6789/0 conn(0x7fb48c0b83f0 legacy=0x7fb48c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.837+0000 7fb48bfff700 1 -- 172.21.15.16:0/1807617216 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c0cd1e0 con 0x7fb48c0b4b50 2023-06-08T04:02:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.837+0000 7fb48bfff700 1 --2- 172.21.15.16:0/1807617216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb48c0b4b50 0x7fb48c0d0fc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb484009e50 tx=0x7fb48400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58054ef528f1d45a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.838+0000 7fb48a7fc700 1 -- 172.21.15.16:0/1807617216 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48400e070 con 0x7fb48c0b4b50 2023-06-08T04:02:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.838+0000 7fb48a7fc700 1 -- 172.21.15.16:0/1807617216 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48400b910 con 0x7fb48c0b4b50 2023-06-08T04:02:32.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.838+0000 7fb48a7fc700 1 -- 172.21.15.16:0/1807617216 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48400bcc0 con 0x7fb48c0b4b50 2023-06-08T04:02:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.838+0000 7fb4921ff700 1 -- 172.21.15.16:0/1807617216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb48c0b4b50 msgr2=0x7fb48c0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.838+0000 7fb4921ff700 1 --2- 172.21.15.16:0/1807617216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb48c0b4b50 0x7fb48c0d0fc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb484009e50 tx=0x7fb48400b330 comp rx=0 tx=0).stop 2023-06-08T04:02:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.838+0000 7fb4921ff700 1 -- 172.21.15.16:0/1807617216 shutdown_connections 2023-06-08T04:02:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.838+0000 7fb4921ff700 1 --2- 172.21.15.16:0/1807617216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb48c0b4b50 0x7fb48c0d0fc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.838+0000 7fb4921ff700 1 --2- 172.21.15.16:0/1807617216 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb48c160a60 0x7fb48c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.838+0000 7fb4921ff700 1 -- 172.21.15.16:0/1807617216 >> 172.21.15.16:0/1807617216 conn(0x7fb48c0cf610 msgr2=0x7fb48c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:32.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.838+0000 7fb4921ff700 1 -- 172.21.15.16:0/1807617216 shutdown_connections 2023-06-08T04:02:32.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.838+0000 7fb4921ff700 1 -- 172.21.15.16:0/1807617216 wait complete. 2023-06-08T04:02:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.840+0000 7fb4921ff700 1 Processor -- start 2023-06-08T04:02:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.840+0000 7fb4921ff700 1 -- start start 2023-06-08T04:02:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.841+0000 7fb4921ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb48c0b4b50 0x7fb48c15a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.841+0000 7fb4921ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb48c0b83f0 0x7fb48c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.841+0000 7fb4921ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb48c160a60 0x7fb48c15b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.841+0000 7fb4921ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0b74d0 con 0x7fb48c0b83f0 2023-06-08T04:02:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.841+0000 7fb4921ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0cc130 con 0x7fb48c160a60 2023-06-08T04:02:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.841+0000 7fb4921ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0cc410 con 0x7fb48c0b4b50 2023-06-08T04:02:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.841+0000 7fb48affd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb48c0b83f0 0x7fb48c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.841+0000 7fb48affd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb48c0b83f0 0x7fb48c15f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59954/0 (socket says 172.21.15.16:59954) 2023-06-08T04:02:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.841+0000 7fb48affd700 1 -- 172.21.15.16:0/2888184588 learned_addr learned my addr 172.21.15.16:0/2888184588 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.841+0000 7fb48bfff700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb48c160a60 0x7fb48c15b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.841+0000 7fb48b7fe700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb48c0b4b50 0x7fb48c15a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb48affd700 1 -- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb48c0b4b50 msgr2=0x7fb48c15a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb48affd700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb48c0b4b50 0x7fb48c15a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb48affd700 1 -- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb48c160a60 msgr2=0x7fb48c15b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb48affd700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb48c160a60 0x7fb48c15b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:32.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb48affd700 1 -- 172.21.15.16:0/2888184588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484009b30 con 0x7fb48c0b83f0 2023-06-08T04:02:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb48b7fe700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb48c0b4b50 0x7fb48c15a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb48affd700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb48c0b83f0 0x7fb48c15f0f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb48000e870 tx=0x7fb48000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb473fff700 1 -- 172.21.15.16:0/2888184588 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480009590 con 0x7fb48c0b83f0 2023-06-08T04:02:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb473fff700 1 -- 172.21.15.16:0/2888184588 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb480013680 con 0x7fb48c0b83f0 2023-06-08T04:02:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb473fff700 1 -- 172.21.15.16:0/2888184588 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800139f0 con 0x7fb48c0b83f0 2023-06-08T04:02:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb4921ff700 1 -- 172.21.15.16:0/2888184588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48c0cc6f0 con 0x7fb48c0b83f0 2023-06-08T04:02:32.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.842+0000 7fb4921ff700 1 -- 172.21.15.16:0/2888184588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c0cc9d0 con 0x7fb48c0b83f0 2023-06-08T04:02:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.844+0000 7fb4921ff700 1 -- 172.21.15.16:0/2888184588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c0740e0 con 0x7fb48c0b83f0 2023-06-08T04:02:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.844+0000 7fb473fff700 1 -- 172.21.15.16:0/2888184588 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb480013b50 con 0x7fb48c0b83f0 2023-06-08T04:02:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.845+0000 7fb473fff700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb47806ace0 0x7fb47806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:32.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.845+0000 7fb473fff700 1 -- 172.21.15.16:0/2888184588 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4800894a0 con 0x7fb48c0b83f0 2023-06-08T04:02:32.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.846+0000 7fb48b7fe700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb47806ace0 0x7fb47806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:32.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.847+0000 7fb48b7fe700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb47806ace0 0x7fb47806d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb47c000f60 tx=0x7fb47c007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:32.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:32.850+0000 7fb473fff700 1 -- 172.21.15.16:0/2888184588 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb4800544b0 con 0x7fb48c0b83f0 2023-06-08T04:02:33.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.054+0000 7fb4921ff700 1 -- 172.21.15.16:0/2888184588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb48c15add0 con 0x7fb48c0b83f0 2023-06-08T04:02:33.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.055+0000 7fb473fff700 1 -- 172.21.15.16:0/2888184588 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb48c15add0 con 0x7fb48c0b83f0 2023-06-08T04:02:33.058 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:02:33.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 -- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb47806ace0 msgr2=0x7fb47806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb47806ace0 0x7fb47806d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb47c000f60 tx=0x7fb47c007df0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 -- 172.21.15.16:0/2888184588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb48c0b83f0 msgr2=0x7fb48c15f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb48c0b83f0 0x7fb48c15f0f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb48000e870 tx=0x7fb48000eb80 comp rx=0 tx=0).stop 2023-06-08T04:02:33.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 -- 172.21.15.16:0/2888184588 shutdown_connections 2023-06-08T04:02:33.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb47806ace0 0x7fb47806d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb48c160a60 0x7fb48c15b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb48c0b4b50 0x7fb48c15a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 --2- 172.21.15.16:0/2888184588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb48c0b83f0 0x7fb48c15f0f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 -- 172.21.15.16:0/2888184588 >> 172.21.15.16:0/2888184588 conn(0x7fb48c0cf610 msgr2=0x7fb48c0b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:33.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 -- 172.21.15.16:0/2888184588 shutdown_connections 2023-06-08T04:02:33.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.057+0000 7fb4921ff700 1 -- 172.21.15.16:0/2888184588 wait complete. 2023-06-08T04:02:33.079 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:02:33.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.277+0000 7f6251fff700 1 Processor -- start 2023-06-08T04:02:33.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.278+0000 7f6251fff700 1 -- start start 2023-06-08T04:02:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.279+0000 7f6251fff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f624c0b83f0 0x7f624c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.279+0000 7f6251fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f624c0b4d20 0x7f624c0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.279+0000 7f6251fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c0d0800 con 0x7f624c0ced40 2023-06-08T04:02:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.279+0000 7f6251fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c0cd1e0 con 0x7f624c0b4d20 2023-06-08T04:02:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.279+0000 7f6251fff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c0cd4c0 con 0x7f624c0b83f0 2023-06-08T04:02:33.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.279+0000 7f624bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f624c0b4d20 0x7f624c0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.279+0000 7f624bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f624c0b4d20 0x7f624c0d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59964/0 (socket says 172.21.15.16:59964) 2023-06-08T04:02:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.279+0000 7f624affd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f624c0ced40 0x7f624c0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59794/0 (socket says 172.21.15.16:59794) 2023-06-08T04:02:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.279+0000 7f624bfff700 1 -- 172.21.15.16:0/2438194221 learned_addr learned my addr 172.21.15.16:0/2438194221 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:33.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.280+0000 7f624b7fe700 1 --2- 172.21.15.16:0/2438194221 >> v2:172.21.15.169:3300/0 conn(0x7f624c0b83f0 0x7f624c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.280+0000 7f624bfff700 1 -- 172.21.15.16:0/2438194221 >> v2:172.21.15.169:3300/0 conn(0x7f624c0b83f0 msgr2=0x7f624c160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:33.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.280+0000 7f624bfff700 1 --2- 172.21.15.16:0/2438194221 >> v2:172.21.15.169:3300/0 conn(0x7f624c0b83f0 0x7f624c160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.280+0000 7f624bfff700 1 -- 172.21.15.16:0/2438194221 >> v1:172.21.15.16:6789/0 conn(0x7f624c0ced40 legacy=0x7f624c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.280+0000 7f624bfff700 1 -- 172.21.15.16:0/2438194221 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0d0aa0 con 0x7f624c0b4d20 2023-06-08T04:02:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.280+0000 7f624a7fc700 1 -- 172.21.15.16:0/2438194221 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165775666 0 0) 0x7f624c0d0800 con 0x7f624c0ced40 2023-06-08T04:02:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.280+0000 7f624bfff700 1 --2- 172.21.15.16:0/2438194221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c0b4d20 0x7f624c0d0fc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f624c06ca80 tx=0x7f624400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31c29cd6f8ba6f0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.280+0000 7f624a7fc700 1 -- 172.21.15.16:0/2438194221 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624400e070 con 0x7f624c0b4d20 2023-06-08T04:02:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.280+0000 7f624a7fc700 1 -- 172.21.15.16:0/2438194221 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624400b9c0 con 0x7f624c0b4d20 2023-06-08T04:02:33.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.280+0000 7f624a7fc700 1 -- 172.21.15.16:0/2438194221 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624400bd70 con 0x7f624c0b4d20 2023-06-08T04:02:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.281+0000 7f6251fff700 1 -- 172.21.15.16:0/2438194221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c0b4d20 msgr2=0x7f624c0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.281+0000 7f6251fff700 1 --2- 172.21.15.16:0/2438194221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c0b4d20 0x7f624c0d0fc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f624c06ca80 tx=0x7f624400b330 comp rx=0 tx=0).stop 2023-06-08T04:02:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.281+0000 7f6251fff700 1 -- 172.21.15.16:0/2438194221 shutdown_connections 2023-06-08T04:02:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.281+0000 7f6251fff700 1 --2- 172.21.15.16:0/2438194221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c0b4d20 0x7f624c0d0fc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.281+0000 7f6251fff700 1 --2- 172.21.15.16:0/2438194221 >> v2:172.21.15.169:3300/0 conn(0x7f624c0b83f0 0x7f624c160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.281+0000 7f6251fff700 1 -- 172.21.15.16:0/2438194221 >> 172.21.15.16:0/2438194221 conn(0x7f624c0cf610 msgr2=0x7f624c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.281+0000 7f6251fff700 1 -- 172.21.15.16:0/2438194221 shutdown_connections 2023-06-08T04:02:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.281+0000 7f6251fff700 1 -- 172.21.15.16:0/2438194221 wait complete. 2023-06-08T04:02:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.283+0000 7f6251fff700 1 Processor -- start 2023-06-08T04:02:33.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.283+0000 7f6251fff700 1 -- start start 2023-06-08T04:02:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f6251fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c0b4d20 0x7f624c145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f6251fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f624c0b83f0 0x7f624c15e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f6251fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f624c0ced40 0x7f624c15e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f6251fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1e62d0 con 0x7f624c0b4d20 2023-06-08T04:02:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f6251fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0c9c60 con 0x7f624c0ced40 2023-06-08T04:02:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f6251fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0c9f40 con 0x7f624c0b83f0 2023-06-08T04:02:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f624b7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c0b4d20 0x7f624c145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f624b7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c0b4d20 0x7f624c145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:59978/0 (socket says 172.21.15.16:59978) 2023-06-08T04:02:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f624b7fe700 1 -- 172.21.15.16:0/2908333977 learned_addr learned my addr 172.21.15.16:0/2908333977 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f624affd700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f624c0b83f0 0x7f624c15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f624bfff700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f624c0ced40 0x7f624c15e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f624b7fe700 1 -- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f624c0b83f0 msgr2=0x7f624c15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f624b7fe700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f624c0b83f0 0x7f624c15e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f624b7fe700 1 -- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f624c0ced40 msgr2=0x7f624c15e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f624b7fe700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f624c0ced40 0x7f624c15e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.284+0000 7f624b7fe700 1 -- 172.21.15.16:0/2908333977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6244009b30 con 0x7f624c0b4d20 2023-06-08T04:02:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.285+0000 7f624b7fe700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c0b4d20 0x7f624c145b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f623c00e810 tx=0x7f623c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.285+0000 7f6233fff700 1 -- 172.21.15.16:0/2908333977 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c013610 con 0x7f624c0b4d20 2023-06-08T04:02:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.285+0000 7f6233fff700 1 -- 172.21.15.16:0/2908333977 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c013770 con 0x7f624c0b4d20 2023-06-08T04:02:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.285+0000 7f6233fff700 1 -- 172.21.15.16:0/2908333977 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c013b20 con 0x7f624c0b4d20 2023-06-08T04:02:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.285+0000 7f6251fff700 1 -- 172.21.15.16:0/2908333977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c1e5f60 con 0x7f624c0b4d20 2023-06-08T04:02:33.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.285+0000 7f6251fff700 1 -- 172.21.15.16:0/2908333977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c146050 con 0x7f624c0b4d20 2023-06-08T04:02:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.286+0000 7f6251fff700 1 -- 172.21.15.16:0/2908333977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c1e6660 con 0x7f624c0b4d20 2023-06-08T04:02:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.287+0000 7f6233fff700 1 -- 172.21.15.16:0/2908333977 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f623c013c80 con 0x7f624c0b4d20 2023-06-08T04:02:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.288+0000 7f6233fff700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f623806ace0 0x7f623806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.288+0000 7f6233fff700 1 -- 172.21.15.16:0/2908333977 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f623c0891f0 con 0x7f624c0b4d20 2023-06-08T04:02:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.288+0000 7f624affd700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f623806ace0 0x7f623806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.289+0000 7f624affd700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f623806ace0 0x7f623806d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f624c0d0090 tx=0x7f6240007c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.292+0000 7f6233fff700 1 -- 172.21.15.16:0/2908333977 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f623c057ca0 con 0x7f624c0b4d20 2023-06-08T04:02:33.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.495+0000 7f6251fff700 1 -- 172.21.15.16:0/2908333977 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f624c0740e0 con 0x7f624c0b4d20 2023-06-08T04:02:33.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.495+0000 7f6233fff700 1 -- 172.21.15.16:0/2908333977 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f623c057830 con 0x7f624c0b4d20 2023-06-08T04:02:33.499 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:02:33.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 -- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f623806ace0 msgr2=0x7f623806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f623806ace0 0x7f623806d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f624c0d0090 tx=0x7f6240007c90 comp rx=0 tx=0).stop 2023-06-08T04:02:33.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 -- 172.21.15.16:0/2908333977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c0b4d20 msgr2=0x7f624c145b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c0b4d20 0x7f624c145b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f623c00e810 tx=0x7f623c00ebd0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 -- 172.21.15.16:0/2908333977 shutdown_connections 2023-06-08T04:02:33.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f623806ace0 0x7f623806d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f624c0ced40 0x7f624c15e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c0b4d20 0x7f624c145b10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 --2- 172.21.15.16:0/2908333977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f624c0b83f0 0x7f624c15e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 -- 172.21.15.16:0/2908333977 >> 172.21.15.16:0/2908333977 conn(0x7f624c0cf610 msgr2=0x7f624c0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:33.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 -- 172.21.15.16:0/2908333977 shutdown_connections 2023-06-08T04:02:33.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.498+0000 7f6251fff700 1 -- 172.21.15.16:0/2908333977 wait complete. 2023-06-08T04:02:33.520 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:02:33.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.719+0000 7f47a01ff700 1 Processor -- start 2023-06-08T04:02:33.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.719+0000 7f47a01ff700 1 -- start start 2023-06-08T04:02:33.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.720+0000 7f47a01ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f47980b83f0 0x7f4798160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.720+0000 7f47a01ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f47980ced40 0x7f47980b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.720+0000 7f47a01ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47980d0800 con 0x7f47980b4b50 2023-06-08T04:02:33.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.720+0000 7f47a01ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47980b4fd0 con 0x7f47980b83f0 2023-06-08T04:02:33.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.720+0000 7f47a01ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47980cd1e0 con 0x7f47980ced40 2023-06-08T04:02:33.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.720+0000 7f479df9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f47980b83f0 0x7f4798160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.720+0000 7f479e79c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f47980b4b50 0x7f479806b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59810/0 (socket says 172.21.15.16:59810) 2023-06-08T04:02:33.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.720+0000 7f479e79c700 1 -- 172.21.15.16:0/213896603 learned_addr learned my addr 172.21.15.16:0/213896603 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:33.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.721+0000 7f479d79a700 1 --2- 172.21.15.16:0/213896603 >> v2:172.21.15.169:3300/0 conn(0x7f47980ced40 0x7f47980b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.721+0000 7f479df9b700 1 -- 172.21.15.16:0/213896603 >> v2:172.21.15.169:3300/0 conn(0x7f47980ced40 msgr2=0x7f47980b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:33.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.721+0000 7f479df9b700 1 --2- 172.21.15.16:0/213896603 >> v2:172.21.15.169:3300/0 conn(0x7f47980ced40 0x7f47980b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.721+0000 7f479df9b700 1 -- 172.21.15.16:0/213896603 >> v1:172.21.15.16:6789/0 conn(0x7f47980b4b50 legacy=0x7f479806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.721+0000 7f479df9b700 1 -- 172.21.15.16:0/213896603 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47980cd4c0 con 0x7f47980b83f0 2023-06-08T04:02:33.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.721+0000 7f479d79a700 1 --2- 172.21.15.16:0/213896603 >> v2:172.21.15.169:3300/0 conn(0x7f47980ced40 0x7f47980b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:33.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.721+0000 7f479cf99700 1 -- 172.21.15.16:0/213896603 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729793118 0 0) 0x7f47980d0800 con 0x7f47980b4b50 2023-06-08T04:02:33.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.721+0000 7f479df9b700 1 --2- 172.21.15.16:0/213896603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47980b83f0 0x7f4798160a60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f479806c4e0 tx=0x7f4794009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4282cabe278f1fbe server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:33.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.721+0000 7f479cf99700 1 -- 172.21.15.16:0/213896603 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794011830 con 0x7f47980b83f0 2023-06-08T04:02:33.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.721+0000 7f479cf99700 1 -- 172.21.15.16:0/213896603 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4794011990 con 0x7f47980b83f0 2023-06-08T04:02:33.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.721+0000 7f479cf99700 1 -- 172.21.15.16:0/213896603 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794011d20 con 0x7f47980b83f0 2023-06-08T04:02:33.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.722+0000 7f47a01ff700 1 -- 172.21.15.16:0/213896603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47980b83f0 msgr2=0x7f4798160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.722+0000 7f47a01ff700 1 --2- 172.21.15.16:0/213896603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47980b83f0 0x7f4798160a60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f479806c4e0 tx=0x7f4794009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:33.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.722+0000 7f47a01ff700 1 -- 172.21.15.16:0/213896603 shutdown_connections 2023-06-08T04:02:33.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.722+0000 7f47a01ff700 1 --2- 172.21.15.16:0/213896603 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47980b83f0 0x7f4798160a60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.722+0000 7f47a01ff700 1 --2- 172.21.15.16:0/213896603 >> v2:172.21.15.169:3300/0 conn(0x7f47980ced40 0x7f47980b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.722+0000 7f47a01ff700 1 -- 172.21.15.16:0/213896603 >> 172.21.15.16:0/213896603 conn(0x7f47980cf610 msgr2=0x7f47980cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:33.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.722+0000 7f47a01ff700 1 -- 172.21.15.16:0/213896603 shutdown_connections 2023-06-08T04:02:33.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.722+0000 7f47a01ff700 1 -- 172.21.15.16:0/213896603 wait complete. 2023-06-08T04:02:33.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.724+0000 7f47a01ff700 1 Processor -- start 2023-06-08T04:02:33.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.724+0000 7f47a01ff700 1 -- start start 2023-06-08T04:02:33.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.725+0000 7f47a01ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47980b4b50 0x7f4798153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.725+0000 7f47a01ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47980b83f0 0x7f4798150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.725+0000 7f47a01ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47980ced40 0x7f4798151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.725+0000 7f47a01ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479815cfb0 con 0x7f47980ced40 2023-06-08T04:02:33.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.725+0000 7f47a01ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4798155790 con 0x7f47980b83f0 2023-06-08T04:02:33.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.725+0000 7f47a01ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4798154300 con 0x7f47980b4b50 2023-06-08T04:02:33.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.725+0000 7f479e79c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47980ced40 0x7f4798151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.725+0000 7f479e79c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47980ced40 0x7f4798151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60002/0 (socket says 172.21.15.16:60002) 2023-06-08T04:02:33.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.725+0000 7f479e79c700 1 -- 172.21.15.16:0/3735312174 learned_addr learned my addr 172.21.15.16:0/3735312174 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:33.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.725+0000 7f479df9b700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47980b4b50 0x7f4798153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.725+0000 7f479d79a700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47980b83f0 0x7f4798150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.726+0000 7f479e79c700 1 -- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47980b4b50 msgr2=0x7f4798153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.726+0000 7f479e79c700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47980b4b50 0x7f4798153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.726+0000 7f479e79c700 1 -- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47980b83f0 msgr2=0x7f4798150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.726+0000 7f479e79c700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47980b83f0 0x7f4798150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.726+0000 7f479e79c700 1 -- 172.21.15.16:0/3735312174 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47940094a0 con 0x7f47980ced40 2023-06-08T04:02:33.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.726+0000 7f479e79c700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47980ced40 0x7f4798151950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4790002230 tx=0x7f479000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:33.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.726+0000 7f478e7fc700 1 -- 172.21.15.16:0/3735312174 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479000aac0 con 0x7f47980ced40 2023-06-08T04:02:33.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.726+0000 7f478e7fc700 1 -- 172.21.15.16:0/3735312174 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479000ac40 con 0x7f47980ced40 2023-06-08T04:02:33.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.726+0000 7f47a01ff700 1 -- 172.21.15.16:0/3735312174 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4798153a90 con 0x7f47980ced40 2023-06-08T04:02:33.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.726+0000 7f478e7fc700 1 -- 172.21.15.16:0/3735312174 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47900070d0 con 0x7f47980ced40 2023-06-08T04:02:33.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.726+0000 7f47a01ff700 1 -- 172.21.15.16:0/3735312174 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4798154020 con 0x7f47980ced40 2023-06-08T04:02:33.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.727+0000 7f47a01ff700 1 -- 172.21.15.16:0/3735312174 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4798066d50 con 0x7f47980ced40 2023-06-08T04:02:33.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.728+0000 7f478e7fc700 1 -- 172.21.15.16:0/3735312174 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4790007250 con 0x7f47980ced40 2023-06-08T04:02:33.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.729+0000 7f478e7fc700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f477c06ace0 0x7f477c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:33.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.729+0000 7f478e7fc700 1 -- 172.21.15.16:0/3735312174 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4790088ef0 con 0x7f47980ced40 2023-06-08T04:02:33.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.730+0000 7f479df9b700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f477c06ace0 0x7f477c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:33.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.730+0000 7f479df9b700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f477c06ace0 0x7f477c06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f47940090b0 tx=0x7f4794008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:33.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.733+0000 7f478e7fc700 1 -- 172.21.15.16:0/3735312174 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4790053f90 con 0x7f47980ced40 2023-06-08T04:02:33.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.939+0000 7f47a01ff700 1 -- 172.21.15.16:0/3735312174 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f479815d0f0 con 0x7f47980ced40 2023-06-08T04:02:33.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.939+0000 7f478e7fc700 1 -- 172.21.15.16:0/3735312174 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f479815d0f0 con 0x7f47980ced40 2023-06-08T04:02:33.943 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:02:33.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.941+0000 7f47a01ff700 1 -- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f477c06ace0 msgr2=0x7f477c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.941+0000 7f47a01ff700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f477c06ace0 0x7f477c06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f47940090b0 tx=0x7f4794008030 comp rx=0 tx=0).stop 2023-06-08T04:02:33.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.941+0000 7f47a01ff700 1 -- 172.21.15.16:0/3735312174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47980ced40 msgr2=0x7f4798151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:33.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.941+0000 7f47a01ff700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47980ced40 0x7f4798151950 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4790002230 tx=0x7f479000cf50 comp rx=0 tx=0).stop 2023-06-08T04:02:33.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.942+0000 7f47a01ff700 1 -- 172.21.15.16:0/3735312174 shutdown_connections 2023-06-08T04:02:33.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.942+0000 7f47a01ff700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f477c06ace0 0x7f477c06d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.942+0000 7f47a01ff700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47980ced40 0x7f4798151950 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.942+0000 7f47a01ff700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f47980b4b50 0x7f4798153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.942+0000 7f47a01ff700 1 --2- 172.21.15.16:0/3735312174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47980b83f0 0x7f4798150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:33.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.942+0000 7f47a01ff700 1 -- 172.21.15.16:0/3735312174 >> 172.21.15.16:0/3735312174 conn(0x7f47980cf610 msgr2=0x7f47980b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:33.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.942+0000 7f47a01ff700 1 -- 172.21.15.16:0/3735312174 shutdown_connections 2023-06-08T04:02:33.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:33.942+0000 7f47a01ff700 1 -- 172.21.15.16:0/3735312174 wait complete. 2023-06-08T04:02:33.963 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:34.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.159+0000 7f748e5ff700 1 Processor -- start 2023-06-08T04:02:34.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.159+0000 7f748e5ff700 1 -- start start 2023-06-08T04:02:34.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f748e5ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7488160a60 0x7f74880b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f748e5ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f74880b4b50 0x7f74880d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f748e5ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74880d0800 con 0x7f74880b83f0 2023-06-08T04:02:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f748e5ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7488160ed0 con 0x7f7488160a60 2023-06-08T04:02:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f748e5ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74880b4fd0 con 0x7f74880b4b50 2023-06-08T04:02:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f74877fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7488160a60 0x7f74880b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f7487fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f74880b83f0 0x7f74880ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59820/0 (socket says 172.21.15.16:59820) 2023-06-08T04:02:34.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f7487fff700 1 -- 172.21.15.16:0/2327578306 learned_addr learned my addr 172.21.15.16:0/2327578306 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f748cb9c700 1 --2- 172.21.15.16:0/2327578306 >> v2:172.21.15.169:3300/0 conn(0x7f74880b4b50 0x7f74880d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f74877fe700 1 -- 172.21.15.16:0/2327578306 >> v2:172.21.15.169:3300/0 conn(0x7f74880b4b50 msgr2=0x7f74880d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f74877fe700 1 --2- 172.21.15.16:0/2327578306 >> v2:172.21.15.169:3300/0 conn(0x7f74880b4b50 0x7f74880d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f74877fe700 1 -- 172.21.15.16:0/2327578306 >> v1:172.21.15.16:6789/0 conn(0x7f74880b83f0 legacy=0x7f74880ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.161+0000 7f74877fe700 1 -- 172.21.15.16:0/2327578306 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74880cd1e0 con 0x7f7488160a60 2023-06-08T04:02:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.162+0000 7f74877fe700 1 --2- 172.21.15.16:0/2327578306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7488160a60 0x7f74880b4610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f74880b2590 tx=0x7f747c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf20524569e031 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:34.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.162+0000 7f7486ffd700 1 -- 172.21.15.16:0/2327578306 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c011830 con 0x7f7488160a60 2023-06-08T04:02:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.162+0000 7f7486ffd700 1 -- 172.21.15.16:0/2327578306 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c011990 con 0x7f7488160a60 2023-06-08T04:02:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.162+0000 7f7486ffd700 1 -- 172.21.15.16:0/2327578306 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c011d20 con 0x7f7488160a60 2023-06-08T04:02:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.162+0000 7f748e5ff700 1 -- 172.21.15.16:0/2327578306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7488160a60 msgr2=0x7f74880b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.162+0000 7f748e5ff700 1 --2- 172.21.15.16:0/2327578306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7488160a60 0x7f74880b4610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f74880b2590 tx=0x7f747c009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.162+0000 7f748e5ff700 1 -- 172.21.15.16:0/2327578306 shutdown_connections 2023-06-08T04:02:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.162+0000 7f748e5ff700 1 --2- 172.21.15.16:0/2327578306 >> v2:172.21.15.169:3300/0 conn(0x7f74880b4b50 0x7f74880d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.162+0000 7f748e5ff700 1 --2- 172.21.15.16:0/2327578306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7488160a60 0x7f74880b4610 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.162+0000 7f748e5ff700 1 -- 172.21.15.16:0/2327578306 >> 172.21.15.16:0/2327578306 conn(0x7f74880cf610 msgr2=0x7f74880cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:34.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.163+0000 7f748e5ff700 1 -- 172.21.15.16:0/2327578306 shutdown_connections 2023-06-08T04:02:34.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.163+0000 7f748e5ff700 1 -- 172.21.15.16:0/2327578306 wait complete. 2023-06-08T04:02:34.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.164+0000 7f748e5ff700 1 Processor -- start 2023-06-08T04:02:34.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.164+0000 7f748e5ff700 1 -- start start 2023-06-08T04:02:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.165+0000 7f748e5ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74880b4b50 0x7f7488150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.165+0000 7f748e5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74880b83f0 0x7f74880c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.165+0000 7f748e5ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7488160a60 0x7f74880c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.165+0000 7f748e5ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7488151100 con 0x7f7488160a60 2023-06-08T04:02:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.165+0000 7f748e5ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74880c6f80 con 0x7f74880b4b50 2023-06-08T04:02:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.165+0000 7f748e5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74880c7260 con 0x7f74880b83f0 2023-06-08T04:02:34.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.166+0000 7f748cb9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7488160a60 0x7f74880c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.166+0000 7f748cb9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7488160a60 0x7f74880c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60020/0 (socket says 172.21.15.16:60020) 2023-06-08T04:02:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.166+0000 7f748cb9c700 1 -- 172.21.15.16:0/3232434929 learned_addr learned my addr 172.21.15.16:0/3232434929 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.166+0000 7f74877fe700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74880b83f0 0x7f74880c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.166+0000 7f7487fff700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74880b4b50 0x7f7488150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.166+0000 7f748cb9c700 1 -- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74880b83f0 msgr2=0x7f74880c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.166+0000 7f748cb9c700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74880b83f0 0x7f74880c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.166+0000 7f748cb9c700 1 -- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74880b4b50 msgr2=0x7f7488150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.166+0000 7f748cb9c700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74880b4b50 0x7f7488150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.166+0000 7f748cb9c700 1 -- 172.21.15.16:0/3232434929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0094a0 con 0x7f7488160a60 2023-06-08T04:02:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.166+0000 7f748cb9c700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7488160a60 0x7f74880c66c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7480007e40 tx=0x7f748000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.167+0000 7f7484ff9700 1 -- 172.21.15.16:0/3232434929 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748000ed30 con 0x7f7488160a60 2023-06-08T04:02:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.167+0000 7f7484ff9700 1 -- 172.21.15.16:0/3232434929 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7480014420 con 0x7f7488160a60 2023-06-08T04:02:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.167+0000 7f7484ff9700 1 -- 172.21.15.16:0/3232434929 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74800147d0 con 0x7f7488160a60 2023-06-08T04:02:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.167+0000 7f748e5ff700 1 -- 172.21.15.16:0/3232434929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74880c7540 con 0x7f7488160a60 2023-06-08T04:02:34.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.167+0000 7f748e5ff700 1 -- 172.21.15.16:0/3232434929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74880c8560 con 0x7f7488160a60 2023-06-08T04:02:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.168+0000 7f748e5ff700 1 -- 172.21.15.16:0/3232434929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74880c7b90 con 0x7f7488160a60 2023-06-08T04:02:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.169+0000 7f7484ff9700 1 -- 172.21.15.16:0/3232434929 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7480014930 con 0x7f7488160a60 2023-06-08T04:02:34.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.170+0000 7f7484ff9700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f747406ace0 0x7f747406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.170+0000 7f7484ff9700 1 -- 172.21.15.16:0/3232434929 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7480089c70 con 0x7f7488160a60 2023-06-08T04:02:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.170+0000 7f7487fff700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f747406ace0 0x7f747406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.171+0000 7f7487fff700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f747406ace0 0x7f747406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7478005910 tx=0x7f7478009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:34.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.174+0000 7f7484ff9700 1 -- 172.21.15.16:0/3232434929 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7480054d30 con 0x7f7488160a60 2023-06-08T04:02:34.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.381+0000 7f748e5ff700 1 -- 172.21.15.16:0/3232434929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74880c7d40 con 0x7f7488160a60 2023-06-08T04:02:34.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.382+0000 7f7484ff9700 1 -- 172.21.15.16:0/3232434929 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7f74880c7d40 con 0x7f7488160a60 2023-06-08T04:02:34.386 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:34.387 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:34.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 -- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f747406ace0 msgr2=0x7f747406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f747406ace0 0x7f747406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7478005910 tx=0x7f7478009040 comp rx=0 tx=0).stop 2023-06-08T04:02:34.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 -- 172.21.15.16:0/3232434929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7488160a60 msgr2=0x7f74880c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7488160a60 0x7f74880c66c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7480007e40 tx=0x7f748000e3c0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 -- 172.21.15.16:0/3232434929 shutdown_connections 2023-06-08T04:02:34.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f747406ace0 0x7f747406d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7488160a60 0x7f74880c66c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74880b4b50 0x7f7488150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 --2- 172.21.15.16:0/3232434929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f74880b83f0 0x7f74880c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 -- 172.21.15.16:0/3232434929 >> 172.21.15.16:0/3232434929 conn(0x7f74880cf610 msgr2=0x7f748806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 -- 172.21.15.16:0/3232434929 shutdown_connections 2023-06-08T04:02:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.385+0000 7f748e5ff700 1 -- 172.21.15.16:0/3232434929 wait complete. 2023-06-08T04:02:34.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:01:54.980592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:01:56.264608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:02:34.407 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:02:34.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.607+0000 7fc0e0fff700 1 Processor -- start 2023-06-08T04:02:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.608+0000 7fc0e0fff700 1 -- start start 2023-06-08T04:02:34.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.609+0000 7fc0e0fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b83f0 0x7fc0dc160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.609+0000 7fc0e0fff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc0dc0b4d20 0x7fc0dc0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.609+0000 7fc0e0fff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0dc0d0800 con 0x7fc0dc0ced40 2023-06-08T04:02:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.609+0000 7fc0e0fff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc0cd1e0 con 0x7fc0dc0b4d20 2023-06-08T04:02:34.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.609+0000 7fc0e0fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0cd4c0 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.609+0000 7fc0da59c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b83f0 0x7fc0dc160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.609+0000 7fc0dad9d700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc0dc0b4d20 0x7fc0dc0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.609+0000 7fc0da59c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b83f0 0x7fc0dc160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:40486/0 (socket says 172.21.15.16:40486) 2023-06-08T04:02:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.609+0000 7fc0da59c700 1 -- 172.21.15.16:0/4035905325 learned_addr learned my addr 172.21.15.16:0/4035905325 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.610+0000 7fc0da59c700 1 -- 172.21.15.16:0/4035905325 >> v2:172.21.15.169:3300/0 conn(0x7fc0dc0b4d20 msgr2=0x7fc0dc0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.610+0000 7fc0da59c700 1 --2- 172.21.15.16:0/4035905325 >> v2:172.21.15.169:3300/0 conn(0x7fc0dc0b4d20 0x7fc0dc0d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.610+0000 7fc0da59c700 1 -- 172.21.15.16:0/4035905325 >> v1:172.21.15.169:6789/0 conn(0x7fc0dc0ced40 legacy=0x7fc0dc0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.610+0000 7fc0d9d9b700 1 -- 172.21.15.16:0/4035905325 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440616921 0 0) 0x7fc0dc0d0800 con 0x7fc0dc0ced40 2023-06-08T04:02:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.610+0000 7fc0da59c700 1 -- 172.21.15.16:0/4035905325 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc0d0aa0 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.610+0000 7fc0da59c700 1 --2- 172.21.15.16:0/4035905325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b83f0 0x7fc0dc160a60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0098f0 tx=0x7fc0cc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd284acccc246ac server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.610+0000 7fc0d9d9b700 1 -- 172.21.15.16:0/4035905325 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc011830 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.611+0000 7fc0d9d9b700 1 -- 172.21.15.16:0/4035905325 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc011990 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.611+0000 7fc0d9d9b700 1 -- 172.21.15.16:0/4035905325 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc011d20 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.611+0000 7fc0e0fff700 1 -- 172.21.15.16:0/4035905325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b83f0 msgr2=0x7fc0dc160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.611+0000 7fc0e0fff700 1 --2- 172.21.15.16:0/4035905325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b83f0 0x7fc0dc160a60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0098f0 tx=0x7fc0cc009c00 comp rx=0 tx=0).stop 2023-06-08T04:02:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.611+0000 7fc0e0fff700 1 -- 172.21.15.16:0/4035905325 shutdown_connections 2023-06-08T04:02:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.611+0000 7fc0e0fff700 1 --2- 172.21.15.16:0/4035905325 >> v2:172.21.15.169:3300/0 conn(0x7fc0dc0b4d20 0x7fc0dc0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.611+0000 7fc0e0fff700 1 --2- 172.21.15.16:0/4035905325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b83f0 0x7fc0dc160a60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.611+0000 7fc0e0fff700 1 -- 172.21.15.16:0/4035905325 >> 172.21.15.16:0/4035905325 conn(0x7fc0dc0cf610 msgr2=0x7fc0dc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.611+0000 7fc0e0fff700 1 -- 172.21.15.16:0/4035905325 shutdown_connections 2023-06-08T04:02:34.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.611+0000 7fc0e0fff700 1 -- 172.21.15.16:0/4035905325 wait complete. 2023-06-08T04:02:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.614+0000 7fc0e0fff700 1 Processor -- start 2023-06-08T04:02:34.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.614+0000 7fc0e0fff700 1 -- start start 2023-06-08T04:02:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.615+0000 7fc0e0fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b4d20 0x7fc0dc15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.615+0000 7fc0e0fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0b83f0 0x7fc0dc0c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.615+0000 7fc0e0fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0dc0ced40 0x7fc0dc1f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.615+0000 7fc0e0fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc15ec10 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.615+0000 7fc0e0fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc15df90 con 0x7fc0dc0ced40 2023-06-08T04:02:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.615+0000 7fc0e0fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc15e270 con 0x7fc0dc0b4d20 2023-06-08T04:02:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.615+0000 7fc0d3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0b83f0 0x7fc0dc0c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.615+0000 7fc0da59c700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b4d20 0x7fc0dc15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.615+0000 7fc0d3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0b83f0 0x7fc0dc0c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60022/0 (socket says 172.21.15.16:60022) 2023-06-08T04:02:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.615+0000 7fc0d3fff700 1 -- 172.21.15.16:0/763624002 learned_addr learned my addr 172.21.15.16:0/763624002 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:34.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.615+0000 7fc0dad9d700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0dc0ced40 0x7fc0dc1f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.616+0000 7fc0d3fff700 1 -- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b4d20 msgr2=0x7fc0dc15f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.616+0000 7fc0d3fff700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b4d20 0x7fc0dc15f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.616+0000 7fc0d3fff700 1 -- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0dc0ced40 msgr2=0x7fc0dc1f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.616+0000 7fc0d3fff700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0dc0ced40 0x7fc0dc1f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.616+0000 7fc0d3fff700 1 -- 172.21.15.16:0/763624002 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc009550 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.616+0000 7fc0d3fff700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0b83f0 0x7fc0dc0c9200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c550 tx=0x7fc0c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:34.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.616+0000 7fc0d2ffd700 1 -- 172.21.15.16:0/763624002 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40054e0 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.616+0000 7fc0d2ffd700 1 -- 172.21.15.16:0/763624002 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c4003680 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.616+0000 7fc0d2ffd700 1 -- 172.21.15.16:0/763624002 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4003a30 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.616+0000 7fc0e0fff700 1 -- 172.21.15.16:0/763624002 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0dc15e550 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.617+0000 7fc0e0fff700 1 -- 172.21.15.16:0/763624002 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0dc0c9740 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.618+0000 7fc0e0fff700 1 -- 172.21.15.16:0/763624002 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0dc15ed50 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.618+0000 7fc0d2ffd700 1 -- 172.21.15.16:0/763624002 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc0c4003b90 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.619+0000 7fc0d2ffd700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc0bc06ace0 0x7fc0bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:34.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.619+0000 7fc0d2ffd700 1 -- 172.21.15.16:0/763624002 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0c4088890 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.620+0000 7fc0da59c700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc0bc06ace0 0x7fc0bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:34.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.621+0000 7fc0da59c700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc0bc06ace0 0x7fc0bc06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009c40 tx=0x7fc0cc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:34.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.624+0000 7fc0d2ffd700 1 -- 172.21.15.16:0/763624002 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc0dc15ed50 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.829+0000 7fc0e0fff700 1 -- 172.21.15.16:0/763624002 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc0dc15ed50 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.829+0000 7fc0d2ffd700 1 -- 172.21.15.16:0/763624002 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc0dc15ed50 con 0x7fc0dc0b83f0 2023-06-08T04:02:34.833 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:02:34.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.831+0000 7fc0e0fff700 1 -- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc0bc06ace0 msgr2=0x7fc0bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.831+0000 7fc0e0fff700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc0bc06ace0 0x7fc0bc06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009c40 tx=0x7fc0cc008030 comp rx=0 tx=0).stop 2023-06-08T04:02:34.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.831+0000 7fc0e0fff700 1 -- 172.21.15.16:0/763624002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0b83f0 msgr2=0x7fc0dc0c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:34.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.831+0000 7fc0e0fff700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0b83f0 0x7fc0dc0c9200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c550 tx=0x7fc0c400c860 comp rx=0 tx=0).stop 2023-06-08T04:02:34.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.831+0000 7fc0e0fff700 1 -- 172.21.15.16:0/763624002 shutdown_connections 2023-06-08T04:02:34.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.831+0000 7fc0e0fff700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc0bc06ace0 0x7fc0bc06d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.831+0000 7fc0e0fff700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0dc0ced40 0x7fc0dc1f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.832+0000 7fc0e0fff700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0dc0b4d20 0x7fc0dc15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.832+0000 7fc0e0fff700 1 --2- 172.21.15.16:0/763624002 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0b83f0 0x7fc0dc0c9200 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:34.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.832+0000 7fc0e0fff700 1 -- 172.21.15.16:0/763624002 >> 172.21.15.16:0/763624002 conn(0x7fc0dc0cf610 msgr2=0x7fc0dc06bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:34.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.832+0000 7fc0e0fff700 1 -- 172.21.15.16:0/763624002 shutdown_connections 2023-06-08T04:02:34.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:34.832+0000 7fc0e0fff700 1 -- 172.21.15.16:0/763624002 wait complete. 2023-06-08T04:02:34.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:02:35.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.053+0000 7f14295ff700 1 Processor -- start 2023-06-08T04:02:35.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.053+0000 7f14295ff700 1 -- start start 2023-06-08T04:02:35.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.054+0000 7f14295ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1424160a60 0x7f14240b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.054+0000 7f14295ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14240d0800 con 0x7f14240b4b50 2023-06-08T04:02:35.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.054+0000 7f14295ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14240cd1e0 con 0x7f14240b83f0 2023-06-08T04:02:35.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.054+0000 7f14295ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1424160ed0 con 0x7f1424160a60 2023-06-08T04:02:35.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.054+0000 7f14237fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f14240b4b50 0x7f14240d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59824/0 (socket says 172.21.15.16:59824) 2023-06-08T04:02:35.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.054+0000 7f14237fe700 1 -- 172.21.15.16:0/3160784374 learned_addr learned my addr 172.21.15.16:0/3160784374 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:35.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f14227fc700 1 --2- 172.21.15.16:0/3160784374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1424160a60 0x7f14240b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098035757 0 0) 0x7f14240d0800 con 0x7f14240b4b50 2023-06-08T04:02:35.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f140c0035b0 con 0x7f14240b4b50 2023-06-08T04:02:35.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3087431562 0 0) 0x7f140c0035b0 con 0x7f14240b4b50 2023-06-08T04:02:35.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1424160a60 msgr2=0x7f14240b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:35.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 --2- 172.21.15.16:0/3160784374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1424160a60 0x7f14240b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 >> v1:172.21.15.169:6789/0 conn(0x7f14240b83f0 legacy=0x7f14240ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14240cd4c0 con 0x7f14240b4b50 2023-06-08T04:02:35.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7f141c0019f0 con 0x7f14240b4b50 2023-06-08T04:02:35.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 >> v1:172.21.15.16:6789/0 conn(0x7f14240b4b50 legacy=0x7f14240d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 --2- 172.21.15.16:0/3160784374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f140c003a30 0x7f140c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 --2- 172.21.15.16:0/3160784374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f140c004850 0x7f140c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 --2- 172.21.15.16:0/3160784374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1424160a60 0x7f140c0052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c00bba0 con 0x7f140c003a30 2023-06-08T04:02:35.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c00bce0 con 0x7f140c004850 2023-06-08T04:02:35.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c00be70 con 0x7f1424160a60 2023-06-08T04:02:35.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.055+0000 7f1422ffd700 1 --2- 172.21.15.16:0/3160784374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f140c003a30 0x7f140c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.056+0000 7f14227fc700 1 --2- 172.21.15.16:0/3160784374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f140c004850 0x7f140c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.056+0000 7f1422ffd700 1 -- 172.21.15.16:0/3160784374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1424160a60 msgr2=0x7f140c0052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:35.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.056+0000 7f1422ffd700 1 --2- 172.21.15.16:0/3160784374 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1424160a60 0x7f140c0052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.056+0000 7f1422ffd700 1 -- 172.21.15.16:0/3160784374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f140c004850 msgr2=0x7f140c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:35.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.056+0000 7f1422ffd700 1 --2- 172.21.15.16:0/3160784374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f140c004850 0x7f140c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.056+0000 7f1422ffd700 1 -- 172.21.15.16:0/3160784374 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0035b0 con 0x7f140c003a30 2023-06-08T04:02:35.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.056+0000 7f1422ffd700 1 --2- 172.21.15.16:0/3160784374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f140c003a30 0x7f140c003e40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1414001830 tx=0x7f140c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa103b657733c49 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:35.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.056+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14140012f0 con 0x7f140c003a30 2023-06-08T04:02:35.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.056+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14140052f0 con 0x7f140c003a30 2023-06-08T04:02:35.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.056+0000 7f1421ffb700 1 -- 172.21.15.16:0/3160784374 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414006860 con 0x7f140c003a30 2023-06-08T04:02:35.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.057+0000 7f14295ff700 1 -- 172.21.15.16:0/3160784374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f140c003a30 msgr2=0x7f140c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.057+0000 7f14295ff700 1 --2- 172.21.15.16:0/3160784374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f140c003a30 0x7f140c003e40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1414001830 tx=0x7f140c005880 comp rx=0 tx=0).stop 2023-06-08T04:02:35.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.057+0000 7f14237fe700 1 -- 172.21.15.16:0/3160784374 reap_dead start 2023-06-08T04:02:35.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.057+0000 7f14295ff700 1 -- 172.21.15.16:0/3160784374 shutdown_connections 2023-06-08T04:02:35.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.057+0000 7f14295ff700 1 -- 172.21.15.16:0/3160784374 >> 172.21.15.16:0/3160784374 conn(0x7f14240cf610 msgr2=0x7f14240cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:35.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.057+0000 7f14295ff700 1 -- 172.21.15.16:0/3160784374 shutdown_connections 2023-06-08T04:02:35.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.057+0000 7f14295ff700 1 -- 172.21.15.16:0/3160784374 wait complete. 2023-06-08T04:02:35.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.059+0000 7f14295ff700 1 Processor -- start 2023-06-08T04:02:35.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.059+0000 7f14295ff700 1 -- start start 2023-06-08T04:02:35.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14295ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f140c003a30 0x7f1424143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14295ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240b6a10 0x7f14240b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14295ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f142415e570 0x7f142415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14295ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14240b73c0 con 0x7f14240b6a10 2023-06-08T04:02:35.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14295ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1424143e40 con 0x7f142415e570 2023-06-08T04:02:35.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14295ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142415f890 con 0x7f140c003a30 2023-06-08T04:02:35.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14227fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240b6a10 0x7f14240b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14227fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240b6a10 0x7f14240b6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60036/0 (socket says 172.21.15.16:60036) 2023-06-08T04:02:35.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14227fc700 1 -- 172.21.15.16:0/2085671708 learned_addr learned my addr 172.21.15.16:0/2085671708 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:35.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f1422ffd700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f140c003a30 0x7f1424143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14237fe700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f142415e570 0x7f142415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14227fc700 1 -- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f140c003a30 msgr2=0x7f1424143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14227fc700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f140c003a30 0x7f1424143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14227fc700 1 -- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f142415e570 msgr2=0x7f142415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14227fc700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f142415e570 0x7f142415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14227fc700 1 -- 172.21.15.16:0/2085671708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142415f2d0 con 0x7f14240b6a10 2023-06-08T04:02:35.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f1422ffd700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f140c003a30 0x7f1424143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:35.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.060+0000 7f14237fe700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f142415e570 0x7f142415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:35.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.061+0000 7f14227fc700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240b6a10 0x7f14240b6e80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14180116c0 tx=0x7f1418011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:35.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.061+0000 7f140b7fe700 1 -- 172.21.15.16:0/2085671708 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418015870 con 0x7f14240b6a10 2023-06-08T04:02:35.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.061+0000 7f140b7fe700 1 -- 172.21.15.16:0/2085671708 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14180159d0 con 0x7f14240b6a10 2023-06-08T04:02:35.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.061+0000 7f140b7fe700 1 -- 172.21.15.16:0/2085671708 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418015d40 con 0x7f14240b6a10 2023-06-08T04:02:35.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.061+0000 7f14295ff700 1 -- 172.21.15.16:0/2085671708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142415f5b0 con 0x7f14240b6a10 2023-06-08T04:02:35.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.061+0000 7f14295ff700 1 -- 172.21.15.16:0/2085671708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1424141220 con 0x7f14240b6a10 2023-06-08T04:02:35.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.062+0000 7f14295ff700 1 -- 172.21.15.16:0/2085671708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14240740e0 con 0x7f14240b6a10 2023-06-08T04:02:35.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.063+0000 7f140b7fe700 1 -- 172.21.15.16:0/2085671708 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1418013400 con 0x7f14240b6a10 2023-06-08T04:02:35.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.064+0000 7f140b7fe700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f141006ace0 0x7f141006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.065+0000 7f140b7fe700 1 -- 172.21.15.16:0/2085671708 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1418089760 con 0x7f14240b6a10 2023-06-08T04:02:35.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.065+0000 7f1422ffd700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f141006ace0 0x7f141006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.066+0000 7f1422ffd700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f141006ace0 0x7f141006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1414014040 tx=0x7f1414009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:35.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.069+0000 7f140b7fe700 1 -- 172.21.15.16:0/2085671708 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f14180548a0 con 0x7f14240b6a10 2023-06-08T04:02:35.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.276+0000 7f14295ff700 1 -- 172.21.15.16:0/2085671708 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14240d1060 con 0x7f14240b6a10 2023-06-08T04:02:35.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.276+0000 7f140b7fe700 1 -- 172.21.15.16:0/2085671708 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1418057ec0 con 0x7f14240b6a10 2023-06-08T04:02:35.280 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:02:35.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.278+0000 7f14295ff700 1 -- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f141006ace0 msgr2=0x7f141006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.278+0000 7f14295ff700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f141006ace0 0x7f141006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1414014040 tx=0x7f1414009030 comp rx=0 tx=0).stop 2023-06-08T04:02:35.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.278+0000 7f14295ff700 1 -- 172.21.15.16:0/2085671708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240b6a10 msgr2=0x7f14240b6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.278+0000 7f14295ff700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240b6a10 0x7f14240b6e80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14180116c0 tx=0x7f1418011a80 comp rx=0 tx=0).stop 2023-06-08T04:02:35.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.279+0000 7f14295ff700 1 -- 172.21.15.16:0/2085671708 shutdown_connections 2023-06-08T04:02:35.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.279+0000 7f14295ff700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f141006ace0 0x7f141006d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.279+0000 7f14295ff700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f142415e570 0x7f142415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.279+0000 7f14295ff700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f140c003a30 0x7f1424143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.279+0000 7f14295ff700 1 --2- 172.21.15.16:0/2085671708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240b6a10 0x7f14240b6e80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.279+0000 7f14295ff700 1 -- 172.21.15.16:0/2085671708 >> 172.21.15.16:0/2085671708 conn(0x7f14240cf610 msgr2=0x7f14240b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:35.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.279+0000 7f14295ff700 1 -- 172.21.15.16:0/2085671708 shutdown_connections 2023-06-08T04:02:35.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.279+0000 7f14295ff700 1 -- 172.21.15.16:0/2085671708 wait complete. 2023-06-08T04:02:35.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:02:35.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.499+0000 7fdac85ff700 1 Processor -- start 2023-06-08T04:02:35.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.499+0000 7fdac85ff700 1 -- start start 2023-06-08T04:02:35.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.500+0000 7fdac85ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00b83f0 0x7fdac0160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.500+0000 7fdac85ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdac00b4d20 0x7fdac00d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.501+0000 7fdac85ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac00d0800 con 0x7fdac00ced40 2023-06-08T04:02:35.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.501+0000 7fdac85ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac00cd1e0 con 0x7fdac00b4d20 2023-06-08T04:02:35.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.501+0000 7fdac85ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00cd4c0 con 0x7fdac00b83f0 2023-06-08T04:02:35.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.501+0000 7fdac6b9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdac00b4d20 0x7fdac00d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.501+0000 7fdac639b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00b83f0 0x7fdac0160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.501+0000 7fdac639b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00b83f0 0x7fdac0160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:40514/0 (socket says 172.21.15.16:40514) 2023-06-08T04:02:35.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.501+0000 7fdac6b9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdac00b4d20 0x7fdac00d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:34796/0 (socket says 172.21.15.16:34796) 2023-06-08T04:02:35.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.501+0000 7fdac639b700 1 -- 172.21.15.16:0/3861723504 learned_addr learned my addr 172.21.15.16:0/3861723504 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.501+0000 7fdac639b700 1 -- 172.21.15.16:0/3861723504 >> v2:172.21.15.169:3300/0 conn(0x7fdac00b4d20 msgr2=0x7fdac00d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.501+0000 7fdac639b700 1 --2- 172.21.15.16:0/3861723504 >> v2:172.21.15.169:3300/0 conn(0x7fdac00b4d20 0x7fdac00d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.501+0000 7fdac639b700 1 -- 172.21.15.16:0/3861723504 >> v1:172.21.15.169:6789/0 conn(0x7fdac00ced40 legacy=0x7fdac00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.502+0000 7fdac639b700 1 -- 172.21.15.16:0/3861723504 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac00d0aa0 con 0x7fdac00b83f0 2023-06-08T04:02:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.502+0000 7fdac639b700 1 --2- 172.21.15.16:0/3861723504 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00b83f0 0x7fdac0160a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0098f0 tx=0x7fdabc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56759743aa66e4f1 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.502+0000 7fdac5399700 1 -- 172.21.15.16:0/3861723504 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011830 con 0x7fdac00b83f0 2023-06-08T04:02:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.502+0000 7fdac5399700 1 -- 172.21.15.16:0/3861723504 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc011990 con 0x7fdac00b83f0 2023-06-08T04:02:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.502+0000 7fdac5399700 1 -- 172.21.15.16:0/3861723504 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011d20 con 0x7fdac00b83f0 2023-06-08T04:02:35.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.503+0000 7fdac85ff700 1 -- 172.21.15.16:0/3861723504 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00b83f0 msgr2=0x7fdac0160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.503+0000 7fdac85ff700 1 --2- 172.21.15.16:0/3861723504 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00b83f0 0x7fdac0160a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0098f0 tx=0x7fdabc009c00 comp rx=0 tx=0).stop 2023-06-08T04:02:35.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.503+0000 7fdac85ff700 1 -- 172.21.15.16:0/3861723504 shutdown_connections 2023-06-08T04:02:35.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.503+0000 7fdac85ff700 1 --2- 172.21.15.16:0/3861723504 >> v2:172.21.15.169:3300/0 conn(0x7fdac00b4d20 0x7fdac00d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.503+0000 7fdac85ff700 1 --2- 172.21.15.16:0/3861723504 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00b83f0 0x7fdac0160a60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.503+0000 7fdac85ff700 1 -- 172.21.15.16:0/3861723504 >> 172.21.15.16:0/3861723504 conn(0x7fdac00cf610 msgr2=0x7fdac00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:35.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.503+0000 7fdac85ff700 1 -- 172.21.15.16:0/3861723504 shutdown_connections 2023-06-08T04:02:35.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.503+0000 7fdac85ff700 1 -- 172.21.15.16:0/3861723504 wait complete. 2023-06-08T04:02:35.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.505+0000 7fdac85ff700 1 Processor -- start 2023-06-08T04:02:35.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.505+0000 7fdac85ff700 1 -- start start 2023-06-08T04:02:35.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.506+0000 7fdac85ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdac00b4d20 0x7fdac0153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.506+0000 7fdac85ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdac00b83f0 0x7fdac00c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.506+0000 7fdac85ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00ced40 0x7fdac00b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.506+0000 7fdac85ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac0153fa0 con 0x7fdac00b83f0 2023-06-08T04:02:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.506+0000 7fdac85ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac015f770 con 0x7fdac00b4d20 2023-06-08T04:02:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.506+0000 7fdac85ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac01e5fb0 con 0x7fdac00ced40 2023-06-08T04:02:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.506+0000 7fdac5b9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdac00b83f0 0x7fdac00c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.506+0000 7fdac5b9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdac00b83f0 0x7fdac00c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60052/0 (socket says 172.21.15.16:60052) 2023-06-08T04:02:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.506+0000 7fdac5b9a700 1 -- 172.21.15.16:0/3056320440 learned_addr learned my addr 172.21.15.16:0/3056320440 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.506+0000 7fdac639b700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdac00b4d20 0x7fdac0153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.506+0000 7fdac6b9c700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00ced40 0x7fdac00b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.507+0000 7fdac5b9a700 1 -- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00ced40 msgr2=0x7fdac00b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.507+0000 7fdac5b9a700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00ced40 0x7fdac00b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.507+0000 7fdac5b9a700 1 -- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdac00b4d20 msgr2=0x7fdac0153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.507+0000 7fdac5b9a700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdac00b4d20 0x7fdac0153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.507+0000 7fdac5b9a700 1 -- 172.21.15.16:0/3056320440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc009550 con 0x7fdac00b83f0 2023-06-08T04:02:35.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.507+0000 7fdac5b9a700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdac00b83f0 0x7fdac00c9c60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdab000c450 tx=0x7fdab000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:35.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.507+0000 7fdab6ffd700 1 -- 172.21.15.16:0/3056320440 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab00052d0 con 0x7fdac00b83f0 2023-06-08T04:02:35.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.507+0000 7fdab6ffd700 1 -- 172.21.15.16:0/3056320440 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab0005430 con 0x7fdac00b83f0 2023-06-08T04:02:35.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.507+0000 7fdac85ff700 1 -- 172.21.15.16:0/3056320440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac01e6290 con 0x7fdac00b83f0 2023-06-08T04:02:35.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.507+0000 7fdab6ffd700 1 -- 172.21.15.16:0/3056320440 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab00038c0 con 0x7fdac00b83f0 2023-06-08T04:02:35.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.507+0000 7fdac85ff700 1 -- 172.21.15.16:0/3056320440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac01e6850 con 0x7fdac00b83f0 2023-06-08T04:02:35.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.508+0000 7fdac85ff700 1 -- 172.21.15.16:0/3056320440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac015f8b0 con 0x7fdac00b83f0 2023-06-08T04:02:35.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.509+0000 7fdab6ffd700 1 -- 172.21.15.16:0/3056320440 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdab0003a20 con 0x7fdac00b83f0 2023-06-08T04:02:35.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.510+0000 7fdab6ffd700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdaa406ace0 0x7fdaa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.510+0000 7fdab6ffd700 1 -- 172.21.15.16:0/3056320440 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdab0088890 con 0x7fdac00b83f0 2023-06-08T04:02:35.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.511+0000 7fdac639b700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdaa406ace0 0x7fdaa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.512+0000 7fdac639b700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdaa406ace0 0x7fdaa406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009c40 tx=0x7fdabc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:35.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.515+0000 7fdab6ffd700 1 -- 172.21.15.16:0/3056320440 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdab00539d0 con 0x7fdac00b83f0 2023-06-08T04:02:35.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.719+0000 7fdac85ff700 1 -- 172.21.15.16:0/3056320440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdac01e6a70 con 0x7fdac00b83f0 2023-06-08T04:02:35.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.720+0000 7fdab6ffd700 1 -- 172.21.15.16:0/3056320440 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdab0056ff0 con 0x7fdac00b83f0 2023-06-08T04:02:35.724 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:02:35.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 -- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdaa406ace0 msgr2=0x7fdaa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdaa406ace0 0x7fdaa406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009c40 tx=0x7fdabc008030 comp rx=0 tx=0).stop 2023-06-08T04:02:35.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 -- 172.21.15.16:0/3056320440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdac00b83f0 msgr2=0x7fdac00c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdac00b83f0 0x7fdac00c9c60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdab000c450 tx=0x7fdab000c810 comp rx=0 tx=0).stop 2023-06-08T04:02:35.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 -- 172.21.15.16:0/3056320440 shutdown_connections 2023-06-08T04:02:35.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdaa406ace0 0x7fdaa406d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdac00ced40 0x7fdac00b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdac00b4d20 0x7fdac0153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 --2- 172.21.15.16:0/3056320440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdac00b83f0 0x7fdac00c9c60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 -- 172.21.15.16:0/3056320440 >> 172.21.15.16:0/3056320440 conn(0x7fdac00cf610 msgr2=0x7fdac00d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:35.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 -- 172.21.15.16:0/3056320440 shutdown_connections 2023-06-08T04:02:35.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.722+0000 7fdac85ff700 1 -- 172.21.15.16:0/3056320440 wait complete. 2023-06-08T04:02:35.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:02:35.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.944+0000 7fa9cdfff700 1 Processor -- start 2023-06-08T04:02:35.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.944+0000 7fa9cdfff700 1 -- start start 2023-06-08T04:02:35.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.946+0000 7fa9cdfff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80b83f0 0x7fa9c8160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.946+0000 7fa9cdfff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c80d0800 con 0x7fa9c80ced40 2023-06-08T04:02:35.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.946+0000 7fa9cdfff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c80cd1e0 con 0x7fa9c80b4d20 2023-06-08T04:02:35.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.946+0000 7fa9cdfff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c80cd4c0 con 0x7fa9c80b83f0 2023-06-08T04:02:35.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.946+0000 7fa9c6ffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa9c80ced40 0x7fa9c80b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59840/0 (socket says 172.21.15.16:59840) 2023-06-08T04:02:35.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.946+0000 7fa9c6ffd700 1 -- 172.21.15.16:0/3802744728 learned_addr learned my addr 172.21.15.16:0/3802744728 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:35.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c77fe700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80b83f0 0x7fa9c8160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034062915 0 0) 0x7fa9c80d0800 con 0x7fa9c80ced40 2023-06-08T04:02:35.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9b00035b0 con 0x7fa9c80ced40 2023-06-08T04:02:35.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3610804254 0 0) 0x7fa9b00035b0 con 0x7fa9c80ced40 2023-06-08T04:02:35.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80b83f0 msgr2=0x7fa9c8160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:35.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80b83f0 0x7fa9c8160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 >> v1:172.21.15.169:6789/0 conn(0x7fa9c80b4d20 legacy=0x7fa9c80d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c80d0aa0 con 0x7fa9c80ced40 2023-06-08T04:02:35.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7fa9bc001670 con 0x7fa9c80ced40 2023-06-08T04:02:35.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 >> v1:172.21.15.16:6789/0 conn(0x7fa9c80ced40 legacy=0x7fa9c80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9b0003a30 0x7fa9b0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80b83f0 0x7fa9b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0004d90 0x7fa9b0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c80cd4c0 con 0x7fa9b0004d90 2023-06-08T04:02:35.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b000bba0 con 0x7fa9b0003a30 2023-06-08T04:02:35.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.947+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b000bd30 con 0x7fa9c80b83f0 2023-06-08T04:02:35.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.948+0000 7fa9c77fe700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9b0003a30 0x7fa9b0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.948+0000 7fa9c6ffd700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80b83f0 0x7fa9b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.948+0000 7fa9c7fff700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0004d90 0x7fa9b0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.948+0000 7fa9c77fe700 1 -- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80b83f0 msgr2=0x7fa9b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:35.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.948+0000 7fa9c77fe700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80b83f0 0x7fa9b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.948+0000 7fa9c77fe700 1 -- 172.21.15.16:0/3802744728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0004d90 msgr2=0x7fa9b0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:35.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.948+0000 7fa9c77fe700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0004d90 0x7fa9b0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.948+0000 7fa9c77fe700 1 -- 172.21.15.16:0/3802744728 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b00035b0 con 0x7fa9b0003a30 2023-06-08T04:02:35.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.948+0000 7fa9c7fff700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0004d90 0x7fa9b0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:02:35.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.948+0000 7fa9c6ffd700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80b83f0 0x7fa9b0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:02:35.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.949+0000 7fa9c77fe700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9b0003a30 0x7fa9b0003e40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009b60 tx=0x7fa9b0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3421cf7a5f2d1b3 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:35.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.949+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b800e6c0 con 0x7fa9b0003a30 2023-06-08T04:02:35.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.949+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b800e820 con 0x7fa9b0003a30 2023-06-08T04:02:35.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.949+0000 7fa9c67fc700 1 -- 172.21.15.16:0/3802744728 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b800eb90 con 0x7fa9b0003a30 2023-06-08T04:02:35.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.949+0000 7fa9cdfff700 1 -- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9b0003a30 msgr2=0x7fa9b0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.949+0000 7fa9cdfff700 1 --2- 172.21.15.16:0/3802744728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9b0003a30 0x7fa9b0003e40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009b60 tx=0x7fa9b0005880 comp rx=0 tx=0).stop 2023-06-08T04:02:35.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.949+0000 7fa9c7fff700 1 -- 172.21.15.16:0/3802744728 reap_dead start 2023-06-08T04:02:35.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.949+0000 7fa9cdfff700 1 -- 172.21.15.16:0/3802744728 shutdown_connections 2023-06-08T04:02:35.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.949+0000 7fa9cdfff700 1 -- 172.21.15.16:0/3802744728 >> 172.21.15.16:0/3802744728 conn(0x7fa9c80cf610 msgr2=0x7fa9c80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:35.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.949+0000 7fa9cdfff700 1 -- 172.21.15.16:0/3802744728 shutdown_connections 2023-06-08T04:02:35.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.950+0000 7fa9cdfff700 1 -- 172.21.15.16:0/3802744728 wait complete. 2023-06-08T04:02:35.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.952+0000 7fa9cdfff700 1 Processor -- start 2023-06-08T04:02:35.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.952+0000 7fa9cdfff700 1 -- start start 2023-06-08T04:02:35.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.953+0000 7fa9cdfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0003a30 0x7fa9c80c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.953+0000 7fa9cdfff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80c9c60 0x7fa9c815ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.953+0000 7fa9cdfff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c815b2e0 0x7fa9c81f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.953+0000 7fa9cdfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c815f3a0 con 0x7fa9b0003a30 2023-06-08T04:02:35.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.953+0000 7fa9cdfff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c815b780 con 0x7fa9c815b2e0 2023-06-08T04:02:35.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.953+0000 7fa9cdfff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c815e440 con 0x7fa9c80c9c60 2023-06-08T04:02:35.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0003a30 0x7fa9c80c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0003a30 0x7fa9c80c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60078/0 (socket says 172.21.15.16:60078) 2023-06-08T04:02:35.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c77fe700 1 -- 172.21.15.16:0/1268905583 learned_addr learned my addr 172.21.15.16:0/1268905583 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:35.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c6ffd700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80c9c60 0x7fa9c815ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c7fff700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c815b2e0 0x7fa9c81f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c77fe700 1 -- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80c9c60 msgr2=0x7fa9c815ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c77fe700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80c9c60 0x7fa9c815ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c77fe700 1 -- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c815b2e0 msgr2=0x7fa9c81f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:35.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c77fe700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c815b2e0 0x7fa9c81f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:35.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c77fe700 1 -- 172.21.15.16:0/1268905583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c815e720 con 0x7fa9b0003a30 2023-06-08T04:02:35.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c6ffd700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80c9c60 0x7fa9c815ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:35.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c7fff700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c815b2e0 0x7fa9c81f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:35.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9c77fe700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0003a30 0x7fa9c80c8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800e4b0 tx=0x7fa9b80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:35.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.954+0000 7fa9affff700 1 -- 172.21.15.16:0/1268905583 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b800e6c0 con 0x7fa9b0003a30 2023-06-08T04:02:35.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.955+0000 7fa9affff700 1 -- 172.21.15.16:0/1268905583 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b8003ad0 con 0x7fa9b0003a30 2023-06-08T04:02:35.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.955+0000 7fa9affff700 1 -- 172.21.15.16:0/1268905583 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b8003e80 con 0x7fa9b0003a30 2023-06-08T04:02:35.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.955+0000 7fa9cdfff700 1 -- 172.21.15.16:0/1268905583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c815ea00 con 0x7fa9b0003a30 2023-06-08T04:02:35.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.955+0000 7fa9cdfff700 1 -- 172.21.15.16:0/1268905583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c815efc0 con 0x7fa9b0003a30 2023-06-08T04:02:35.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.956+0000 7fa9cdfff700 1 -- 172.21.15.16:0/1268905583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c80740e0 con 0x7fa9b0003a30 2023-06-08T04:02:35.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.957+0000 7fa9affff700 1 -- 172.21.15.16:0/1268905583 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9b8013470 con 0x7fa9b0003a30 2023-06-08T04:02:35.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.957+0000 7fa9affff700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa9b406ace0 0x7fa9b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:35.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.957+0000 7fa9affff700 1 -- 172.21.15.16:0/1268905583 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa9b808acc0 con 0x7fa9b0003a30 2023-06-08T04:02:35.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.958+0000 7fa9c6ffd700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa9b406ace0 0x7fa9b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:35.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.959+0000 7fa9c6ffd700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa9b406ace0 0x7fa9b406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc007fd0 tx=0x7fa9bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:35.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:35.962+0000 7fa9affff700 1 -- 172.21.15.16:0/1268905583 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9b8091080 con 0x7fa9b0003a30 2023-06-08T04:02:36.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.168+0000 7fa9cdfff700 1 -- 172.21.15.16:0/1268905583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9c815f610 con 0x7fa9b0003a30 2023-06-08T04:02:36.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.169+0000 7fa9affff700 1 -- 172.21.15.16:0/1268905583 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9b8055e80 con 0x7fa9b0003a30 2023-06-08T04:02:36.173 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:02:36.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.171+0000 7fa9cdfff700 1 -- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa9b406ace0 msgr2=0x7fa9b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:36.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.171+0000 7fa9cdfff700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa9b406ace0 0x7fa9b406d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc007fd0 tx=0x7fa9bc009040 comp rx=0 tx=0).stop 2023-06-08T04:02:36.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.171+0000 7fa9cdfff700 1 -- 172.21.15.16:0/1268905583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0003a30 msgr2=0x7fa9c80c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:36.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.171+0000 7fa9cdfff700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0003a30 0x7fa9c80c8ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800e4b0 tx=0x7fa9b80047c0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.171+0000 7fa9cdfff700 1 -- 172.21.15.16:0/1268905583 shutdown_connections 2023-06-08T04:02:36.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.171+0000 7fa9cdfff700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa9b406ace0 0x7fa9b406d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.171+0000 7fa9cdfff700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c815b2e0 0x7fa9c81f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.171+0000 7fa9cdfff700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9b0003a30 0x7fa9c80c8ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.171+0000 7fa9cdfff700 1 --2- 172.21.15.16:0/1268905583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9c80c9c60 0x7fa9c815ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.171+0000 7fa9cdfff700 1 -- 172.21.15.16:0/1268905583 >> 172.21.15.16:0/1268905583 conn(0x7fa9c80cf610 msgr2=0x7fa9c80b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:36.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.172+0000 7fa9cdfff700 1 -- 172.21.15.16:0/1268905583 shutdown_connections 2023-06-08T04:02:36.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.172+0000 7fa9cdfff700 1 -- 172.21.15.16:0/1268905583 wait complete. 2023-06-08T04:02:36.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:36.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.389+0000 7f87f77ff700 1 Processor -- start 2023-06-08T04:02:36.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.389+0000 7f87f77ff700 1 -- start start 2023-06-08T04:02:36.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f77ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f87f00b83f0 0x7f87f0160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f77ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87f00ced40 0x7f87f00b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f77ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f87f00b4b50 0x7f87f006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f77ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f00b4fd0 con 0x7f87f00b4b50 2023-06-08T04:02:36.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f77ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f00d0800 con 0x7f87f00b83f0 2023-06-08T04:02:36.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f77ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00cd1e0 con 0x7f87f00ced40 2023-06-08T04:02:36.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f5d9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f87f00b4b50 0x7f87f006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f5d9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f87f00b4b50 0x7f87f006b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60082/0 (socket says 172.21.15.16:60082) 2023-06-08T04:02:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f5d9c700 1 -- 172.21.15.16:0/4109181956 learned_addr learned my addr 172.21.15.16:0/4109181956 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:36.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f559b700 1 --2- 172.21.15.16:0/4109181956 >> v2:172.21.15.169:3300/0 conn(0x7f87f00b83f0 0x7f87f0160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f4d9a700 1 --2- 172.21.15.16:0/4109181956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87f00ced40 0x7f87f00b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f5d9c700 1 -- 172.21.15.16:0/4109181956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87f00ced40 msgr2=0x7f87f00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:36.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f5d9c700 1 --2- 172.21.15.16:0/4109181956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87f00ced40 0x7f87f00b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f5d9c700 1 -- 172.21.15.16:0/4109181956 >> v2:172.21.15.169:3300/0 conn(0x7f87f00b83f0 msgr2=0x7f87f0160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f5d9c700 1 --2- 172.21.15.16:0/4109181956 >> v2:172.21.15.169:3300/0 conn(0x7f87f00b83f0 0x7f87f0160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f5d9c700 1 -- 172.21.15.16:0/4109181956 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f00cd4c0 con 0x7f87f00b4b50 2023-06-08T04:02:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.391+0000 7f87f4d9a700 1 --2- 172.21.15.16:0/4109181956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87f00ced40 0x7f87f00b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.392+0000 7f87f5d9c700 1 --2- 172.21.15.16:0/4109181956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87f00b4b50 0x7f87f006b1e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f87f006ca80 tx=0x7f87e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239d1da031941814 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.392+0000 7f87e7fff700 1 -- 172.21.15.16:0/4109181956 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e800e070 con 0x7f87f00b4b50 2023-06-08T04:02:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.392+0000 7f87e7fff700 1 -- 172.21.15.16:0/4109181956 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e800b910 con 0x7f87f00b4b50 2023-06-08T04:02:36.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.392+0000 7f87e7fff700 1 -- 172.21.15.16:0/4109181956 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e800bcc0 con 0x7f87f00b4b50 2023-06-08T04:02:36.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.392+0000 7f87f77ff700 1 -- 172.21.15.16:0/4109181956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87f00b4b50 msgr2=0x7f87f006b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:36.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.392+0000 7f87f77ff700 1 --2- 172.21.15.16:0/4109181956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87f00b4b50 0x7f87f006b1e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f87f006ca80 tx=0x7f87e800b330 comp rx=0 tx=0).stop 2023-06-08T04:02:36.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.393+0000 7f87f77ff700 1 -- 172.21.15.16:0/4109181956 shutdown_connections 2023-06-08T04:02:36.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.393+0000 7f87f77ff700 1 --2- 172.21.15.16:0/4109181956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87f00b4b50 0x7f87f006b1e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.393+0000 7f87f77ff700 1 --2- 172.21.15.16:0/4109181956 >> v2:172.21.15.169:3300/0 conn(0x7f87f00b83f0 0x7f87f0160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.393+0000 7f87f77ff700 1 --2- 172.21.15.16:0/4109181956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87f00ced40 0x7f87f00b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.393+0000 7f87f77ff700 1 -- 172.21.15.16:0/4109181956 >> 172.21.15.16:0/4109181956 conn(0x7f87f00cf610 msgr2=0x7f87f00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:36.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.393+0000 7f87f77ff700 1 -- 172.21.15.16:0/4109181956 shutdown_connections 2023-06-08T04:02:36.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.393+0000 7f87f77ff700 1 -- 172.21.15.16:0/4109181956 wait complete. 2023-06-08T04:02:36.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.395+0000 7f87f77ff700 1 Processor -- start 2023-06-08T04:02:36.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.395+0000 7f87f77ff700 1 -- start start 2023-06-08T04:02:36.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.396+0000 7f87f77ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87f00b4b50 0x7f87f01f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f77ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87f00b83f0 0x7f87f00c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f77ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87f00ced40 0x7f87f0158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f77ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00cb970 con 0x7f87f00b4b50 2023-06-08T04:02:36.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f77ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f01f2530 con 0x7f87f00b83f0 2023-06-08T04:02:36.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f77ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00cb060 con 0x7f87f00ced40 2023-06-08T04:02:36.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f559b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87f00b4b50 0x7f87f01f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f559b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87f00b4b50 0x7f87f01f1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60090/0 (socket says 172.21.15.16:60090) 2023-06-08T04:02:36.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f559b700 1 -- 172.21.15.16:0/2712943096 learned_addr learned my addr 172.21.15.16:0/2712943096 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:36.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f559b700 1 -- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87f00ced40 msgr2=0x7f87f0158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:36.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f559b700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87f00ced40 0x7f87f0158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f559b700 1 -- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87f00b83f0 msgr2=0x7f87f00c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:36.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f4d9a700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87f00b83f0 0x7f87f00c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f559b700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87f00b83f0 0x7f87f00c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.397+0000 7f87f559b700 1 -- 172.21.15.16:0/2712943096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e8009b30 con 0x7f87f00b4b50 2023-06-08T04:02:36.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.398+0000 7f87f559b700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87f00b4b50 0x7f87f01f1ff0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00e960 tx=0x7f87ec00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:36.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.398+0000 7f87e5ffb700 1 -- 172.21.15.16:0/2712943096 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec009690 con 0x7f87f00b4b50 2023-06-08T04:02:36.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.398+0000 7f87e5ffb700 1 -- 172.21.15.16:0/2712943096 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec00c7f0 con 0x7f87f00b4b50 2023-06-08T04:02:36.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.398+0000 7f87f77ff700 1 -- 172.21.15.16:0/2712943096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f00caa70 con 0x7f87f00b4b50 2023-06-08T04:02:36.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.398+0000 7f87e5ffb700 1 -- 172.21.15.16:0/2712943096 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec00cb60 con 0x7f87f00b4b50 2023-06-08T04:02:36.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.398+0000 7f87f77ff700 1 -- 172.21.15.16:0/2712943096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f00cb590 con 0x7f87f00b4b50 2023-06-08T04:02:36.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.399+0000 7f87f77ff700 1 -- 172.21.15.16:0/2712943096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f00740e0 con 0x7f87f00b4b50 2023-06-08T04:02:36.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.400+0000 7f87e5ffb700 1 -- 172.21.15.16:0/2712943096 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87ec00ccc0 con 0x7f87f00b4b50 2023-06-08T04:02:36.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.401+0000 7f87e5ffb700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f87d406ace0 0x7f87d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.401+0000 7f87e5ffb700 1 -- 172.21.15.16:0/2712943096 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87ec089490 con 0x7f87f00b4b50 2023-06-08T04:02:36.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.402+0000 7f87f4d9a700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f87d406ace0 0x7f87d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.402+0000 7f87f4d9a700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f87d406ace0 0x7f87d406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f87f01f5530 tx=0x7f87e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:36.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.405+0000 7f87e5ffb700 1 -- 172.21.15.16:0/2712943096 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87ec054530 con 0x7f87f00b4b50 2023-06-08T04:02:36.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.613+0000 7f87f77ff700 1 -- 172.21.15.16:0/2712943096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87f00ce320 con 0x7f87f00b4b50 2023-06-08T04:02:36.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.615+0000 7f87e5ffb700 1 -- 172.21.15.16:0/2712943096 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7f87ec057b50 con 0x7f87f00b4b50 2023-06-08T04:02:36.619 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:36.619 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:36.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.617+0000 7f87f77ff700 1 -- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f87d406ace0 msgr2=0x7f87d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:36.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.617+0000 7f87f77ff700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f87d406ace0 0x7f87d406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f87f01f5530 tx=0x7f87e0008040 comp rx=0 tx=0).stop 2023-06-08T04:02:36.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.617+0000 7f87f77ff700 1 -- 172.21.15.16:0/2712943096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87f00b4b50 msgr2=0x7f87f01f1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:36.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.617+0000 7f87f77ff700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87f00b4b50 0x7f87f01f1ff0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00e960 tx=0x7f87ec00ed20 comp rx=0 tx=0).stop 2023-06-08T04:02:36.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.617+0000 7f87f77ff700 1 -- 172.21.15.16:0/2712943096 shutdown_connections 2023-06-08T04:02:36.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.617+0000 7f87f77ff700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f87d406ace0 0x7f87d406d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.617+0000 7f87f77ff700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87f00ced40 0x7f87f0158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.617+0000 7f87f77ff700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87f00b4b50 0x7f87f01f1ff0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.617+0000 7f87f77ff700 1 --2- 172.21.15.16:0/2712943096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87f00b83f0 0x7f87f00c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.617+0000 7f87f77ff700 1 -- 172.21.15.16:0/2712943096 >> 172.21.15.16:0/2712943096 conn(0x7f87f00cf610 msgr2=0x7f87f00b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:36.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.618+0000 7f87f77ff700 1 -- 172.21.15.16:0/2712943096 shutdown_connections 2023-06-08T04:02:36.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.618+0000 7f87f77ff700 1 -- 172.21.15.16:0/2712943096 wait complete. 2023-06-08T04:02:36.639 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:01:54.980592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:01:56.264608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:02:36.640 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:02:36.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.841+0000 7f52635ff700 1 Processor -- start 2023-06-08T04:02:36.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.841+0000 7f52635ff700 1 -- start start 2023-06-08T04:02:36.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.842+0000 7f52635ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f525c15b250 0x7f525c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.842+0000 7f52635ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f525c161d10 0x7f525c1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.842+0000 7f52635ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525c070c90 con 0x7f525c15a770 2023-06-08T04:02:36.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.842+0000 7f52635ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525c0ce620 con 0x7f525c15b250 2023-06-08T04:02:36.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.842+0000 7f52635ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525c0cbd30 con 0x7f525c161d10 2023-06-08T04:02:36.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.842+0000 7f5260b9a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f525c15b250 0x7f525c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.842+0000 7f5260b9a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f525c15b250 0x7f525c0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60104/0 (socket says 172.21.15.16:60104) 2023-06-08T04:02:36.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.842+0000 7f5260b9a700 1 -- 172.21.15.16:0/575292477 learned_addr learned my addr 172.21.15.16:0/575292477 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:36.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.842+0000 7f526139b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f525c15a770 0x7f525c15ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59846/0 (socket says 172.21.15.16:59846) 2023-06-08T04:02:36.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.842+0000 7f5261b9c700 1 --2- 172.21.15.16:0/575292477 >> v2:172.21.15.169:3300/0 conn(0x7f525c161d10 0x7f525c1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.843+0000 7f5260b9a700 1 -- 172.21.15.16:0/575292477 >> v2:172.21.15.169:3300/0 conn(0x7f525c161d10 msgr2=0x7f525c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:36.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.843+0000 7f5260b9a700 1 --2- 172.21.15.16:0/575292477 >> v2:172.21.15.169:3300/0 conn(0x7f525c161d10 0x7f525c1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.843+0000 7f5260b9a700 1 -- 172.21.15.16:0/575292477 >> v1:172.21.15.16:6789/0 conn(0x7f525c15a770 legacy=0x7f525c15ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:36.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.843+0000 7f5260b9a700 1 -- 172.21.15.16:0/575292477 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c0c9110 con 0x7f525c15b250 2023-06-08T04:02:36.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.843+0000 7f5253fff700 1 -- 172.21.15.16:0/575292477 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737604119 0 0) 0x7f525c070c90 con 0x7f525c15a770 2023-06-08T04:02:36.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.843+0000 7f5260b9a700 1 --2- 172.21.15.16:0/575292477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f525c15b250 0x7f525c0ce0e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f525c0c2240 tx=0x7f524c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8eab4358e2601d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:36.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.843+0000 7f5253fff700 1 -- 172.21.15.16:0/575292477 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c00b860 con 0x7f525c15b250 2023-06-08T04:02:36.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.843+0000 7f5253fff700 1 -- 172.21.15.16:0/575292477 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c00b9c0 con 0x7f525c15b250 2023-06-08T04:02:36.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.843+0000 7f5253fff700 1 -- 172.21.15.16:0/575292477 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c00bd50 con 0x7f525c15b250 2023-06-08T04:02:36.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.844+0000 7f52635ff700 1 -- 172.21.15.16:0/575292477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f525c15b250 msgr2=0x7f525c0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:36.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.844+0000 7f52635ff700 1 --2- 172.21.15.16:0/575292477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f525c15b250 0x7f525c0ce0e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f525c0c2240 tx=0x7f524c009c00 comp rx=0 tx=0).stop 2023-06-08T04:02:36.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.844+0000 7f52635ff700 1 -- 172.21.15.16:0/575292477 shutdown_connections 2023-06-08T04:02:36.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.844+0000 7f52635ff700 1 --2- 172.21.15.16:0/575292477 >> v2:172.21.15.169:3300/0 conn(0x7f525c161d10 0x7f525c1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.844+0000 7f52635ff700 1 --2- 172.21.15.16:0/575292477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f525c15b250 0x7f525c0ce0e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.844+0000 7f52635ff700 1 -- 172.21.15.16:0/575292477 >> 172.21.15.16:0/575292477 conn(0x7f525c06aa40 msgr2=0x7f525c0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:36.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.844+0000 7f52635ff700 1 -- 172.21.15.16:0/575292477 shutdown_connections 2023-06-08T04:02:36.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.844+0000 7f52635ff700 1 -- 172.21.15.16:0/575292477 wait complete. 2023-06-08T04:02:36.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.846+0000 7f52635ff700 1 Processor -- start 2023-06-08T04:02:36.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.846+0000 7f52635ff700 1 -- start start 2023-06-08T04:02:36.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f52635ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f525c15a770 0x7f525c1f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f52635ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525c15b250 0x7f525c152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f52635ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f525c161d10 0x7f525c14ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f52635ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c06c130 con 0x7f525c161d10 2023-06-08T04:02:36.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f52635ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c1f5980 con 0x7f525c15b250 2023-06-08T04:02:36.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f52635ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c1f5c60 con 0x7f525c15a770 2023-06-08T04:02:36.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f5261b9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f525c161d10 0x7f525c14ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f5261b9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f525c161d10 0x7f525c14ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60116/0 (socket says 172.21.15.16:60116) 2023-06-08T04:02:36.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f526139b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f525c15a770 0x7f525c1f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f5261b9c700 1 -- 172.21.15.16:0/3520833468 learned_addr learned my addr 172.21.15.16:0/3520833468 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:36.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f5260b9a700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525c15b250 0x7f525c152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f5261b9c700 1 -- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f525c15a770 msgr2=0x7f525c1f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:36.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f5261b9c700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f525c15a770 0x7f525c1f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f5261b9c700 1 -- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525c15b250 msgr2=0x7f525c152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:36.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f5261b9c700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525c15b250 0x7f525c152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:36.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.847+0000 7f5261b9c700 1 -- 172.21.15.16:0/3520833468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c009550 con 0x7f525c161d10 2023-06-08T04:02:36.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.848+0000 7f5261b9c700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f525c161d10 0x7f525c14ea60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5254007e30 tx=0x7f525400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:36.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.848+0000 7f5251ffb700 1 -- 172.21.15.16:0/3520833468 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525400ed30 con 0x7f525c161d10 2023-06-08T04:02:36.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.848+0000 7f5251ffb700 1 -- 172.21.15.16:0/3520833468 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525400ee90 con 0x7f525c161d10 2023-06-08T04:02:36.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.848+0000 7f5251ffb700 1 -- 172.21.15.16:0/3520833468 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254014660 con 0x7f525c161d10 2023-06-08T04:02:36.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.848+0000 7f52635ff700 1 -- 172.21.15.16:0/3520833468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c1f5f40 con 0x7f525c161d10 2023-06-08T04:02:36.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.848+0000 7f52635ff700 1 -- 172.21.15.16:0/3520833468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c1f6220 con 0x7f525c161d10 2023-06-08T04:02:36.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.849+0000 7f52635ff700 1 -- 172.21.15.16:0/3520833468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c0740e0 con 0x7f525c161d10 2023-06-08T04:02:36.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.850+0000 7f5251ffb700 1 -- 172.21.15.16:0/3520833468 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52540147c0 con 0x7f525c161d10 2023-06-08T04:02:36.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.851+0000 7f5251ffb700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f524006ace0 0x7f524006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:36.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.851+0000 7f5251ffb700 1 -- 172.21.15.16:0/3520833468 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5254089bd0 con 0x7f525c161d10 2023-06-08T04:02:36.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.851+0000 7f526139b700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f524006ace0 0x7f524006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:36.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.852+0000 7f526139b700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f524006ace0 0x7f524006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5258000f60 tx=0x7f5258007e70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:36.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:36.856+0000 7f5251ffb700 1 -- 172.21.15.16:0/3520833468 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5254058670 con 0x7f525c161d10 2023-06-08T04:02:37.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.062+0000 7f52635ff700 1 -- 172.21.15.16:0/3520833468 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f525c06c270 con 0x7f525c161d10 2023-06-08T04:02:37.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.063+0000 7f5251ffb700 1 -- 172.21.15.16:0/3520833468 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f525c06c270 con 0x7f525c161d10 2023-06-08T04:02:37.067 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:02:37.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.065+0000 7f52635ff700 1 -- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f524006ace0 msgr2=0x7f524006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.065+0000 7f52635ff700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f524006ace0 0x7f524006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5258000f60 tx=0x7f5258007e70 comp rx=0 tx=0).stop 2023-06-08T04:02:37.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.065+0000 7f52635ff700 1 -- 172.21.15.16:0/3520833468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f525c161d10 msgr2=0x7f525c14ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.065+0000 7f52635ff700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f525c161d10 0x7f525c14ea60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5254007e30 tx=0x7f525400e3c0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.065+0000 7f52635ff700 1 -- 172.21.15.16:0/3520833468 shutdown_connections 2023-06-08T04:02:37.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.065+0000 7f52635ff700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f524006ace0 0x7f524006d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.065+0000 7f52635ff700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f525c161d10 0x7f525c14ea60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.065+0000 7f52635ff700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f525c15a770 0x7f525c1f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.065+0000 7f52635ff700 1 --2- 172.21.15.16:0/3520833468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525c15b250 0x7f525c152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.065+0000 7f52635ff700 1 -- 172.21.15.16:0/3520833468 >> 172.21.15.16:0/3520833468 conn(0x7f525c06aa40 msgr2=0x7f525c0ae350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:37.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.066+0000 7f52635ff700 1 -- 172.21.15.16:0/3520833468 shutdown_connections 2023-06-08T04:02:37.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.066+0000 7f52635ff700 1 -- 172.21.15.16:0/3520833468 wait complete. 2023-06-08T04:02:37.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:02:37.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.286+0000 7f17c91ff700 1 Processor -- start 2023-06-08T04:02:37.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.286+0000 7f17c91ff700 1 -- start start 2023-06-08T04:02:37.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.287+0000 7f17c91ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17c4160a60 0x7f17c40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:37.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.287+0000 7f17c91ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c40d0800 con 0x7f17c40b83f0 2023-06-08T04:02:37.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.287+0000 7f17c91ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c40cd1e0 con 0x7f17c40b4b50 2023-06-08T04:02:37.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.287+0000 7f17c91ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4160ed0 con 0x7f17c4160a60 2023-06-08T04:02:37.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.288+0000 7f17c2d9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f17c40b83f0 0x7f17c40ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59854/0 (socket says 172.21.15.16:59854) 2023-06-08T04:02:37.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.288+0000 7f17c2d9d700 1 -- 172.21.15.16:0/474970260 learned_addr learned my addr 172.21.15.16:0/474970260 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:37.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.288+0000 7f17c259c700 1 --2- 172.21.15.16:0/474970260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17c4160a60 0x7f17c40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:37.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.288+0000 7f17c1d9b700 1 -- 172.21.15.16:0/474970260 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323625510 0 0) 0x7f17c40d0800 con 0x7f17c40b83f0 2023-06-08T04:02:37.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.288+0000 7f17c1d9b700 1 -- 172.21.15.16:0/474970260 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17ac0035b0 con 0x7f17c40b83f0 2023-06-08T04:02:37.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.288+0000 7f17c1d9b700 1 -- 172.21.15.16:0/474970260 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152915721 0 0) 0x7f17c40cd1e0 con 0x7f17c40b4b50 2023-06-08T04:02:37.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.288+0000 7f17c1d9b700 1 -- 172.21.15.16:0/474970260 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c40d0800 con 0x7f17c40b4b50 2023-06-08T04:02:37.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.288+0000 7f17c259c700 1 -- 172.21.15.16:0/474970260 >> v1:172.21.15.169:6789/0 conn(0x7f17c40b4b50 legacy=0x7f17c40d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.288+0000 7f17c259c700 1 -- 172.21.15.16:0/474970260 >> v1:172.21.15.16:6789/0 conn(0x7f17c40b83f0 legacy=0x7f17c40ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.288+0000 7f17c259c700 1 -- 172.21.15.16:0/474970260 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40cd4c0 con 0x7f17c4160a60 2023-06-08T04:02:37.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.289+0000 7f17c259c700 1 --2- 172.21.15.16:0/474970260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17c4160a60 0x7f17c40b4610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009870 tx=0x7f17b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d6dbb05886d77d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:37.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.289+0000 7f17c1d9b700 1 -- 172.21.15.16:0/474970260 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8011830 con 0x7f17c4160a60 2023-06-08T04:02:37.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.289+0000 7f17c1d9b700 1 -- 172.21.15.16:0/474970260 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b8011990 con 0x7f17c4160a60 2023-06-08T04:02:37.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.289+0000 7f17c1d9b700 1 -- 172.21.15.16:0/474970260 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8011d20 con 0x7f17c4160a60 2023-06-08T04:02:37.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.289+0000 7f17c91ff700 1 -- 172.21.15.16:0/474970260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17c4160a60 msgr2=0x7f17c40b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.289+0000 7f17c91ff700 1 --2- 172.21.15.16:0/474970260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17c4160a60 0x7f17c40b4610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009870 tx=0x7f17b8009b80 comp rx=0 tx=0).stop 2023-06-08T04:02:37.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.290+0000 7f17c91ff700 1 -- 172.21.15.16:0/474970260 shutdown_connections 2023-06-08T04:02:37.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.290+0000 7f17c91ff700 1 --2- 172.21.15.16:0/474970260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17c4160a60 0x7f17c40b4610 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.290+0000 7f17c91ff700 1 -- 172.21.15.16:0/474970260 >> 172.21.15.16:0/474970260 conn(0x7f17c40cf610 msgr2=0x7f17c40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:37.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.290+0000 7f17c91ff700 1 -- 172.21.15.16:0/474970260 shutdown_connections 2023-06-08T04:02:37.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.290+0000 7f17c91ff700 1 -- 172.21.15.16:0/474970260 wait complete. 2023-06-08T04:02:37.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.291+0000 7f17c91ff700 1 Processor -- start 2023-06-08T04:02:37.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.291+0000 7f17c91ff700 1 -- start start 2023-06-08T04:02:37.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.292+0000 7f17c91ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17c40b4b50 0x7f17c40c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:37.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.292+0000 7f17c91ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17c40b83f0 0x7f17c41495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:37.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.292+0000 7f17c91ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17c4160a60 0x7f17c415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:37.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.292+0000 7f17c91ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4149b00 con 0x7f17c4160a60 2023-06-08T04:02:37.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.292+0000 7f17c91ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c415dc20 con 0x7f17c40b83f0 2023-06-08T04:02:37.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.292+0000 7f17c91ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c415df00 con 0x7f17c40b4b50 2023-06-08T04:02:37.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.293+0000 7f17c359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17c4160a60 0x7f17c415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:37.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.293+0000 7f17c2d9d700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17c40b4b50 0x7f17c40c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:37.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.293+0000 7f17c359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17c4160a60 0x7f17c415ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60126/0 (socket says 172.21.15.16:60126) 2023-06-08T04:02:37.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.293+0000 7f17c359e700 1 -- 172.21.15.16:0/2160967428 learned_addr learned my addr 172.21.15.16:0/2160967428 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:37.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.293+0000 7f17c259c700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17c40b83f0 0x7f17c41495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:37.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.293+0000 7f17c359e700 1 -- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17c40b4b50 msgr2=0x7f17c40c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.293+0000 7f17c359e700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17c40b4b50 0x7f17c40c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.293+0000 7f17c359e700 1 -- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17c40b83f0 msgr2=0x7f17c41495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.293+0000 7f17c359e700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17c40b83f0 0x7f17c41495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.293+0000 7f17c359e700 1 -- 172.21.15.16:0/2160967428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80094a0 con 0x7f17c4160a60 2023-06-08T04:02:37.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.293+0000 7f17c359e700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17c4160a60 0x7f17c415ecc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00cbc0 tx=0x7f17bc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:37.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.294+0000 7f17ab7fe700 1 -- 172.21.15.16:0/2160967428 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc003c00 con 0x7f17c4160a60 2023-06-08T04:02:37.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.294+0000 7f17ab7fe700 1 -- 172.21.15.16:0/2160967428 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc003d60 con 0x7f17c4160a60 2023-06-08T04:02:37.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.294+0000 7f17ab7fe700 1 -- 172.21.15.16:0/2160967428 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00aaa0 con 0x7f17c4160a60 2023-06-08T04:02:37.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.294+0000 7f17c91ff700 1 -- 172.21.15.16:0/2160967428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c415e1e0 con 0x7f17c4160a60 2023-06-08T04:02:37.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.294+0000 7f17c91ff700 1 -- 172.21.15.16:0/2160967428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c415e7a0 con 0x7f17c4160a60 2023-06-08T04:02:37.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.295+0000 7f17c91ff700 1 -- 172.21.15.16:0/2160967428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c40740e0 con 0x7f17c4160a60 2023-06-08T04:02:37.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.296+0000 7f17ab7fe700 1 -- 172.21.15.16:0/2160967428 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f17bc00ac00 con 0x7f17c4160a60 2023-06-08T04:02:37.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.297+0000 7f17ab7fe700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f17b006ace0 0x7f17b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:37.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.297+0000 7f17ab7fe700 1 -- 172.21.15.16:0/2160967428 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17bc0894f0 con 0x7f17c4160a60 2023-06-08T04:02:37.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.297+0000 7f17c2d9d700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f17b006ace0 0x7f17b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:37.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.298+0000 7f17c2d9d700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f17b006ace0 0x7f17b006d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f17b4007fd0 tx=0x7f17b4007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:37.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.301+0000 7f17ab7fe700 1 -- 172.21.15.16:0/2160967428 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f17bc054500 con 0x7f17c4160a60 2023-06-08T04:02:37.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.507+0000 7f17c91ff700 1 -- 172.21.15.16:0/2160967428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17c415e9c0 con 0x7f17c4160a60 2023-06-08T04:02:37.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.507+0000 7f17ab7fe700 1 -- 172.21.15.16:0/2160967428 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17bc057b20 con 0x7f17c4160a60 2023-06-08T04:02:37.511 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:02:37.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.509+0000 7f17c91ff700 1 -- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f17b006ace0 msgr2=0x7f17b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.509+0000 7f17c91ff700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f17b006ace0 0x7f17b006d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f17b4007fd0 tx=0x7f17b4007dc0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.509+0000 7f17c91ff700 1 -- 172.21.15.16:0/2160967428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17c4160a60 msgr2=0x7f17c415ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.509+0000 7f17c91ff700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17c4160a60 0x7f17c415ecc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00cbc0 tx=0x7f17bc00ced0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.510+0000 7f17c91ff700 1 -- 172.21.15.16:0/2160967428 shutdown_connections 2023-06-08T04:02:37.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.510+0000 7f17c91ff700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f17b006ace0 0x7f17b006d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.510+0000 7f17c91ff700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17c4160a60 0x7f17c415ecc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.510+0000 7f17c91ff700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f17c40b4b50 0x7f17c40c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.510+0000 7f17c91ff700 1 --2- 172.21.15.16:0/2160967428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f17c40b83f0 0x7f17c41495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.510+0000 7f17c91ff700 1 -- 172.21.15.16:0/2160967428 >> 172.21.15.16:0/2160967428 conn(0x7f17c40cf610 msgr2=0x7f17c40cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:37.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.510+0000 7f17c91ff700 1 -- 172.21.15.16:0/2160967428 shutdown_connections 2023-06-08T04:02:37.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.510+0000 7f17c91ff700 1 -- 172.21.15.16:0/2160967428 wait complete. 2023-06-08T04:02:37.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:02:37.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.731+0000 7fa4d69ff700 1 Processor -- start 2023-06-08T04:02:37.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.731+0000 7fa4d69ff700 1 -- start start 2023-06-08T04:02:37.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.732+0000 7fa4d69ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa4d0160a60 0x7fa4d00b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:37.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.732+0000 7fa4d69ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d00b4b50 0x7fa4d00d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:37.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.732+0000 7fa4d69ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d00d0800 con 0x7fa4d00b83f0 2023-06-08T04:02:37.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.733+0000 7fa4d69ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d0160ed0 con 0x7fa4d0160a60 2023-06-08T04:02:37.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.733+0000 7fa4d69ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00b4fd0 con 0x7fa4d00b4b50 2023-06-08T04:02:37.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.733+0000 7fa4cf7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa4d0160a60 0x7fa4d00b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:37.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.733+0000 7fa4cffff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa4d00b83f0 0x7fa4d00ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59860/0 (socket says 172.21.15.16:59860) 2023-06-08T04:02:37.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.733+0000 7fa4cffff700 1 -- 172.21.15.16:0/1385589724 learned_addr learned my addr 172.21.15.16:0/1385589724 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.733+0000 7fa4d4f9c700 1 --2- 172.21.15.16:0/1385589724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d00b4b50 0x7fa4d00d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.733+0000 7fa4cf7fe700 1 -- 172.21.15.16:0/1385589724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d00b4b50 msgr2=0x7fa4d00d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.733+0000 7fa4cf7fe700 1 --2- 172.21.15.16:0/1385589724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d00b4b50 0x7fa4d00d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.733+0000 7fa4cf7fe700 1 -- 172.21.15.16:0/1385589724 >> v1:172.21.15.16:6789/0 conn(0x7fa4d00b83f0 legacy=0x7fa4d00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.733+0000 7fa4cf7fe700 1 -- 172.21.15.16:0/1385589724 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d00cd1e0 con 0x7fa4d0160a60 2023-06-08T04:02:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.733+0000 7fa4ceffd700 1 -- 172.21.15.16:0/1385589724 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098068663 0 0) 0x7fa4d00d0800 con 0x7fa4d00b83f0 2023-06-08T04:02:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.734+0000 7fa4cf7fe700 1 --2- 172.21.15.16:0/1385589724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0160a60 0x7fa4d00b4610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009840 tx=0x7fa4c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486532e8b64f0190 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.734+0000 7fa4ceffd700 1 -- 172.21.15.16:0/1385589724 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4011830 con 0x7fa4d0160a60 2023-06-08T04:02:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.734+0000 7fa4ceffd700 1 -- 172.21.15.16:0/1385589724 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c4011990 con 0x7fa4d0160a60 2023-06-08T04:02:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.734+0000 7fa4ceffd700 1 -- 172.21.15.16:0/1385589724 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4011d20 con 0x7fa4d0160a60 2023-06-08T04:02:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.734+0000 7fa4d69ff700 1 -- 172.21.15.16:0/1385589724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0160a60 msgr2=0x7fa4d00b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.734+0000 7fa4d69ff700 1 --2- 172.21.15.16:0/1385589724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0160a60 0x7fa4d00b4610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009840 tx=0x7fa4c4009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.734+0000 7fa4d69ff700 1 -- 172.21.15.16:0/1385589724 shutdown_connections 2023-06-08T04:02:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.734+0000 7fa4d69ff700 1 --2- 172.21.15.16:0/1385589724 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d00b4b50 0x7fa4d00d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.734+0000 7fa4d69ff700 1 --2- 172.21.15.16:0/1385589724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d0160a60 0x7fa4d00b4610 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.734+0000 7fa4d69ff700 1 -- 172.21.15.16:0/1385589724 >> 172.21.15.16:0/1385589724 conn(0x7fa4d00cf610 msgr2=0x7fa4d00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.735+0000 7fa4d69ff700 1 -- 172.21.15.16:0/1385589724 shutdown_connections 2023-06-08T04:02:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.735+0000 7fa4d69ff700 1 -- 172.21.15.16:0/1385589724 wait complete. 2023-06-08T04:02:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.736+0000 7fa4d69ff700 1 Processor -- start 2023-06-08T04:02:37.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.736+0000 7fa4d69ff700 1 -- start start 2023-06-08T04:02:37.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.737+0000 7fa4d69ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d00b4b50 0x7fa4d00cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:37.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.737+0000 7fa4d69ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d00b83f0 0x7fa4d01542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:37.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.737+0000 7fa4d69ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4d0160a60 0x7fa4d015b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:37.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.737+0000 7fa4d69ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0154810 con 0x7fa4d00b4b50 2023-06-08T04:02:37.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.737+0000 7fa4d69ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d015b540 con 0x7fa4d0160a60 2023-06-08T04:02:37.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.737+0000 7fa4d69ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d015d410 con 0x7fa4d00b83f0 2023-06-08T04:02:37.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4cffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d00b4b50 0x7fa4d00cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:37.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4cffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d00b4b50 0x7fa4d00cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60154/0 (socket says 172.21.15.16:60154) 2023-06-08T04:02:37.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4cffff700 1 -- 172.21.15.16:0/2694389006 learned_addr learned my addr 172.21.15.16:0/2694389006 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:37.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4cf7fe700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d00b83f0 0x7fa4d01542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:37.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4d4f9c700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4d0160a60 0x7fa4d015b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:37.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4cffff700 1 -- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d00b83f0 msgr2=0x7fa4d01542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4cffff700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d00b83f0 0x7fa4d01542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4cffff700 1 -- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4d0160a60 msgr2=0x7fa4d015b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4cffff700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4d0160a60 0x7fa4d015b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4cffff700 1 -- 172.21.15.16:0/2694389006 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40094a0 con 0x7fa4d00b4b50 2023-06-08T04:02:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4cf7fe700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d00b83f0 0x7fa4d01542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.738+0000 7fa4cffff700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d00b4b50 0x7fa4d00cc6a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00011e0 tx=0x7fa4c000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.739+0000 7fa4ccff9700 1 -- 172.21.15.16:0/2694389006 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0004c80 con 0x7fa4d00b4b50 2023-06-08T04:02:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.739+0000 7fa4ccff9700 1 -- 172.21.15.16:0/2694389006 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c0004e00 con 0x7fa4d00b4b50 2023-06-08T04:02:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.739+0000 7fa4d69ff700 1 -- 172.21.15.16:0/2694389006 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d015d690 con 0x7fa4d00b4b50 2023-06-08T04:02:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.739+0000 7fa4ccff9700 1 -- 172.21.15.16:0/2694389006 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0007310 con 0x7fa4d00b4b50 2023-06-08T04:02:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.739+0000 7fa4d69ff700 1 -- 172.21.15.16:0/2694389006 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d015dc50 con 0x7fa4d00b4b50 2023-06-08T04:02:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.740+0000 7fa4d69ff700 1 -- 172.21.15.16:0/2694389006 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d00740e0 con 0x7fa4d00b4b50 2023-06-08T04:02:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.741+0000 7fa4ccff9700 1 -- 172.21.15.16:0/2694389006 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa4c0007470 con 0x7fa4d00b4b50 2023-06-08T04:02:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.742+0000 7fa4ccff9700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa4bc06ace0 0x7fa4bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.742+0000 7fa4ccff9700 1 -- 172.21.15.16:0/2694389006 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4c0089220 con 0x7fa4d00b4b50 2023-06-08T04:02:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.742+0000 7fa4cf7fe700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa4bc06ace0 0x7fa4bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.743+0000 7fa4cf7fe700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa4bc06ace0 0x7fa4bc06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40090b0 tx=0x7fa4c401c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:37.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.746+0000 7fa4ccff9700 1 -- 172.21.15.16:0/2694389006 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa4c0054360 con 0x7fa4d00b4b50 2023-06-08T04:02:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.953+0000 7fa4d69ff700 1 -- 172.21.15.16:0/2694389006 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4d00d1b90 con 0x7fa4d00b4b50 2023-06-08T04:02:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.953+0000 7fa4ccff9700 1 -- 172.21.15.16:0/2694389006 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4c0057980 con 0x7fa4d00b4b50 2023-06-08T04:02:37.958 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:02:37.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 -- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa4bc06ace0 msgr2=0x7fa4bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa4bc06ace0 0x7fa4bc06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40090b0 tx=0x7fa4c401c040 comp rx=0 tx=0).stop 2023-06-08T04:02:37.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 -- 172.21.15.16:0/2694389006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d00b4b50 msgr2=0x7fa4d00cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:37.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d00b4b50 0x7fa4d00cc6a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00011e0 tx=0x7fa4c000cae0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 -- 172.21.15.16:0/2694389006 shutdown_connections 2023-06-08T04:02:37.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa4bc06ace0 0x7fa4bc06d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4d0160a60 0x7fa4d015b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4d00b4b50 0x7fa4d00cc6a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 --2- 172.21.15.16:0/2694389006 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4d00b83f0 0x7fa4d01542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:37.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 -- 172.21.15.16:0/2694389006 >> 172.21.15.16:0/2694389006 conn(0x7fa4d00cf610 msgr2=0x7fa4d00b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:37.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 -- 172.21.15.16:0/2694389006 shutdown_connections 2023-06-08T04:02:37.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:37.956+0000 7fa4d69ff700 1 -- 172.21.15.16:0/2694389006 wait complete. 2023-06-08T04:02:37.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:02:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.176+0000 7f2ad0fff700 1 Processor -- start 2023-06-08T04:02:38.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.176+0000 7f2ad0fff700 1 -- start start 2023-06-08T04:02:38.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.177+0000 7f2ad0fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2acc0b83f0 0x7f2acc160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.177+0000 7f2ad0fff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2acc0b4d20 0x7f2acc0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.177+0000 7f2ad0fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2acc0d0800 con 0x7f2acc0ced40 2023-06-08T04:02:38.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.177+0000 7f2ad0fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2acc0cd1e0 con 0x7f2acc0b83f0 2023-06-08T04:02:38.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.177+0000 7f2ad0fff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2acc0cd4c0 con 0x7f2acc0b4d20 2023-06-08T04:02:38.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.177+0000 7f2aca59c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2acc0b83f0 0x7f2acc160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.177+0000 7f2aca59c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2acc0b83f0 0x7f2acc160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60164/0 (socket says 172.21.15.16:60164) 2023-06-08T04:02:38.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.177+0000 7f2ac3fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2acc0ced40 0x7f2acc0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59870/0 (socket says 172.21.15.16:59870) 2023-06-08T04:02:38.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.177+0000 7f2aca59c700 1 -- 172.21.15.16:0/301985116 learned_addr learned my addr 172.21.15.16:0/301985116 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:38.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.178+0000 7f2acad9d700 1 --2- 172.21.15.16:0/301985116 >> v2:172.21.15.169:3300/0 conn(0x7f2acc0b4d20 0x7f2acc0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.183 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.178+0000 7f2aca59c700 1 -- 172.21.15.16:0/301985116 >> v2:172.21.15.169:3300/0 conn(0x7f2acc0b4d20 msgr2=0x7f2acc0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:38.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.178+0000 7f2aca59c700 1 --2- 172.21.15.16:0/301985116 >> v2:172.21.15.169:3300/0 conn(0x7f2acc0b4d20 0x7f2acc0d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.178+0000 7f2aca59c700 1 -- 172.21.15.16:0/301985116 >> v1:172.21.15.16:6789/0 conn(0x7f2acc0ced40 legacy=0x7f2acc0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:38.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.178+0000 7f2aca59c700 1 -- 172.21.15.16:0/301985116 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc0d0aa0 con 0x7f2acc0b83f0 2023-06-08T04:02:38.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.178+0000 7f2ac9d9b700 1 -- 172.21.15.16:0/301985116 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146605667 0 0) 0x7f2acc0d0800 con 0x7f2acc0ced40 2023-06-08T04:02:38.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.178+0000 7f2aca59c700 1 --2- 172.21.15.16:0/301985116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc0b83f0 0x7f2acc160a60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2acc160fa0 tx=0x7f2abc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84f7639907af714 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:38.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.178+0000 7f2ac9d9b700 1 -- 172.21.15.16:0/301985116 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc011830 con 0x7f2acc0b83f0 2023-06-08T04:02:38.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.179+0000 7f2ac9d9b700 1 -- 172.21.15.16:0/301985116 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc011990 con 0x7f2acc0b83f0 2023-06-08T04:02:38.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.179+0000 7f2ac9d9b700 1 -- 172.21.15.16:0/301985116 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc011d20 con 0x7f2acc0b83f0 2023-06-08T04:02:38.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.179+0000 7f2ad0fff700 1 -- 172.21.15.16:0/301985116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc0b83f0 msgr2=0x7f2acc160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:38.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.179+0000 7f2ad0fff700 1 --2- 172.21.15.16:0/301985116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc0b83f0 0x7f2acc160a60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2acc160fa0 tx=0x7f2abc009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.179+0000 7f2ad0fff700 1 -- 172.21.15.16:0/301985116 shutdown_connections 2023-06-08T04:02:38.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.179+0000 7f2ad0fff700 1 --2- 172.21.15.16:0/301985116 >> v2:172.21.15.169:3300/0 conn(0x7f2acc0b4d20 0x7f2acc0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.179+0000 7f2ad0fff700 1 --2- 172.21.15.16:0/301985116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc0b83f0 0x7f2acc160a60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.179+0000 7f2ad0fff700 1 -- 172.21.15.16:0/301985116 >> 172.21.15.16:0/301985116 conn(0x7f2acc0cf610 msgr2=0x7f2acc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:38.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.179+0000 7f2ad0fff700 1 -- 172.21.15.16:0/301985116 shutdown_connections 2023-06-08T04:02:38.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.179+0000 7f2ad0fff700 1 -- 172.21.15.16:0/301985116 wait complete. 2023-06-08T04:02:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.181+0000 7f2ad0fff700 1 Processor -- start 2023-06-08T04:02:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.181+0000 7f2ad0fff700 1 -- start start 2023-06-08T04:02:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.182+0000 7f2ad0fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc0b4d20 0x7f2acc152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.182+0000 7f2ad0fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2acc0b83f0 0x7f2acc1f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.182+0000 7f2ad0fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2acc0ced40 0x7f2acc0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.182+0000 7f2ad0fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0caa10 con 0x7f2acc0b4d20 2023-06-08T04:02:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.182+0000 7f2ad0fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc1f61a0 con 0x7f2acc0b83f0 2023-06-08T04:02:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.182+0000 7f2ad0fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0c9e00 con 0x7f2acc0ced40 2023-06-08T04:02:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.182+0000 7f2aca59c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc0b4d20 0x7f2acc152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.182+0000 7f2aca59c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc0b4d20 0x7f2acc152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60166/0 (socket says 172.21.15.16:60166) 2023-06-08T04:02:38.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.182+0000 7f2aca59c700 1 -- 172.21.15.16:0/2828732601 learned_addr learned my addr 172.21.15.16:0/2828732601 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:38.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.182+0000 7f2ac3fff700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2acc0b83f0 0x7f2acc1f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.182+0000 7f2acad9d700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2acc0ced40 0x7f2acc0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.183+0000 7f2aca59c700 1 -- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2acc0ced40 msgr2=0x7f2acc0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:38.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.183+0000 7f2aca59c700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2acc0ced40 0x7f2acc0cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.183+0000 7f2aca59c700 1 -- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2acc0b83f0 msgr2=0x7f2acc1f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:38.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.183+0000 7f2aca59c700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2acc0b83f0 0x7f2acc1f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.183+0000 7f2aca59c700 1 -- 172.21.15.16:0/2828732601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc009550 con 0x7f2acc0b4d20 2023-06-08T04:02:38.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.183+0000 7f2aca59c700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc0b4d20 0x7f2acc152890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009c10 tx=0x7f2abc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:38.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.183+0000 7f2ac2ffd700 1 -- 172.21.15.16:0/2828732601 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc004510 con 0x7f2acc0b4d20 2023-06-08T04:02:38.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.183+0000 7f2ac2ffd700 1 -- 172.21.15.16:0/2828732601 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc0036a0 con 0x7f2acc0b4d20 2023-06-08T04:02:38.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.183+0000 7f2ad0fff700 1 -- 172.21.15.16:0/2828732601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2acc0ca0e0 con 0x7f2acc0b4d20 2023-06-08T04:02:38.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.183+0000 7f2ac2ffd700 1 -- 172.21.15.16:0/2828732601 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc003a10 con 0x7f2acc0b4d20 2023-06-08T04:02:38.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.184+0000 7f2ad0fff700 1 -- 172.21.15.16:0/2828732601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc0ca6a0 con 0x7f2acc0b4d20 2023-06-08T04:02:38.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.184+0000 7f2ad0fff700 1 -- 172.21.15.16:0/2828732601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2acc0b23b0 con 0x7f2acc0b4d20 2023-06-08T04:02:38.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.185+0000 7f2ac2ffd700 1 -- 172.21.15.16:0/2828732601 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2abc003b70 con 0x7f2acc0b4d20 2023-06-08T04:02:38.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.186+0000 7f2ac2ffd700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2aac06ace0 0x7f2aac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.186+0000 7f2ac2ffd700 1 -- 172.21.15.16:0/2828732601 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2abc021030 con 0x7f2acc0b4d20 2023-06-08T04:02:38.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.187+0000 7f2ac3fff700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2aac06ace0 0x7f2aac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.187+0000 7f2ac3fff700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2aac06ace0 0x7f2aac06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4000f60 tx=0x7f2ab4007e70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:38.194 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.191+0000 7f2ac2ffd700 1 -- 172.21.15.16:0/2828732601 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2abc055bb0 con 0x7f2acc0b4d20 2023-06-08T04:02:38.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.397+0000 7f2ad0fff700 1 -- 172.21.15.16:0/2828732601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2acc0740e0 con 0x7f2acc0b4d20 2023-06-08T04:02:38.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.397+0000 7f2ac2ffd700 1 -- 172.21.15.16:0/2828732601 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2abc015020 con 0x7f2acc0b4d20 2023-06-08T04:02:38.401 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:02:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 -- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2aac06ace0 msgr2=0x7f2aac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2aac06ace0 0x7f2aac06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4000f60 tx=0x7f2ab4007e70 comp rx=0 tx=0).stop 2023-06-08T04:02:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 -- 172.21.15.16:0/2828732601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc0b4d20 msgr2=0x7f2acc152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc0b4d20 0x7f2acc152890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009c10 tx=0x7f2abc004750 comp rx=0 tx=0).stop 2023-06-08T04:02:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 -- 172.21.15.16:0/2828732601 shutdown_connections 2023-06-08T04:02:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2aac06ace0 0x7f2aac06d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2acc0ced40 0x7f2acc0cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc0b4d20 0x7f2acc152890 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 --2- 172.21.15.16:0/2828732601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2acc0b83f0 0x7f2acc1f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 -- 172.21.15.16:0/2828732601 >> 172.21.15.16:0/2828732601 conn(0x7f2acc0cf610 msgr2=0x7f2acc06b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:38.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 -- 172.21.15.16:0/2828732601 shutdown_connections 2023-06-08T04:02:38.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.400+0000 7f2ad0fff700 1 -- 172.21.15.16:0/2828732601 wait complete. 2023-06-08T04:02:38.432 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-08T04:02:38.433 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-08T04:02:38.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.630+0000 7fc51a9ff700 1 Processor -- start 2023-06-08T04:02:38.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.630+0000 7fc51a9ff700 1 -- start start 2023-06-08T04:02:38.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.631+0000 7fc51a9ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc514156860 0x7fc5140d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.631+0000 7fc51a9ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc51415d790 0x7fc5140cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.631+0000 7fc51a9ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc5140cd770 0x7fc5140d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.631+0000 7fc51a9ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5140cf050 con 0x7fc51415d790 2023-06-08T04:02:38.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.631+0000 7fc51a9ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5140cf2f0 con 0x7fc5140cd770 2023-06-08T04:02:38.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.631+0000 7fc51a9ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5140cf5d0 con 0x7fc514156860 2023-06-08T04:02:38.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.632+0000 7fc5137fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc51415d790 0x7fc5140cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.632+0000 7fc5137fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc51415d790 0x7fc5140cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60178/0 (socket says 172.21.15.16:60178) 2023-06-08T04:02:38.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.632+0000 7fc5137fe700 1 -- 172.21.15.16:0/2602012213 learned_addr learned my addr 172.21.15.16:0/2602012213 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:38.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.632+0000 7fc513fff700 1 --2- 172.21.15.16:0/2602012213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc514156860 0x7fc5140d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.632+0000 7fc518f9c700 1 --2- 172.21.15.16:0/2602012213 >> v2:172.21.15.169:3300/0 conn(0x7fc5140cd770 0x7fc5140d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.632+0000 7fc5137fe700 1 -- 172.21.15.16:0/2602012213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc514156860 msgr2=0x7fc5140d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:38.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.632+0000 7fc5137fe700 1 --2- 172.21.15.16:0/2602012213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc514156860 0x7fc5140d00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.632+0000 7fc5137fe700 1 -- 172.21.15.16:0/2602012213 >> v2:172.21.15.169:3300/0 conn(0x7fc5140cd770 msgr2=0x7fc5140d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:38.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.632+0000 7fc5137fe700 1 --2- 172.21.15.16:0/2602012213 >> v2:172.21.15.169:3300/0 conn(0x7fc5140cd770 0x7fc5140d2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.632+0000 7fc5137fe700 1 -- 172.21.15.16:0/2602012213 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5140cf8b0 con 0x7fc51415d790 2023-06-08T04:02:38.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.632+0000 7fc5137fe700 1 --2- 172.21.15.16:0/2602012213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51415d790 0x7fc5140cd230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc5140cecc0 tx=0x7fc508009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99742f08cff43d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:38.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc512ffd700 1 -- 172.21.15.16:0/2602012213 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508011830 con 0x7fc51415d790 2023-06-08T04:02:38.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc512ffd700 1 -- 172.21.15.16:0/2602012213 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc508011990 con 0x7fc51415d790 2023-06-08T04:02:38.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc512ffd700 1 -- 172.21.15.16:0/2602012213 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508011d20 con 0x7fc51415d790 2023-06-08T04:02:38.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc51a9ff700 1 -- 172.21.15.16:0/2602012213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51415d790 msgr2=0x7fc5140cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:38.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc51a9ff700 1 --2- 172.21.15.16:0/2602012213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51415d790 0x7fc5140cd230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc5140cecc0 tx=0x7fc508009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc51a9ff700 1 -- 172.21.15.16:0/2602012213 shutdown_connections 2023-06-08T04:02:38.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc51a9ff700 1 --2- 172.21.15.16:0/2602012213 >> v2:172.21.15.169:3300/0 conn(0x7fc5140cd770 0x7fc5140d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc51a9ff700 1 --2- 172.21.15.16:0/2602012213 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc514156860 0x7fc5140d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc51a9ff700 1 --2- 172.21.15.16:0/2602012213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc51415d790 0x7fc5140cd230 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc51a9ff700 1 -- 172.21.15.16:0/2602012213 >> 172.21.15.16:0/2602012213 conn(0x7fc51406b350 msgr2=0x7fc51406b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:38.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc51a9ff700 1 -- 172.21.15.16:0/2602012213 shutdown_connections 2023-06-08T04:02:38.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.633+0000 7fc51a9ff700 1 -- 172.21.15.16:0/2602012213 wait complete. 2023-06-08T04:02:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.635+0000 7fc51a9ff700 1 Processor -- start 2023-06-08T04:02:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.635+0000 7fc51a9ff700 1 -- start start 2023-06-08T04:02:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.636+0000 7fc51a9ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5140cd770 0x7fc51414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.636+0000 7fc51a9ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc514156860 0x7fc51415a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.636+0000 7fc51a9ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc51415d790 0x7fc51415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.636+0000 7fc51a9ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51414c5e0 con 0x7fc5140cd770 2023-06-08T04:02:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.636+0000 7fc51a9ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51415b520 con 0x7fc51415d790 2023-06-08T04:02:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.636+0000 7fc51a9ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51415b800 con 0x7fc514156860 2023-06-08T04:02:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.636+0000 7fc513fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5140cd770 0x7fc51414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.636+0000 7fc513fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5140cd770 0x7fc51414c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60194/0 (socket says 172.21.15.16:60194) 2023-06-08T04:02:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.636+0000 7fc513fff700 1 -- 172.21.15.16:0/947526196 learned_addr learned my addr 172.21.15.16:0/947526196 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:38.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc5137fe700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc514156860 0x7fc51415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc518f9c700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc51415d790 0x7fc51415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc513fff700 1 -- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc514156860 msgr2=0x7fc51415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc513fff700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc514156860 0x7fc51415a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc513fff700 1 -- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc51415d790 msgr2=0x7fc51415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc513fff700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc51415d790 0x7fc51415aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc513fff700 1 -- 172.21.15.16:0/947526196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508009550 con 0x7fc5140cd770 2023-06-08T04:02:38.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc513fff700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5140cd770 0x7fc51414c0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e9b0 tx=0x7fc50400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:38.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc510ff9700 1 -- 172.21.15.16:0/947526196 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504009710 con 0x7fc5140cd770 2023-06-08T04:02:38.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc510ff9700 1 -- 172.21.15.16:0/947526196 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50400c850 con 0x7fc5140cd770 2023-06-08T04:02:38.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc510ff9700 1 -- 172.21.15.16:0/947526196 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50400cbc0 con 0x7fc5140cd770 2023-06-08T04:02:38.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.637+0000 7fc51a9ff700 1 -- 172.21.15.16:0/947526196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51415bae0 con 0x7fc5140cd770 2023-06-08T04:02:38.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.638+0000 7fc51a9ff700 1 -- 172.21.15.16:0/947526196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51415c0a0 con 0x7fc5140cd770 2023-06-08T04:02:38.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.639+0000 7fc51a9ff700 1 -- 172.21.15.16:0/947526196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5140740e0 con 0x7fc5140cd770 2023-06-08T04:02:38.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.640+0000 7fc510ff9700 1 -- 172.21.15.16:0/947526196 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc50400cd20 con 0x7fc5140cd770 2023-06-08T04:02:38.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.640+0000 7fc510ff9700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc50006ace0 0x7fc50006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:38.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.640+0000 7fc510ff9700 1 -- 172.21.15.16:0/947526196 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5040895a0 con 0x7fc5140cd770 2023-06-08T04:02:38.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.641+0000 7fc5137fe700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc50006ace0 0x7fc50006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:38.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.642+0000 7fc5137fe700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc50006ace0 0x7fc50006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc508009c10 tx=0x7fc508008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:38.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.645+0000 7fc510ff9700 1 -- 172.21.15.16:0/947526196 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc5040580d0 con 0x7fc5140cd770 2023-06-08T04:02:38.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:38.933+0000 7fc51a9ff700 1 -- 172.21.15.16:0/947526196 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fc5140b5290 con 0x7fc5140cd770 2023-06-08T04:02:39.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.910+0000 7fc510ff9700 1 -- 172.21.15.16:0/947526196 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v53) v1 ==== 147+0+0 (secure 0 0 0) 0x7fc504057c60 con 0x7fc5140cd770 2023-06-08T04:02:39.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 -- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc50006ace0 msgr2=0x7fc50006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:39.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc50006ace0 0x7fc50006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc508009c10 tx=0x7fc508008030 comp rx=0 tx=0).stop 2023-06-08T04:02:39.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 -- 172.21.15.16:0/947526196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5140cd770 msgr2=0x7fc51414c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:39.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5140cd770 0x7fc51414c0a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e9b0 tx=0x7fc50400ed70 comp rx=0 tx=0).stop 2023-06-08T04:02:39.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 -- 172.21.15.16:0/947526196 shutdown_connections 2023-06-08T04:02:39.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc50006ace0 0x7fc50006d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:39.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc51415d790 0x7fc51415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:39.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5140cd770 0x7fc51414c0a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:39.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 --2- 172.21.15.16:0/947526196 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc514156860 0x7fc51415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:39.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 -- 172.21.15.16:0/947526196 >> 172.21.15.16:0/947526196 conn(0x7fc51406b350 msgr2=0x7fc51415f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:39.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 -- 172.21.15.16:0/947526196 shutdown_connections 2023-06-08T04:02:39.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:39.913+0000 7fc51a9ff700 1 -- 172.21.15.16:0/947526196 wait complete. 2023-06-08T04:02:39.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-08T04:02:40.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.141+0000 7f30479ff700 1 Processor -- start 2023-06-08T04:02:40.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.141+0000 7f30479ff700 1 -- start start 2023-06-08T04:02:40.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.142+0000 7f30479ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f30400b83f0 0x7f3040160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:40.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.142+0000 7f30479ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f30400b4d20 0x7f30400d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:40.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.142+0000 7f30479ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30400d0800 con 0x7f30400ced40 2023-06-08T04:02:40.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.142+0000 7f30479ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30400cd1e0 con 0x7f30400b83f0 2023-06-08T04:02:40.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.142+0000 7f30479ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30400cd4c0 con 0x7f30400b4d20 2023-06-08T04:02:40.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.143+0000 7f304579b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f30400b83f0 0x7f3040160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:40.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.143+0000 7f3044f9a700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f30400ced40 0x7f30400b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59886/0 (socket says 172.21.15.16:59886) 2023-06-08T04:02:40.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.143+0000 7f3044f9a700 1 -- 172.21.15.16:0/3888238839 learned_addr learned my addr 172.21.15.16:0/3888238839 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:40.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.143+0000 7f304579b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f30400b83f0 0x7f3040160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60206/0 (socket says 172.21.15.16:60206) 2023-06-08T04:02:40.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.143+0000 7f3045f9c700 1 --2- 172.21.15.16:0/3888238839 >> v2:172.21.15.169:3300/0 conn(0x7f30400b4d20 0x7f30400d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:40.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.143+0000 7f304579b700 1 -- 172.21.15.16:0/3888238839 >> v2:172.21.15.169:3300/0 conn(0x7f30400b4d20 msgr2=0x7f30400d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:40.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.143+0000 7f304579b700 1 --2- 172.21.15.16:0/3888238839 >> v2:172.21.15.169:3300/0 conn(0x7f30400b4d20 0x7f30400d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:40.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.143+0000 7f304579b700 1 -- 172.21.15.16:0/3888238839 >> v1:172.21.15.16:6789/0 conn(0x7f30400ced40 legacy=0x7f30400b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:40.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.143+0000 7f304579b700 1 -- 172.21.15.16:0/3888238839 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400d0aa0 con 0x7f30400b83f0 2023-06-08T04:02:40.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.143+0000 7f3045f9c700 1 --2- 172.21.15.16:0/3888238839 >> v2:172.21.15.169:3300/0 conn(0x7f30400b4d20 0x7f30400d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:40.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.143+0000 7f3037fff700 1 -- 172.21.15.16:0/3888238839 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824379897 0 0) 0x7f30400d0800 con 0x7f30400ced40 2023-06-08T04:02:40.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.144+0000 7f304579b700 1 --2- 172.21.15.16:0/3888238839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30400b83f0 0x7f3040160a60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3040160fa0 tx=0x7f303c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dde41bf3de8abd server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:40.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.144+0000 7f3037fff700 1 -- 172.21.15.16:0/3888238839 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c011830 con 0x7f30400b83f0 2023-06-08T04:02:40.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.144+0000 7f3037fff700 1 -- 172.21.15.16:0/3888238839 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c011990 con 0x7f30400b83f0 2023-06-08T04:02:40.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.144+0000 7f3037fff700 1 -- 172.21.15.16:0/3888238839 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c011d20 con 0x7f30400b83f0 2023-06-08T04:02:40.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.144+0000 7f30479ff700 1 -- 172.21.15.16:0/3888238839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30400b83f0 msgr2=0x7f3040160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:40.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.144+0000 7f30479ff700 1 --2- 172.21.15.16:0/3888238839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30400b83f0 0x7f3040160a60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3040160fa0 tx=0x7f303c009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:40.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.144+0000 7f30479ff700 1 -- 172.21.15.16:0/3888238839 shutdown_connections 2023-06-08T04:02:40.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.144+0000 7f30479ff700 1 --2- 172.21.15.16:0/3888238839 >> v2:172.21.15.169:3300/0 conn(0x7f30400b4d20 0x7f30400d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:40.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.144+0000 7f30479ff700 1 --2- 172.21.15.16:0/3888238839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30400b83f0 0x7f3040160a60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:40.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.144+0000 7f30479ff700 1 -- 172.21.15.16:0/3888238839 >> 172.21.15.16:0/3888238839 conn(0x7f30400cf610 msgr2=0x7f30400cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:40.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.144+0000 7f30479ff700 1 -- 172.21.15.16:0/3888238839 shutdown_connections 2023-06-08T04:02:40.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.145+0000 7f30479ff700 1 -- 172.21.15.16:0/3888238839 wait complete. 2023-06-08T04:02:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.146+0000 7f30479ff700 1 Processor -- start 2023-06-08T04:02:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.146+0000 7f30479ff700 1 -- start start 2023-06-08T04:02:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.147+0000 7f30479ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30400b4d20 0x7f3040152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.147+0000 7f30479ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30400b83f0 0x7f30401f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:40.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.147+0000 7f30479ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30400ced40 0x7f30400cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.147+0000 7f30479ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30400caa10 con 0x7f30400ced40 2023-06-08T04:02:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.147+0000 7f30479ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30401f61a0 con 0x7f30400b4d20 2023-06-08T04:02:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.147+0000 7f30479ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30400c9e00 con 0x7f30400b83f0 2023-06-08T04:02:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f3045f9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30400ced40 0x7f30400cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f3045f9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30400ced40 0x7f30400cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60212/0 (socket says 172.21.15.16:60212) 2023-06-08T04:02:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f3045f9c700 1 -- 172.21.15.16:0/3535988729 learned_addr learned my addr 172.21.15.16:0/3535988729 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f304579b700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30400b4d20 0x7f3040152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:40.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f3044f9a700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30400b83f0 0x7f30401f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f3045f9c700 1 -- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30400b83f0 msgr2=0x7f30401f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f3045f9c700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30400b83f0 0x7f30401f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f3045f9c700 1 -- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30400b4d20 msgr2=0x7f3040152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f3045f9c700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30400b4d20 0x7f3040152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f3045f9c700 1 -- 172.21.15.16:0/3535988729 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0094a0 con 0x7f30400ced40 2023-06-08T04:02:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f3044f9a700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30400b83f0 0x7f30401f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:40.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.148+0000 7f3045f9c700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30400ced40 0x7f30400cb820 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3038007e40 tx=0x7f303800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.149+0000 7f3035ffb700 1 -- 172.21.15.16:0/3535988729 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800ddd0 con 0x7f30400ced40 2023-06-08T04:02:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.149+0000 7f3035ffb700 1 -- 172.21.15.16:0/3535988729 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303800f040 con 0x7f30400ced40 2023-06-08T04:02:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.149+0000 7f30479ff700 1 -- 172.21.15.16:0/3535988729 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30400ca0e0 con 0x7f30400ced40 2023-06-08T04:02:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.149+0000 7f3035ffb700 1 -- 172.21.15.16:0/3535988729 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038015640 con 0x7f30400ced40 2023-06-08T04:02:40.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.149+0000 7f30479ff700 1 -- 172.21.15.16:0/3535988729 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30400ca6a0 con 0x7f30400ced40 2023-06-08T04:02:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.150+0000 7f30479ff700 1 -- 172.21.15.16:0/3535988729 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30400b23b0 con 0x7f30400ced40 2023-06-08T04:02:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.151+0000 7f3035ffb700 1 -- 172.21.15.16:0/3535988729 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f303801e3b0 con 0x7f30400ced40 2023-06-08T04:02:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.152+0000 7f3035ffb700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f302406ace0 0x7f302406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.152+0000 7f3035ffb700 1 -- 172.21.15.16:0/3535988729 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3038089690 con 0x7f30400ced40 2023-06-08T04:02:40.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.152+0000 7f304579b700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f302406ace0 0x7f302406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:40.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.153+0000 7f304579b700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f302406ace0 0x7f302406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f303c0090b0 tx=0x7f303c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:40.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.156+0000 7f3035ffb700 1 -- 172.21.15.16:0/3535988729 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f30380546a0 con 0x7f30400ced40 2023-06-08T04:02:40.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.363+0000 7f30479ff700 1 -- 172.21.15.16:0/3535988729 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f30400740e0 con 0x7f30400ced40 2023-06-08T04:02:40.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.367+0000 7f3035ffb700 1 -- 172.21.15.16:0/3535988729 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3038057cc0 con 0x7f30400ced40 2023-06-08T04:02:40.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 -- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f302406ace0 msgr2=0x7f302406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:40.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f302406ace0 0x7f302406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f303c0090b0 tx=0x7f303c008030 comp rx=0 tx=0).stop 2023-06-08T04:02:40.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 -- 172.21.15.16:0/3535988729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30400ced40 msgr2=0x7f30400cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:40.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30400ced40 0x7f30400cb820 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3038007e40 tx=0x7f303800d3b0 comp rx=0 tx=0).stop 2023-06-08T04:02:40.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 -- 172.21.15.16:0/3535988729 shutdown_connections 2023-06-08T04:02:40.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f302406ace0 0x7f302406d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:40.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30400ced40 0x7f30400cb820 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:40.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30400b4d20 0x7f3040152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:40.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 --2- 172.21.15.16:0/3535988729 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30400b83f0 0x7f30401f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:40.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 -- 172.21.15.16:0/3535988729 >> 172.21.15.16:0/3535988729 conn(0x7f30400cf610 msgr2=0x7f304006b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:40.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 -- 172.21.15.16:0/3535988729 shutdown_connections 2023-06-08T04:02:40.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:40.370+0000 7f30479ff700 1 -- 172.21.15.16:0/3535988729 wait complete. 2023-06-08T04:02:40.391 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-08T04:02:40.392 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-08T04:02:40.490 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-08T04:02:40.598 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-08T04:02:40.599 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:02:40.599 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:40.645 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:02:40.645 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:40.729 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:02:40.730 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:40.815 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:41.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.054+0000 7f716edff700 1 Processor -- start 2023-06-08T04:02:41.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.054+0000 7f716edff700 1 -- start start 2023-06-08T04:02:41.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.055+0000 7f716edff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f71680b0940 0x7f7168069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.055+0000 7f716edff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71680af3f0 con 0x7f71680af9e0 2023-06-08T04:02:41.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.055+0000 7f716edff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71680af6d0 con 0x7f716815fb60 2023-06-08T04:02:41.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.055+0000 7f716edff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71680b0e40 con 0x7f71680b0940 2023-06-08T04:02:41.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.055+0000 7f716d39c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f71680af9e0 0x7f71680cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59890/0 (socket says 172.21.15.16:59890) 2023-06-08T04:02:41.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.055+0000 7f716d39c700 1 -- 172.21.15.16:0/4136714274 learned_addr learned my addr 172.21.15.16:0/4136714274 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.056+0000 7f7167fff700 1 --2- 172.21.15.16:0/4136714274 >> v2:172.21.15.169:3300/0 conn(0x7f71680b0940 0x7f7168069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.056+0000 7f71677fe700 1 -- 172.21.15.16:0/4136714274 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332795432 0 0) 0x7f71680af3f0 con 0x7f71680af9e0 2023-06-08T04:02:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.056+0000 7f71677fe700 1 -- 172.21.15.16:0/4136714274 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71580035b0 con 0x7f71680af9e0 2023-06-08T04:02:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.056+0000 7f7167fff700 1 -- 172.21.15.16:0/4136714274 >> v1:172.21.15.169:6789/0 conn(0x7f716815fb60 legacy=0x7f71680c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.056+0000 7f7167fff700 1 -- 172.21.15.16:0/4136714274 >> v1:172.21.15.16:6789/0 conn(0x7f71680af9e0 legacy=0x7f71680cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.056+0000 7f7167fff700 1 -- 172.21.15.16:0/4136714274 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680ce720 con 0x7f71680b0940 2023-06-08T04:02:41.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.056+0000 7f7167fff700 1 --2- 172.21.15.16:0/4136714274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71680b0940 0x7f7168069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7154009840 tx=0x7f7154009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3097a558a572ca39 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:41.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.057+0000 7f71677fe700 1 -- 172.21.15.16:0/4136714274 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7154011830 con 0x7f71680b0940 2023-06-08T04:02:41.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.057+0000 7f71677fe700 1 -- 172.21.15.16:0/4136714274 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7154011990 con 0x7f71680b0940 2023-06-08T04:02:41.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.057+0000 7f71677fe700 1 -- 172.21.15.16:0/4136714274 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7154011d20 con 0x7f71680b0940 2023-06-08T04:02:41.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.057+0000 7f716edff700 1 -- 172.21.15.16:0/4136714274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71680b0940 msgr2=0x7f7168069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.057+0000 7f716edff700 1 --2- 172.21.15.16:0/4136714274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71680b0940 0x7f7168069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7154009840 tx=0x7f7154009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:41.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.057+0000 7f716edff700 1 -- 172.21.15.16:0/4136714274 shutdown_connections 2023-06-08T04:02:41.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.057+0000 7f716edff700 1 --2- 172.21.15.16:0/4136714274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71680b0940 0x7f7168069db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.057+0000 7f716edff700 1 -- 172.21.15.16:0/4136714274 >> 172.21.15.16:0/4136714274 conn(0x7f7168098a50 msgr2=0x7f71680cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:41.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.057+0000 7f716edff700 1 -- 172.21.15.16:0/4136714274 shutdown_connections 2023-06-08T04:02:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.057+0000 7f716edff700 1 -- 172.21.15.16:0/4136714274 wait complete. 2023-06-08T04:02:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.059+0000 7f716edff700 1 Processor -- start 2023-06-08T04:02:41.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.059+0000 7f716edff700 1 -- start start 2023-06-08T04:02:41.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.060+0000 7f716edff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71680af9e0 0x7f716814f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.060+0000 7f716edff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71680b0940 0x7f71680cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.060+0000 7f716edff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f716815fb60 0x7f71680cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.060+0000 7f716edff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71680c6170 con 0x7f71680af9e0 2023-06-08T04:02:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.060+0000 7f716edff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71680c5510 con 0x7f71680b0940 2023-06-08T04:02:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.060+0000 7f716edff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71680c57d0 con 0x7f716815fb60 2023-06-08T04:02:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.060+0000 7f716cb9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71680af9e0 0x7f716814f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.060+0000 7f716cb9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71680af9e0 0x7f716814f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60226/0 (socket says 172.21.15.16:60226) 2023-06-08T04:02:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.060+0000 7f716cb9b700 1 -- 172.21.15.16:0/2319291552 learned_addr learned my addr 172.21.15.16:0/2319291552 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f7167fff700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71680b0940 0x7f71680cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f716d39c700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f716815fb60 0x7f71680cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f716cb9b700 1 -- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f716815fb60 msgr2=0x7f71680cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f716cb9b700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f716815fb60 0x7f71680cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f716cb9b700 1 -- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71680b0940 msgr2=0x7f71680cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f716cb9b700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71680b0940 0x7f71680cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f716cb9b700 1 -- 172.21.15.16:0/2319291552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71540094a0 con 0x7f71680af9e0 2023-06-08T04:02:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f716cb9b700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71680af9e0 0x7f716814f0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f715c00c4e0 tx=0x7f715c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f71657fa700 1 -- 172.21.15.16:0/2319291552 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0052d0 con 0x7f71680af9e0 2023-06-08T04:02:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f71657fa700 1 -- 172.21.15.16:0/2319291552 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c005430 con 0x7f71680af9e0 2023-06-08T04:02:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f71657fa700 1 -- 172.21.15.16:0/2319291552 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0038c0 con 0x7f71680af9e0 2023-06-08T04:02:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.061+0000 7f716edff700 1 -- 172.21.15.16:0/2319291552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71680c5ab0 con 0x7f71680af9e0 2023-06-08T04:02:41.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.062+0000 7f716edff700 1 -- 172.21.15.16:0/2319291552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71680c5190 con 0x7f71680af9e0 2023-06-08T04:02:41.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.063+0000 7f716edff700 1 -- 172.21.15.16:0/2319291552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71680b1060 con 0x7f71680af9e0 2023-06-08T04:02:41.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.064+0000 7f71657fa700 1 -- 172.21.15.16:0/2319291552 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f715c003a20 con 0x7f71680af9e0 2023-06-08T04:02:41.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.066+0000 7f71657fa700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f714c06ad10 0x7f714c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.066+0000 7f71657fa700 1 -- 172.21.15.16:0/2319291552 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f715c088820 con 0x7f71680af9e0 2023-06-08T04:02:41.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.066+0000 7f7167fff700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f714c06ad10 0x7f714c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.067+0000 7f7167fff700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f714c06ad10 0x7f714c06d1c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7154009fd0 tx=0x7f7154008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:41.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.070+0000 7f71657fa700 1 -- 172.21.15.16:0/2319291552 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f715c0538d0 con 0x7f71680af9e0 2023-06-08T04:02:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.276+0000 7f716edff700 1 -- 172.21.15.16:0/2319291552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71680740e0 con 0x7f71680af9e0 2023-06-08T04:02:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.278+0000 7f71657fa700 1 -- 172.21.15.16:0/2319291552 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7f715c056ef0 con 0x7f71680af9e0 2023-06-08T04:02:41.282 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:41.282 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.280+0000 7f716edff700 1 -- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f714c06ad10 msgr2=0x7f714c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.280+0000 7f716edff700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f714c06ad10 0x7f714c06d1c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7154009fd0 tx=0x7f7154008030 comp rx=0 tx=0).stop 2023-06-08T04:02:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.280+0000 7f716edff700 1 -- 172.21.15.16:0/2319291552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71680af9e0 msgr2=0x7f716814f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.280+0000 7f716edff700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71680af9e0 0x7f716814f0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f715c00c4e0 tx=0x7f715c00c7f0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.281+0000 7f716edff700 1 -- 172.21.15.16:0/2319291552 shutdown_connections 2023-06-08T04:02:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.281+0000 7f716edff700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f714c06ad10 0x7f714c06d1c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.281+0000 7f716edff700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f716815fb60 0x7f71680cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.281+0000 7f716edff700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71680af9e0 0x7f716814f0a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.281+0000 7f716edff700 1 --2- 172.21.15.16:0/2319291552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71680b0940 0x7f71680cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.281+0000 7f716edff700 1 -- 172.21.15.16:0/2319291552 >> 172.21.15.16:0/2319291552 conn(0x7f7168098a50 msgr2=0x7f716806e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:41.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.281+0000 7f716edff700 1 -- 172.21.15.16:0/2319291552 shutdown_connections 2023-06-08T04:02:41.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.281+0000 7f716edff700 1 -- 172.21.15.16:0/2319291552 wait complete. 2023-06-08T04:02:41.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:01:54.980592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:01:56.264608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:02:41.303 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:02:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.503+0000 7f0c40dff700 1 Processor -- start 2023-06-08T04:02:41.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.503+0000 7f0c40dff700 1 -- start start 2023-06-08T04:02:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.504+0000 7f0c40dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c3c160a60 0x7f0c3c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.504+0000 7f0c40dff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0c3c0b4b50 0x7f0c3c0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.504+0000 7f0c40dff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c0d0800 con 0x7f0c3c0b83f0 2023-06-08T04:02:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.504+0000 7f0c40dff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c160ed0 con 0x7f0c3c0b4b50 2023-06-08T04:02:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.504+0000 7f0c40dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0b4fd0 con 0x7f0c3c160a60 2023-06-08T04:02:41.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.504+0000 7f0c3ad9d700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0c3c0b4b50 0x7f0c3c0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.504+0000 7f0c33fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c3c160a60 0x7f0c3c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.504+0000 7f0c3ad9d700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0c3c0b4b50 0x7f0c3c0d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:34940/0 (socket says 172.21.15.16:34940) 2023-06-08T04:02:41.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.504+0000 7f0c3ad9d700 1 -- 172.21.15.16:0/3784646800 learned_addr learned my addr 172.21.15.16:0/3784646800 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:41.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.505+0000 7f0c33fff700 1 -- 172.21.15.16:0/3784646800 >> v2:172.21.15.169:3300/0 conn(0x7f0c3c0b4b50 msgr2=0x7f0c3c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:41.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.505+0000 7f0c33fff700 1 --2- 172.21.15.16:0/3784646800 >> v2:172.21.15.169:3300/0 conn(0x7f0c3c0b4b50 0x7f0c3c0d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.505+0000 7f0c33fff700 1 -- 172.21.15.16:0/3784646800 >> v1:172.21.15.169:6789/0 conn(0x7f0c3c0b83f0 legacy=0x7f0c3c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.505+0000 7f0c33fff700 1 -- 172.21.15.16:0/3784646800 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0cd1e0 con 0x7f0c3c160a60 2023-06-08T04:02:41.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.505+0000 7f0c33fff700 1 --2- 172.21.15.16:0/3784646800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c3c160a60 0x7f0c3c0b4610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009840 tx=0x7f0c24009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb4fefb40cee2df server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:41.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.505+0000 7f0c39d9b700 1 -- 172.21.15.16:0/3784646800 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24011830 con 0x7f0c3c160a60 2023-06-08T04:02:41.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.506+0000 7f0c39d9b700 1 -- 172.21.15.16:0/3784646800 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c24011990 con 0x7f0c3c160a60 2023-06-08T04:02:41.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.506+0000 7f0c39d9b700 1 -- 172.21.15.16:0/3784646800 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24011d20 con 0x7f0c3c160a60 2023-06-08T04:02:41.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.506+0000 7f0c40dff700 1 -- 172.21.15.16:0/3784646800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c3c160a60 msgr2=0x7f0c3c0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.506+0000 7f0c40dff700 1 --2- 172.21.15.16:0/3784646800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c3c160a60 0x7f0c3c0b4610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c24009840 tx=0x7f0c24009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:41.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.506+0000 7f0c40dff700 1 -- 172.21.15.16:0/3784646800 shutdown_connections 2023-06-08T04:02:41.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.506+0000 7f0c40dff700 1 --2- 172.21.15.16:0/3784646800 >> v2:172.21.15.169:3300/0 conn(0x7f0c3c0b4b50 0x7f0c3c0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.506+0000 7f0c40dff700 1 --2- 172.21.15.16:0/3784646800 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c3c160a60 0x7f0c3c0b4610 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.506+0000 7f0c40dff700 1 -- 172.21.15.16:0/3784646800 >> 172.21.15.16:0/3784646800 conn(0x7f0c3c0cf610 msgr2=0x7f0c3c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:41.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.506+0000 7f0c40dff700 1 -- 172.21.15.16:0/3784646800 shutdown_connections 2023-06-08T04:02:41.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.506+0000 7f0c40dff700 1 -- 172.21.15.16:0/3784646800 wait complete. 2023-06-08T04:02:41.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.509+0000 7f0c40dff700 1 Processor -- start 2023-06-08T04:02:41.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.509+0000 7f0c40dff700 1 -- start start 2023-06-08T04:02:41.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.510+0000 7f0c40dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c3c0b4b50 0x7f0c3c15e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.510+0000 7f0c40dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c3c0b83f0 0x7f0c3c1510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.510+0000 7f0c40dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3c160a60 0x7f0c3c0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.510+0000 7f0c40dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c15e880 con 0x7f0c3c160a60 2023-06-08T04:02:41.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.510+0000 7f0c40dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c1515e0 con 0x7f0c3c0b83f0 2023-06-08T04:02:41.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.510+0000 7f0c40dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c15eb20 con 0x7f0c3c0b4b50 2023-06-08T04:02:41.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.510+0000 7f0c3ad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3c160a60 0x7f0c3c0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.510+0000 7f0c3ad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3c160a60 0x7f0c3c0b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60230/0 (socket says 172.21.15.16:60230) 2023-06-08T04:02:41.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.510+0000 7f0c3ad9d700 1 -- 172.21.15.16:0/1473131256 learned_addr learned my addr 172.21.15.16:0/1473131256 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:41.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.510+0000 7f0c3a59c700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c3c0b4b50 0x7f0c3c15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.510+0000 7f0c33fff700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c3c0b83f0 0x7f0c3c1510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.516 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.511+0000 7f0c3ad9d700 1 -- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c3c0b4b50 msgr2=0x7f0c3c15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.511+0000 7f0c3ad9d700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c3c0b4b50 0x7f0c3c15e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.511+0000 7f0c3ad9d700 1 -- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c3c0b83f0 msgr2=0x7f0c3c1510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.511+0000 7f0c3ad9d700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c3c0b83f0 0x7f0c3c1510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.511+0000 7f0c3ad9d700 1 -- 172.21.15.16:0/1473131256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240094a0 con 0x7f0c3c160a60 2023-06-08T04:02:41.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.511+0000 7f0c3ad9d700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3c160a60 0x7f0c3c0b59c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400efc0 tx=0x7f0c3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:41.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.511+0000 7f0c32ffd700 1 -- 172.21.15.16:0/1473131256 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34003c20 con 0x7f0c3c160a60 2023-06-08T04:02:41.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.511+0000 7f0c32ffd700 1 -- 172.21.15.16:0/1473131256 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3400f040 con 0x7f0c3c160a60 2023-06-08T04:02:41.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.511+0000 7f0c40dff700 1 -- 172.21.15.16:0/1473131256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c15ee00 con 0x7f0c3c160a60 2023-06-08T04:02:41.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.511+0000 7f0c32ffd700 1 -- 172.21.15.16:0/1473131256 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34009e60 con 0x7f0c3c160a60 2023-06-08T04:02:41.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.512+0000 7f0c40dff700 1 -- 172.21.15.16:0/1473131256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c15f3c0 con 0x7f0c3c160a60 2023-06-08T04:02:41.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.513+0000 7f0c40dff700 1 -- 172.21.15.16:0/1473131256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c0740e0 con 0x7f0c3c160a60 2023-06-08T04:02:41.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.513+0000 7f0c32ffd700 1 -- 172.21.15.16:0/1473131256 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c3400c880 con 0x7f0c3c160a60 2023-06-08T04:02:41.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.514+0000 7f0c32ffd700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0c1c06ad10 0x7f0c1c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.514+0000 7f0c32ffd700 1 -- 172.21.15.16:0/1473131256 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c340897b0 con 0x7f0c3c160a60 2023-06-08T04:02:41.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.515+0000 7f0c3a59c700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0c1c06ad10 0x7f0c1c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.515+0000 7f0c3a59c700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0c1c06ad10 0x7f0c1c06d1c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c007fd0 tx=0x7f0c2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:41.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.519+0000 7f0c32ffd700 1 -- 172.21.15.16:0/1473131256 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0c340547d0 con 0x7f0c3c160a60 2023-06-08T04:02:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.724+0000 7f0c40dff700 1 -- 172.21.15.16:0/1473131256 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0c3c15c280 con 0x7f0c3c160a60 2023-06-08T04:02:41.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.724+0000 7f0c32ffd700 1 -- 172.21.15.16:0/1473131256 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0c34057df0 con 0x7f0c3c160a60 2023-06-08T04:02:41.728 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:02:41.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 -- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0c1c06ad10 msgr2=0x7f0c1c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0c1c06ad10 0x7f0c1c06d1c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c007fd0 tx=0x7f0c2c009040 comp rx=0 tx=0).stop 2023-06-08T04:02:41.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 -- 172.21.15.16:0/1473131256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3c160a60 msgr2=0x7f0c3c0b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3c160a60 0x7f0c3c0b59c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400efc0 tx=0x7f0c3400c3a0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 -- 172.21.15.16:0/1473131256 shutdown_connections 2023-06-08T04:02:41.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0c1c06ad10 0x7f0c1c06d1c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c3c160a60 0x7f0c3c0b59c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c3c0b4b50 0x7f0c3c15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 --2- 172.21.15.16:0/1473131256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c3c0b83f0 0x7f0c3c1510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 -- 172.21.15.16:0/1473131256 >> 172.21.15.16:0/1473131256 conn(0x7f0c3c0cf610 msgr2=0x7f0c3c0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:41.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 -- 172.21.15.16:0/1473131256 shutdown_connections 2023-06-08T04:02:41.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.726+0000 7f0c40dff700 1 -- 172.21.15.16:0/1473131256 wait complete. 2023-06-08T04:02:41.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:02:41.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.949+0000 7fd02a7ff700 1 Processor -- start 2023-06-08T04:02:41.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.950+0000 7fd02a7ff700 1 -- start start 2023-06-08T04:02:41.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.951+0000 7fd02a7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd02415a770 0x7fd0240ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.951+0000 7fd02a7ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd024070c90 con 0x7fd02415ab40 2023-06-08T04:02:41.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.951+0000 7fd02a7ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0240c9110 con 0x7fd024161d10 2023-06-08T04:02:41.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.951+0000 7fd02a7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240ce620 con 0x7fd02415a770 2023-06-08T04:02:41.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.951+0000 7fd01bfff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd02415ab40 0x7fd02415afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59898/0 (socket says 172.21.15.16:59898) 2023-06-08T04:02:41.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.951+0000 7fd01bfff700 1 -- 172.21.15.16:0/1626442976 learned_addr learned my addr 172.21.15.16:0/1626442976 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:41.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.951+0000 7fd023fff700 1 --2- 172.21.15.16:0/1626442976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd02415a770 0x7fd0240ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.952+0000 7fd0237fe700 1 -- 172.21.15.16:0/1626442976 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129504483 0 0) 0x7fd024070c90 con 0x7fd02415ab40 2023-06-08T04:02:41.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.952+0000 7fd0237fe700 1 -- 172.21.15.16:0/1626442976 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0100035b0 con 0x7fd02415ab40 2023-06-08T04:02:41.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.952+0000 7fd0237fe700 1 -- 172.21.15.16:0/1626442976 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313030966 0 0) 0x7fd0240c9110 con 0x7fd024161d10 2023-06-08T04:02:41.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.952+0000 7fd0237fe700 1 -- 172.21.15.16:0/1626442976 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd024070c90 con 0x7fd024161d10 2023-06-08T04:02:41.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.952+0000 7fd023fff700 1 -- 172.21.15.16:0/1626442976 >> v1:172.21.15.169:6789/0 conn(0x7fd024161d10 legacy=0x7fd0241640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.952+0000 7fd023fff700 1 -- 172.21.15.16:0/1626442976 >> v1:172.21.15.16:6789/0 conn(0x7fd02415ab40 legacy=0x7fd02415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.952+0000 7fd023fff700 1 -- 172.21.15.16:0/1626442976 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd024070ee0 con 0x7fd02415a770 2023-06-08T04:02:41.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.952+0000 7fd023fff700 1 --2- 172.21.15.16:0/1626442976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd02415a770 0x7fd0240ce0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd014009870 tx=0x7fd014009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10038019eb90a798 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:41.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.952+0000 7fd0237fe700 1 -- 172.21.15.16:0/1626442976 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014011830 con 0x7fd02415a770 2023-06-08T04:02:41.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.953+0000 7fd0237fe700 1 -- 172.21.15.16:0/1626442976 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd014011990 con 0x7fd02415a770 2023-06-08T04:02:41.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.953+0000 7fd0237fe700 1 -- 172.21.15.16:0/1626442976 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014011d20 con 0x7fd02415a770 2023-06-08T04:02:41.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.953+0000 7fd02a7ff700 1 -- 172.21.15.16:0/1626442976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd02415a770 msgr2=0x7fd0240ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.953+0000 7fd02a7ff700 1 --2- 172.21.15.16:0/1626442976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd02415a770 0x7fd0240ce0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd014009870 tx=0x7fd014009b80 comp rx=0 tx=0).stop 2023-06-08T04:02:41.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.953+0000 7fd02a7ff700 1 -- 172.21.15.16:0/1626442976 shutdown_connections 2023-06-08T04:02:41.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.953+0000 7fd02a7ff700 1 --2- 172.21.15.16:0/1626442976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd02415a770 0x7fd0240ce0e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.953+0000 7fd02a7ff700 1 -- 172.21.15.16:0/1626442976 >> 172.21.15.16:0/1626442976 conn(0x7fd02406aa40 msgr2=0x7fd0240b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:41.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.953+0000 7fd02a7ff700 1 -- 172.21.15.16:0/1626442976 shutdown_connections 2023-06-08T04:02:41.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.953+0000 7fd02a7ff700 1 -- 172.21.15.16:0/1626442976 wait complete. 2023-06-08T04:02:41.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.955+0000 7fd02a7ff700 1 Processor -- start 2023-06-08T04:02:41.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.955+0000 7fd02a7ff700 1 -- start start 2023-06-08T04:02:41.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.956+0000 7fd02a7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd02415a770 0x7fd024145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.956+0000 7fd02a7ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd02415ab40 0x7fd024144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.956+0000 7fd02a7ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd024161d10 0x7fd02414e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.956+0000 7fd02a7ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02406c0e0 con 0x7fd024161d10 2023-06-08T04:02:41.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.956+0000 7fd02a7ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024159fa0 con 0x7fd02415ab40 2023-06-08T04:02:41.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.956+0000 7fd02a7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd024145dd0 con 0x7fd02415a770 2023-06-08T04:02:41.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.956+0000 7fd028d9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd024161d10 0x7fd02414e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.956+0000 7fd028d9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd024161d10 0x7fd02414e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60236/0 (socket says 172.21.15.16:60236) 2023-06-08T04:02:41.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.956+0000 7fd028d9c700 1 -- 172.21.15.16:0/4156118785 learned_addr learned my addr 172.21.15.16:0/4156118785 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:41.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.956+0000 7fd023fff700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd02415a770 0x7fd024145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.956+0000 7fd01bfff700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd02415ab40 0x7fd024144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.957+0000 7fd028d9c700 1 -- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd02415a770 msgr2=0x7fd024145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.957+0000 7fd028d9c700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd02415a770 0x7fd024145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.957+0000 7fd028d9c700 1 -- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd02415ab40 msgr2=0x7fd024144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:41.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.957+0000 7fd028d9c700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd02415ab40 0x7fd024144d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:41.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.957+0000 7fd028d9c700 1 -- 172.21.15.16:0/4156118785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0140094a0 con 0x7fd024161d10 2023-06-08T04:02:41.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.957+0000 7fd028d9c700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd024161d10 0x7fd02414e610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00cc80 tx=0x7fd01c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:41.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.957+0000 7fd0217fa700 1 -- 172.21.15.16:0/4156118785 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c003c00 con 0x7fd024161d10 2023-06-08T04:02:41.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.957+0000 7fd0217fa700 1 -- 172.21.15.16:0/4156118785 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c003d60 con 0x7fd024161d10 2023-06-08T04:02:41.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.957+0000 7fd02a7ff700 1 -- 172.21.15.16:0/4156118785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0241452d0 con 0x7fd024161d10 2023-06-08T04:02:41.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.957+0000 7fd0217fa700 1 -- 172.21.15.16:0/4156118785 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00aaa0 con 0x7fd024161d10 2023-06-08T04:02:41.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.957+0000 7fd02a7ff700 1 -- 172.21.15.16:0/4156118785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02406dc30 con 0x7fd024161d10 2023-06-08T04:02:41.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.958+0000 7fd02a7ff700 1 -- 172.21.15.16:0/4156118785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02406c220 con 0x7fd024161d10 2023-06-08T04:02:41.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.959+0000 7fd0217fa700 1 -- 172.21.15.16:0/4156118785 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd01c00ac00 con 0x7fd024161d10 2023-06-08T04:02:41.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.960+0000 7fd0217fa700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd00406ace0 0x7fd00406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:41.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.961+0000 7fd0217fa700 1 -- 172.21.15.16:0/4156118785 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd01c089480 con 0x7fd024161d10 2023-06-08T04:02:41.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.961+0000 7fd023fff700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd00406ace0 0x7fd00406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:41.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.962+0000 7fd023fff700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd00406ace0 0x7fd00406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd0140097c0 tx=0x7fd01401c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:41.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:41.965+0000 7fd0217fa700 1 -- 172.21.15.16:0/4156118785 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd02406c220 con 0x7fd024161d10 2023-06-08T04:02:42.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.170+0000 7fd02a7ff700 1 -- 172.21.15.16:0/4156118785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd02406c220 con 0x7fd024161d10 2023-06-08T04:02:42.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.170+0000 7fd0217fa700 1 -- 172.21.15.16:0/4156118785 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd02406c220 con 0x7fd024161d10 2023-06-08T04:02:42.174 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:02:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 -- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd00406ace0 msgr2=0x7fd00406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd00406ace0 0x7fd00406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd0140097c0 tx=0x7fd01401c040 comp rx=0 tx=0).stop 2023-06-08T04:02:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 -- 172.21.15.16:0/4156118785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd024161d10 msgr2=0x7fd02414e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd024161d10 0x7fd02414e610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00cc80 tx=0x7fd01c00cf90 comp rx=0 tx=0).stop 2023-06-08T04:02:42.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 -- 172.21.15.16:0/4156118785 shutdown_connections 2023-06-08T04:02:42.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd00406ace0 0x7fd00406d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd024161d10 0x7fd02414e610 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd02415a770 0x7fd024145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 --2- 172.21.15.16:0/4156118785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd02415ab40 0x7fd024144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 -- 172.21.15.16:0/4156118785 >> 172.21.15.16:0/4156118785 conn(0x7fd02406aa40 msgr2=0x7fd024152870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:42.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 -- 172.21.15.16:0/4156118785 shutdown_connections 2023-06-08T04:02:42.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.173+0000 7fd02a7ff700 1 -- 172.21.15.16:0/4156118785 wait complete. 2023-06-08T04:02:42.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:02:42.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.395+0000 7f9f7e7ff700 1 Processor -- start 2023-06-08T04:02:42.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.396+0000 7f9f7e7ff700 1 -- start start 2023-06-08T04:02:42.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.397+0000 7f9f7e7ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9f780b83f0 0x7f9f78160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.397+0000 7f9f7e7ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780d0800 con 0x7f9f780ced40 2023-06-08T04:02:42.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.397+0000 7f9f7e7ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780cd1e0 con 0x7f9f780b4d20 2023-06-08T04:02:42.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.397+0000 7f9f7e7ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f780cd4c0 con 0x7f9f780b83f0 2023-06-08T04:02:42.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.397+0000 7f9f777fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9f780ced40 0x7f9f780b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34342/0 (socket says 172.21.15.16:34342) 2023-06-08T04:02:42.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.397+0000 7f9f777fe700 1 -- 172.21.15.16:0/1804499248 learned_addr learned my addr 172.21.15.16:0/1804499248 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:42.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.397+0000 7f9f77fff700 1 --2- 172.21.15.16:0/1804499248 >> v2:172.21.15.169:3300/0 conn(0x7f9f780b83f0 0x7f9f78160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238646324 0 0) 0x7f9f780d0800 con 0x7f9f780ced40 2023-06-08T04:02:42.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f600035b0 con 0x7f9f780ced40 2023-06-08T04:02:42.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712751135 0 0) 0x7f9f780cd1e0 con 0x7f9f780b4d20 2023-06-08T04:02:42.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f780d0800 con 0x7f9f780b4d20 2023-06-08T04:02:42.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3527406477 0 0) 0x7f9f600035b0 con 0x7f9f780ced40 2023-06-08T04:02:42.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 >> v2:172.21.15.169:3300/0 conn(0x7f9f780b83f0 msgr2=0x7f9f78160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:42.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 --2- 172.21.15.16:0/1804499248 >> v2:172.21.15.169:3300/0 conn(0x7f9f780b83f0 0x7f9f78160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 >> v1:172.21.15.169:6789/0 conn(0x7f9f780b4d20 legacy=0x7f9f780d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780d0aa0 con 0x7f9f780ced40 2023-06-08T04:02:42.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7f9f6c001670 con 0x7f9f780ced40 2023-06-08T04:02:42.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 >> v1:172.21.15.16:6789/0 conn(0x7f9f780ced40 legacy=0x7f9f780b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 --2- 172.21.15.16:0/1804499248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f60003be0 0x7f9f60003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 --2- 172.21.15.16:0/1804499248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f60004850 0x7f9f60004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 --2- 172.21.15.16:0/1804499248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f60005250 0x7f9f6000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780cd4c0 con 0x7f9f60003be0 2023-06-08T04:02:42.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6000c160 con 0x7f9f60004850 2023-06-08T04:02:42.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6000c320 con 0x7f9f60005250 2023-06-08T04:02:42.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f77fff700 1 --2- 172.21.15.16:0/1804499248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f60003be0 0x7f9f60003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.398+0000 7f9f777fe700 1 --2- 172.21.15.16:0/1804499248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f60004850 0x7f9f60004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.399+0000 7f9f7cd9c700 1 --2- 172.21.15.16:0/1804499248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f60005250 0x7f9f6000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.399+0000 7f9f77fff700 1 -- 172.21.15.16:0/1804499248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f60005250 msgr2=0x7f9f6000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:42.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.399+0000 7f9f77fff700 1 --2- 172.21.15.16:0/1804499248 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f60005250 0x7f9f6000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.399+0000 7f9f77fff700 1 -- 172.21.15.16:0/1804499248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f60004850 msgr2=0x7f9f60004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:42.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.399+0000 7f9f77fff700 1 --2- 172.21.15.16:0/1804499248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f60004850 0x7f9f60004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.399+0000 7f9f77fff700 1 -- 172.21.15.16:0/1804499248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f600035b0 con 0x7f9f60003be0 2023-06-08T04:02:42.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.399+0000 7f9f7cd9c700 1 -- 172.21.15.16:0/1804499248 reap_dead start 2023-06-08T04:02:42.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.399+0000 7f9f77fff700 1 --2- 172.21.15.16:0/1804499248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f60003be0 0x7f9f60003fd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009b30 tx=0x7f9f60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b998e207e1de39e1 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:42.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.399+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800e6c0 con 0x7f9f60003be0 2023-06-08T04:02:42.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.399+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6800e820 con 0x7f9f60003be0 2023-06-08T04:02:42.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.399+0000 7f9f76ffd700 1 -- 172.21.15.16:0/1804499248 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800eb90 con 0x7f9f60003be0 2023-06-08T04:02:42.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.400+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/1804499248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f60003be0 msgr2=0x7f9f60003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.400+0000 7f9f7e7ff700 1 --2- 172.21.15.16:0/1804499248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f60003be0 0x7f9f60003fd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009b30 tx=0x7f9f60005880 comp rx=0 tx=0).stop 2023-06-08T04:02:42.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.400+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/1804499248 shutdown_connections 2023-06-08T04:02:42.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.400+0000 7f9f7e7ff700 1 --2- 172.21.15.16:0/1804499248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f60003be0 0x7f9f60003fd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.400+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/1804499248 >> 172.21.15.16:0/1804499248 conn(0x7f9f780cf610 msgr2=0x7f9f780cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:42.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.400+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/1804499248 shutdown_connections 2023-06-08T04:02:42.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.400+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/1804499248 wait complete. 2023-06-08T04:02:42.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.402+0000 7f9f7e7ff700 1 Processor -- start 2023-06-08T04:02:42.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.403+0000 7f9f7e7ff700 1 -- start start 2023-06-08T04:02:42.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.404+0000 7f9f7e7ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f60003be0 0x7f9f78152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.404+0000 7f9f7e7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f7815e9c0 0x7f9f781512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.404+0000 7f9f7e7ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f781597d0 0x7f9f78159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.404+0000 7f9f7e7ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7815a180 con 0x7f9f781597d0 2023-06-08T04:02:42.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.404+0000 7f9f7e7ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f78153930 con 0x7f9f60003be0 2023-06-08T04:02:42.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.404+0000 7f9f7e7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f781517e0 con 0x7f9f7815e9c0 2023-06-08T04:02:42.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.404+0000 7f9f7cd9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f781597d0 0x7f9f78159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.404+0000 7f9f7cd9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f781597d0 0x7f9f78159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45176/0 (socket says 172.21.15.16:45176) 2023-06-08T04:02:42.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.404+0000 7f9f7cd9c700 1 -- 172.21.15.16:0/2385945951 learned_addr learned my addr 172.21.15.16:0/2385945951 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:42.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.404+0000 7f9f77fff700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f60003be0 0x7f9f78152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.404+0000 7f9f777fe700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f7815e9c0 0x7f9f781512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.405+0000 7f9f7cd9c700 1 -- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f7815e9c0 msgr2=0x7f9f781512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.405+0000 7f9f7cd9c700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f7815e9c0 0x7f9f781512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.405+0000 7f9f7cd9c700 1 -- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f60003be0 msgr2=0x7f9f78152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.405+0000 7f9f7cd9c700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f60003be0 0x7f9f78152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.405+0000 7f9f7cd9c700 1 -- 172.21.15.16:0/2385945951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f78152d20 con 0x7f9f781597d0 2023-06-08T04:02:42.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.405+0000 7f9f7cd9c700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f781597d0 0x7f9f78159c40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9f780b8d00 tx=0x7f9f7000c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:42.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.405+0000 7f9f74ff9700 1 -- 172.21.15.16:0/2385945951 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70003c10 con 0x7f9f781597d0 2023-06-08T04:02:42.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.405+0000 7f9f74ff9700 1 -- 172.21.15.16:0/2385945951 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f70003d90 con 0x7f9f781597d0 2023-06-08T04:02:42.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.405+0000 7f9f74ff9700 1 -- 172.21.15.16:0/2385945951 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000c9a0 con 0x7f9f781597d0 2023-06-08T04:02:42.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.405+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/2385945951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f78153000 con 0x7f9f781597d0 2023-06-08T04:02:42.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.405+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/2385945951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f781535c0 con 0x7f9f781597d0 2023-06-08T04:02:42.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.406+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/2385945951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f780740e0 con 0x7f9f781597d0 2023-06-08T04:02:42.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.407+0000 7f9f74ff9700 1 -- 172.21.15.16:0/2385945951 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f7000cb00 con 0x7f9f781597d0 2023-06-08T04:02:42.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.408+0000 7f9f74ff9700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9f6406ace0 0x7f9f6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.408+0000 7f9f74ff9700 1 -- 172.21.15.16:0/2385945951 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f70089610 con 0x7f9f781597d0 2023-06-08T04:02:42.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.409+0000 7f9f77fff700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9f6406ace0 0x7f9f6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.410+0000 7f9f77fff700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9f6406ace0 0x7f9f6406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9f680090b0 tx=0x7f9f68008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:42.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.413+0000 7f9f74ff9700 1 -- 172.21.15.16:0/2385945951 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9f700546b0 con 0x7f9f781597d0 2023-06-08T04:02:42.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.616+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/2385945951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f7815b960 con 0x7f9f781597d0 2023-06-08T04:02:42.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.617+0000 7f9f74ff9700 1 -- 172.21.15.16:0/2385945951 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f70057cd0 con 0x7f9f781597d0 2023-06-08T04:02:42.621 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:02:42.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9f6406ace0 msgr2=0x7f9f6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9f6406ace0 0x7f9f6406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9f680090b0 tx=0x7f9f68008030 comp rx=0 tx=0).stop 2023-06-08T04:02:42.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/2385945951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f781597d0 msgr2=0x7f9f78159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f781597d0 0x7f9f78159c40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9f780b8d00 tx=0x7f9f7000c0e0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/2385945951 shutdown_connections 2023-06-08T04:02:42.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f9f6406ace0 0x7f9f6406d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f781597d0 0x7f9f78159c40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f60003be0 0x7f9f78152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 --2- 172.21.15.16:0/2385945951 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f7815e9c0 0x7f9f781512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/2385945951 >> 172.21.15.16:0/2385945951 conn(0x7f9f780cf610 msgr2=0x7f9f780b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:42.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/2385945951 shutdown_connections 2023-06-08T04:02:42.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.619+0000 7f9f7e7ff700 1 -- 172.21.15.16:0/2385945951 wait complete. 2023-06-08T04:02:42.641 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:02:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.842+0000 7fb84a5ff700 1 Processor -- start 2023-06-08T04:02:42.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.842+0000 7fb84a5ff700 1 -- start start 2023-06-08T04:02:42.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.843+0000 7fb84a5ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb84415b250 0x7fb8440ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.843+0000 7fb84a5ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb844070c90 con 0x7fb844161d10 2023-06-08T04:02:42.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.843+0000 7fb84a5ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8440c9110 con 0x7fb84415a770 2023-06-08T04:02:42.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.843+0000 7fb84a5ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8440ce620 con 0x7fb84415b250 2023-06-08T04:02:42.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.844+0000 7fb8437fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb84415b250 0x7fb8440ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.844+0000 7fb848b9c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb844161d10 0x7fb8441640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34346/0 (socket says 172.21.15.16:34346) 2023-06-08T04:02:42.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.844+0000 7fb8437fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb84415b250 0x7fb8440ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45186/0 (socket says 172.21.15.16:45186) 2023-06-08T04:02:42.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.844+0000 7fb848b9c700 1 -- 172.21.15.16:0/3175038842 learned_addr learned my addr 172.21.15.16:0/3175038842 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:42.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.844+0000 7fb842ffd700 1 -- 172.21.15.16:0/3175038842 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801107065 0 0) 0x7fb844070c90 con 0x7fb844161d10 2023-06-08T04:02:42.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.844+0000 7fb8437fe700 1 -- 172.21.15.16:0/3175038842 >> v1:172.21.15.169:6789/0 conn(0x7fb84415a770 legacy=0x7fb84415ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.844+0000 7fb8437fe700 1 -- 172.21.15.16:0/3175038842 >> v1:172.21.15.16:6789/0 conn(0x7fb844161d10 legacy=0x7fb8441640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.844+0000 7fb8437fe700 1 -- 172.21.15.16:0/3175038842 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb844070ee0 con 0x7fb84415b250 2023-06-08T04:02:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.844+0000 7fb8437fe700 1 --2- 172.21.15.16:0/3175038842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb84415b250 0x7fb8440ce0e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb838009840 tx=0x7fb838009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d22c5649711d8dd server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.845+0000 7fb842ffd700 1 -- 172.21.15.16:0/3175038842 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838011830 con 0x7fb84415b250 2023-06-08T04:02:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.845+0000 7fb842ffd700 1 -- 172.21.15.16:0/3175038842 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838011990 con 0x7fb84415b250 2023-06-08T04:02:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.845+0000 7fb842ffd700 1 -- 172.21.15.16:0/3175038842 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838011d20 con 0x7fb84415b250 2023-06-08T04:02:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.845+0000 7fb84a5ff700 1 -- 172.21.15.16:0/3175038842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb84415b250 msgr2=0x7fb8440ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.845+0000 7fb84a5ff700 1 --2- 172.21.15.16:0/3175038842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb84415b250 0x7fb8440ce0e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb838009840 tx=0x7fb838009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:42.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.845+0000 7fb84a5ff700 1 -- 172.21.15.16:0/3175038842 shutdown_connections 2023-06-08T04:02:42.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.845+0000 7fb84a5ff700 1 --2- 172.21.15.16:0/3175038842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb84415b250 0x7fb8440ce0e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.845+0000 7fb84a5ff700 1 -- 172.21.15.16:0/3175038842 >> 172.21.15.16:0/3175038842 conn(0x7fb84406aa40 msgr2=0x7fb8440b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:42.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.845+0000 7fb84a5ff700 1 -- 172.21.15.16:0/3175038842 shutdown_connections 2023-06-08T04:02:42.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.845+0000 7fb84a5ff700 1 -- 172.21.15.16:0/3175038842 wait complete. 2023-06-08T04:02:42.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.847+0000 7fb84a5ff700 1 Processor -- start 2023-06-08T04:02:42.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.847+0000 7fb84a5ff700 1 -- start start 2023-06-08T04:02:42.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.848+0000 7fb84a5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb84415a770 0x7fb84415d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.848+0000 7fb84a5ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb84415b250 0x7fb844147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.848+0000 7fb84a5ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb844161d10 0x7fb84415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.848+0000 7fb84a5ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440c6270 con 0x7fb84415b250 2023-06-08T04:02:42.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.848+0000 7fb84a5ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84414f3a0 con 0x7fb844161d10 2023-06-08T04:02:42.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.848+0000 7fb84a5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84415bca0 con 0x7fb84415a770 2023-06-08T04:02:42.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.849+0000 7fb8437fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb84415b250 0x7fb844147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.849+0000 7fb8437fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb84415b250 0x7fb844147750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45196/0 (socket says 172.21.15.16:45196) 2023-06-08T04:02:42.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.849+0000 7fb8437fe700 1 -- 172.21.15.16:0/4145440431 learned_addr learned my addr 172.21.15.16:0/4145440431 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:42.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.849+0000 7fb848b9c700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb844161d10 0x7fb84415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.849+0000 7fb843fff700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb84415a770 0x7fb84415d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.849+0000 7fb8437fe700 1 -- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb84415a770 msgr2=0x7fb84415d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.849+0000 7fb8437fe700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb84415a770 0x7fb84415d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.849+0000 7fb8437fe700 1 -- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb844161d10 msgr2=0x7fb84415b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:42.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.849+0000 7fb8437fe700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb844161d10 0x7fb84415b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:42.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.849+0000 7fb8437fe700 1 -- 172.21.15.16:0/4145440431 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8380094a0 con 0x7fb84415b250 2023-06-08T04:02:42.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.849+0000 7fb8437fe700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb84415b250 0x7fb844147750 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb8380090b0 tx=0x7fb838004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:42.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.850+0000 7fb840ff9700 1 -- 172.21.15.16:0/4145440431 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83801a980 con 0x7fb84415b250 2023-06-08T04:02:42.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.850+0000 7fb840ff9700 1 -- 172.21.15.16:0/4145440431 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83801ab00 con 0x7fb84415b250 2023-06-08T04:02:42.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.850+0000 7fb840ff9700 1 -- 172.21.15.16:0/4145440431 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838024420 con 0x7fb84415b250 2023-06-08T04:02:42.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.850+0000 7fb84a5ff700 1 -- 172.21.15.16:0/4145440431 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84415bf40 con 0x7fb84415b250 2023-06-08T04:02:42.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.850+0000 7fb84a5ff700 1 -- 172.21.15.16:0/4145440431 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84415c500 con 0x7fb84415b250 2023-06-08T04:02:42.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.851+0000 7fb84a5ff700 1 -- 172.21.15.16:0/4145440431 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8440cd690 con 0x7fb84415b250 2023-06-08T04:02:42.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.852+0000 7fb840ff9700 1 -- 172.21.15.16:0/4145440431 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb838022070 con 0x7fb84415b250 2023-06-08T04:02:42.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.853+0000 7fb840ff9700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb83006ace0 0x7fb83006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:42.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.853+0000 7fb840ff9700 1 -- 172.21.15.16:0/4145440431 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb83808a8c0 con 0x7fb84415b250 2023-06-08T04:02:42.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.853+0000 7fb843fff700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb83006ace0 0x7fb83006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:42.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.854+0000 7fb843fff700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb83006ace0 0x7fb83006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb844151750 tx=0x7fb834009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:42.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:42.857+0000 7fb840ff9700 1 -- 172.21.15.16:0/4145440431 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb838055960 con 0x7fb84415b250 2023-06-08T04:02:43.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.063+0000 7fb84a5ff700 1 -- 172.21.15.16:0/4145440431 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8440740e0 con 0x7fb84415b250 2023-06-08T04:02:43.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.063+0000 7fb840ff9700 1 -- 172.21.15.16:0/4145440431 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8380290a0 con 0x7fb84415b250 2023-06-08T04:02:43.069 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:02:43.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 -- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb83006ace0 msgr2=0x7fb83006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:43.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb83006ace0 0x7fb83006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb844151750 tx=0x7fb834009040 comp rx=0 tx=0).stop 2023-06-08T04:02:43.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 -- 172.21.15.16:0/4145440431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb84415b250 msgr2=0x7fb844147750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:43.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb84415b250 0x7fb844147750 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb8380090b0 tx=0x7fb838004750 comp rx=0 tx=0).stop 2023-06-08T04:02:43.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 -- 172.21.15.16:0/4145440431 shutdown_connections 2023-06-08T04:02:43.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb83006ace0 0x7fb83006d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb844161d10 0x7fb84415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb84415a770 0x7fb84415d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 --2- 172.21.15.16:0/4145440431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb84415b250 0x7fb844147750 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 -- 172.21.15.16:0/4145440431 >> 172.21.15.16:0/4145440431 conn(0x7fb84406aa40 msgr2=0x7fb844159a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:43.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 -- 172.21.15.16:0/4145440431 shutdown_connections 2023-06-08T04:02:43.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.066+0000 7fb84a5ff700 1 -- 172.21.15.16:0/4145440431 wait complete. 2023-06-08T04:02:43.089 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T04:02:43.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.285+0000 7f4708fff700 1 Processor -- start 2023-06-08T04:02:43.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.285+0000 7f4708fff700 1 -- start start 2023-06-08T04:02:43.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.286+0000 7f4708fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4704158860 0x7f4704070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:43.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.286+0000 7f4708fff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f47040ccca0 0x7f470406c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:43.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.286+0000 7f4708fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f470406cc40 0x7f47040c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.286+0000 7f4708fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4704158c30 con 0x7f470406cc40 2023-06-08T04:02:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.286+0000 7f4708fff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47040c98d0 con 0x7f47040ccca0 2023-06-08T04:02:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.286+0000 7f4708fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47040cd1d0 con 0x7f4704158860 2023-06-08T04:02:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.287+0000 7f4702d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f470406cc40 0x7f47040c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:43.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.287+0000 7f4702d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f470406cc40 0x7f47040c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45206/0 (socket says 172.21.15.16:45206) 2023-06-08T04:02:43.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.287+0000 7f4702d9d700 1 -- 172.21.15.16:0/3775228254 learned_addr learned my addr 172.21.15.16:0/3775228254 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:43.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.287+0000 7f4701d9b700 1 --2- 172.21.15.16:0/3775228254 >> v2:172.21.15.169:3300/0 conn(0x7f47040ccca0 0x7f470406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:43.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.287+0000 7f470259c700 1 --2- 172.21.15.16:0/3775228254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4704158860 0x7f4704070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:43.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.287+0000 7f4702d9d700 1 -- 172.21.15.16:0/3775228254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4704158860 msgr2=0x7f4704070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:43.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.287+0000 7f4702d9d700 1 --2- 172.21.15.16:0/3775228254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4704158860 0x7f4704070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.287+0000 7f4702d9d700 1 -- 172.21.15.16:0/3775228254 >> v2:172.21.15.169:3300/0 conn(0x7f47040ccca0 msgr2=0x7f470406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:43.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.287+0000 7f4702d9d700 1 --2- 172.21.15.16:0/3775228254 >> v2:172.21.15.169:3300/0 conn(0x7f47040ccca0 0x7f470406c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.287+0000 7f4702d9d700 1 -- 172.21.15.16:0/3775228254 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040c8fa0 con 0x7f470406cc40 2023-06-08T04:02:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.287+0000 7f4702d9d700 1 --2- 172.21.15.16:0/3775228254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f470406cc40 0x7f47040c9d60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f47040cc2f0 tx=0x7f46fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8243a09e42bf98d5 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f470159a700 1 -- 172.21.15.16:0/3775228254 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc00e070 con 0x7f470406cc40 2023-06-08T04:02:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f470159a700 1 -- 172.21.15.16:0/3775228254 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc00b910 con 0x7f470406cc40 2023-06-08T04:02:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f470159a700 1 -- 172.21.15.16:0/3775228254 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc00bcc0 con 0x7f470406cc40 2023-06-08T04:02:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f4708fff700 1 -- 172.21.15.16:0/3775228254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f470406cc40 msgr2=0x7f47040c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f4708fff700 1 --2- 172.21.15.16:0/3775228254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f470406cc40 0x7f47040c9d60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f47040cc2f0 tx=0x7f46fc00b330 comp rx=0 tx=0).stop 2023-06-08T04:02:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f4708fff700 1 -- 172.21.15.16:0/3775228254 shutdown_connections 2023-06-08T04:02:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f4708fff700 1 --2- 172.21.15.16:0/3775228254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f470406cc40 0x7f47040c9d60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f4708fff700 1 --2- 172.21.15.16:0/3775228254 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4704158860 0x7f4704070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f4708fff700 1 --2- 172.21.15.16:0/3775228254 >> v2:172.21.15.169:3300/0 conn(0x7f47040ccca0 0x7f470406c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f4708fff700 1 -- 172.21.15.16:0/3775228254 >> 172.21.15.16:0/3775228254 conn(0x7f470406aa40 msgr2=0x7f47040b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:43.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f4708fff700 1 -- 172.21.15.16:0/3775228254 shutdown_connections 2023-06-08T04:02:43.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.288+0000 7f4708fff700 1 -- 172.21.15.16:0/3775228254 wait complete. 2023-06-08T04:02:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.290+0000 7f4708fff700 1 Processor -- start 2023-06-08T04:02:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.290+0000 7f4708fff700 1 -- start start 2023-06-08T04:02:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.291+0000 7f4708fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f470406cc40 0x7f47040abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.291+0000 7f4708fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47040ccca0 0x7f470414e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.291+0000 7f4708fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4704158860 0x7f470414ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.291+0000 7f4708fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470415ae30 con 0x7f470406cc40 2023-06-08T04:02:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.291+0000 7f4708fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470415ab50 con 0x7f47040ccca0 2023-06-08T04:02:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.291+0000 7f4708fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47040c6f90 con 0x7f4704158860 2023-06-08T04:02:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.291+0000 7f470259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f470406cc40 0x7f47040abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.291+0000 7f470259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f470406cc40 0x7f47040abde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45222/0 (socket says 172.21.15.16:45222) 2023-06-08T04:02:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.291+0000 7f470259c700 1 -- 172.21.15.16:0/1958084601 learned_addr learned my addr 172.21.15.16:0/1958084601 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.292+0000 7f470259c700 1 -- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4704158860 msgr2=0x7f470414ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.292+0000 7f470259c700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4704158860 0x7f470414ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.292+0000 7f470259c700 1 -- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47040ccca0 msgr2=0x7f470414e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:43.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.292+0000 7f470259c700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47040ccca0 0x7f470414e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.292+0000 7f470259c700 1 -- 172.21.15.16:0/1958084601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc009b30 con 0x7f470406cc40 2023-06-08T04:02:43.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.292+0000 7f470259c700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f470406cc40 0x7f47040abde0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f46f400e9b0 tx=0x7f46f400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:43.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.292+0000 7f46f2ffd700 1 -- 172.21.15.16:0/1958084601 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4009710 con 0x7f470406cc40 2023-06-08T04:02:43.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.292+0000 7f46f2ffd700 1 -- 172.21.15.16:0/1958084601 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f400c850 con 0x7f470406cc40 2023-06-08T04:02:43.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.292+0000 7f4708fff700 1 -- 172.21.15.16:0/1958084601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47040c7270 con 0x7f470406cc40 2023-06-08T04:02:43.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.292+0000 7f46f2ffd700 1 -- 172.21.15.16:0/1958084601 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400cbc0 con 0x7f470406cc40 2023-06-08T04:02:43.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.292+0000 7f4708fff700 1 -- 172.21.15.16:0/1958084601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47040ac8c0 con 0x7f470406cc40 2023-06-08T04:02:43.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.293+0000 7f4708fff700 1 -- 172.21.15.16:0/1958084601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47040c6df0 con 0x7f470406cc40 2023-06-08T04:02:43.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.295+0000 7f46f2ffd700 1 -- 172.21.15.16:0/1958084601 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f46f400cd20 con 0x7f470406cc40 2023-06-08T04:02:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.295+0000 7f46f2ffd700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f46e406ace0 0x7f46e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.296+0000 7f46f2ffd700 1 -- 172.21.15.16:0/1958084601 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46f4089470 con 0x7f470406cc40 2023-06-08T04:02:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.296+0000 7f4701d9b700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f46e406ace0 0x7f46e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.297+0000 7f4701d9b700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f46e406ace0 0x7f46e406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f46f8006b20 tx=0x7f46f8006ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:43.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.300+0000 7f46f2ffd700 1 -- 172.21.15.16:0/1958084601 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f47040c6df0 con 0x7f470406cc40 2023-06-08T04:02:43.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.522+0000 7f4708fff700 1 -- 172.21.15.16:0/1958084601 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f47040c6df0 con 0x7f470406cc40 2023-06-08T04:02:43.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.522+0000 7f46f2ffd700 1 -- 172.21.15.16:0/1958084601 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f47040c6df0 con 0x7f470406cc40 2023-06-08T04:02:43.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 -- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f46e406ace0 msgr2=0x7f46e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:43.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f46e406ace0 0x7f46e406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f46f8006b20 tx=0x7f46f8006ab0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 -- 172.21.15.16:0/1958084601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f470406cc40 msgr2=0x7f47040abde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:43.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f470406cc40 0x7f47040abde0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f46f400e9b0 tx=0x7f46f400ed70 comp rx=0 tx=0).stop 2023-06-08T04:02:43.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 -- 172.21.15.16:0/1958084601 shutdown_connections 2023-06-08T04:02:43.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f46e406ace0 0x7f46e406d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4704158860 0x7f470414ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f470406cc40 0x7f47040abde0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 --2- 172.21.15.16:0/1958084601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f47040ccca0 0x7f470414e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:43.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 -- 172.21.15.16:0/1958084601 >> 172.21.15.16:0/1958084601 conn(0x7f470406aa40 msgr2=0x7f47040ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:43.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 -- 172.21.15.16:0/1958084601 shutdown_connections 2023-06-08T04:02:43.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:43.524+0000 7f4708fff700 1 -- 172.21.15.16:0/1958084601 wait complete. 2023-06-08T04:02:43.531 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-06-08T04:02:43.547 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-08T04:02:43.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:43.548 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-08T04:02:43.642 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2023-06-08T04:02:43.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:43.642 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-08T04:02:43.708 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:02:43.708 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:43.760 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:02:43.760 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:43.808 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:02:43.808 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:43.894 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:44.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.092+0000 7f3b315ff700 1 Processor -- start 2023-06-08T04:02:44.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.092+0000 7f3b315ff700 1 -- start start 2023-06-08T04:02:44.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.093+0000 7f3b315ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3b2c0b83f0 0x7f3b2c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.093+0000 7f3b315ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c0d0800 con 0x7f3b2c0b4d20 2023-06-08T04:02:44.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.093+0000 7f3b315ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c0cd1e0 con 0x7f3b2c0ced40 2023-06-08T04:02:44.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.093+0000 7f3b315ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c0cd4c0 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.093+0000 7f3b2b7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3b2c0b4d20 0x7f3b2c0d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34352/0 (socket says 172.21.15.16:34352) 2023-06-08T04:02:44.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.093+0000 7f3b2b7fe700 1 -- 172.21.15.16:0/709640874 learned_addr learned my addr 172.21.15.16:0/709640874 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:44.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.093+0000 7f3b2affd700 1 --2- 172.21.15.16:0/709640874 >> v2:172.21.15.169:3300/0 conn(0x7f3b2c0b83f0 0x7f3b2c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.094+0000 7f3b2a7fc700 1 -- 172.21.15.16:0/709640874 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939580482 0 0) 0x7f3b2c0d0800 con 0x7f3b2c0b4d20 2023-06-08T04:02:44.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.094+0000 7f3b2affd700 1 -- 172.21.15.16:0/709640874 >> v1:172.21.15.169:6789/0 conn(0x7f3b2c0ced40 legacy=0x7f3b2c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.094+0000 7f3b2affd700 1 -- 172.21.15.16:0/709640874 >> v1:172.21.15.16:6789/0 conn(0x7f3b2c0b4d20 legacy=0x7f3b2c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.094+0000 7f3b2affd700 1 -- 172.21.15.16:0/709640874 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0d0aa0 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.094+0000 7f3b2affd700 1 --2- 172.21.15.16:0/709640874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b2c0b83f0 0x7f3b2c160a60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0097c0 tx=0x7f3b1c009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30d9dc1f9a9e7503 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:44.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.094+0000 7f3b2a7fc700 1 -- 172.21.15.16:0/709640874 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c004230 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.095+0000 7f3b2a7fc700 1 -- 172.21.15.16:0/709640874 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c004390 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.095+0000 7f3b2a7fc700 1 -- 172.21.15.16:0/709640874 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c0036a0 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.095+0000 7f3b315ff700 1 -- 172.21.15.16:0/709640874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b2c0b83f0 msgr2=0x7f3b2c160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.095+0000 7f3b315ff700 1 --2- 172.21.15.16:0/709640874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b2c0b83f0 0x7f3b2c160a60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0097c0 tx=0x7f3b1c009ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.095+0000 7f3b315ff700 1 -- 172.21.15.16:0/709640874 shutdown_connections 2023-06-08T04:02:44.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.095+0000 7f3b315ff700 1 --2- 172.21.15.16:0/709640874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b2c0b83f0 0x7f3b2c160a60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.095+0000 7f3b315ff700 1 -- 172.21.15.16:0/709640874 >> 172.21.15.16:0/709640874 conn(0x7f3b2c0cf610 msgr2=0x7f3b2c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:44.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.095+0000 7f3b315ff700 1 -- 172.21.15.16:0/709640874 shutdown_connections 2023-06-08T04:02:44.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.095+0000 7f3b315ff700 1 -- 172.21.15.16:0/709640874 wait complete. 2023-06-08T04:02:44.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.097+0000 7f3b315ff700 1 Processor -- start 2023-06-08T04:02:44.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.097+0000 7f3b315ff700 1 -- start start 2023-06-08T04:02:44.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.098+0000 7f3b315ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b2c0b4d20 0x7f3b2c159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.098+0000 7f3b315ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0b83f0 0x7f3b2c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.098+0000 7f3b315ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b2c0ced40 0x7f3b2c1f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.098+0000 7f3b315ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c1598f0 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.098+0000 7f3b315ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0cb640 con 0x7f3b2c0ced40 2023-06-08T04:02:44.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.098+0000 7f3b315ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c1f2860 con 0x7f3b2c0b4d20 2023-06-08T04:02:44.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.098+0000 7f3b23fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0b83f0 0x7f3b2c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.098+0000 7f3b23fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0b83f0 0x7f3b2c1593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45230/0 (socket says 172.21.15.16:45230) 2023-06-08T04:02:44.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.098+0000 7f3b23fff700 1 -- 172.21.15.16:0/4096228743 learned_addr learned my addr 172.21.15.16:0/4096228743 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:44.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.098+0000 7f3b2affd700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b2c0b4d20 0x7f3b2c159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.098+0000 7f3b2b7fe700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b2c0ced40 0x7f3b2c1f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b23fff700 1 -- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b2c0b4d20 msgr2=0x7f3b2c159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b23fff700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b2c0b4d20 0x7f3b2c159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b23fff700 1 -- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b2c0ced40 msgr2=0x7f3b2c1f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b23fff700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b2c0ced40 0x7f3b2c1f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b23fff700 1 -- 172.21.15.16:0/4096228743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c0094a0 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b2b7fe700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b2c0ced40 0x7f3b2c1f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:44.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b23fff700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0b83f0 0x7f3b2c1593b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400c750 tx=0x7f3b1400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:44.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b237fe700 1 -- 172.21.15.16:0/4096228743 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140054e0 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b237fe700 1 -- 172.21.15.16:0/4096228743 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b14003680 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b237fe700 1 -- 172.21.15.16:0/4096228743 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14003a30 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b315ff700 1 -- 172.21.15.16:0/4096228743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c15f820 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.099+0000 7f3b315ff700 1 -- 172.21.15.16:0/4096228743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c0caff0 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.100+0000 7f3b315ff700 1 -- 172.21.15.16:0/4096228743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c0740e0 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.101+0000 7f3b237fe700 1 -- 172.21.15.16:0/4096228743 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b14003b90 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.102+0000 7f3b237fe700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3b0c06ace0 0x7f3b0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.102+0000 7f3b237fe700 1 -- 172.21.15.16:0/4096228743 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b14088a30 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.103+0000 7f3b2affd700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3b0c06ace0 0x7f3b0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.104+0000 7f3b2affd700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3b0c06ace0 0x7f3b0c06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0090b0 tx=0x7f3b1c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:44.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.107+0000 7f3b237fe700 1 -- 172.21.15.16:0/4096228743 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3b14053a40 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.313+0000 7f3b315ff700 1 -- 172.21.15.16:0/4096228743 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b2c0cb780 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.314+0000 7f3b237fe700 1 -- 172.21.15.16:0/4096228743 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18197 (secure 0 0 0) 0x7f3b14017090 con 0x7f3b2c0b83f0 2023-06-08T04:02:44.319 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:44.320 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:01:58.287084+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:44.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 -- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3b0c06ace0 msgr2=0x7f3b0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3b0c06ace0 0x7f3b0c06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0090b0 tx=0x7f3b1c008030 comp rx=0 tx=0).stop 2023-06-08T04:02:44.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 -- 172.21.15.16:0/4096228743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0b83f0 msgr2=0x7f3b2c1593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0b83f0 0x7f3b2c1593b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400c750 tx=0x7f3b1400ca60 comp rx=0 tx=0).stop 2023-06-08T04:02:44.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 -- 172.21.15.16:0/4096228743 shutdown_connections 2023-06-08T04:02:44.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3b0c06ace0 0x7f3b0c06d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3b2c0ced40 0x7f3b2c1f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3b2c0b4d20 0x7f3b2c159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 --2- 172.21.15.16:0/4096228743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b2c0b83f0 0x7f3b2c1593b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 -- 172.21.15.16:0/4096228743 >> 172.21.15.16:0/4096228743 conn(0x7f3b2c0cf610 msgr2=0x7f3b2c0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 -- 172.21.15.16:0/4096228743 shutdown_connections 2023-06-08T04:02:44.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.317+0000 7f3b315ff700 1 -- 172.21.15.16:0/4096228743 wait complete. 2023-06-08T04:02:44.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:01:54.980592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:01:56.264608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:02:44.341 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:02:44.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.539+0000 7fc87bbff700 1 Processor -- start 2023-06-08T04:02:44.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.539+0000 7fc87bbff700 1 -- start start 2023-06-08T04:02:44.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.540+0000 7fc87bbff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc8740b83f0 0x7fc874160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.540+0000 7fc87bbff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740ced40 0x7fc8740b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.540+0000 7fc87bbff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8740d0800 con 0x7fc8740b4b50 2023-06-08T04:02:44.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.540+0000 7fc87bbff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8740b4fd0 con 0x7fc8740b83f0 2023-06-08T04:02:44.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.540+0000 7fc87bbff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8740cd1e0 con 0x7fc8740ced40 2023-06-08T04:02:44.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.541+0000 7fc87999b700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc8740b83f0 0x7fc874160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.541+0000 7fc87919a700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740ced40 0x7fc8740b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.541+0000 7fc87a19c700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fc8740b4b50 0x7fc87406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:48616/0 (socket says 172.21.15.16:48616) 2023-06-08T04:02:44.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.541+0000 7fc87a19c700 1 -- 172.21.15.16:0/1457455879 learned_addr learned my addr 172.21.15.16:0/1457455879 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:44.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.541+0000 7fc87919a700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740ced40 0x7fc8740b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:50226/0 (socket says 172.21.15.16:50226) 2023-06-08T04:02:44.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.541+0000 7fc878999700 1 -- 172.21.15.16:0/1457455879 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631871684 0 0) 0x7fc8740d0800 con 0x7fc8740b4b50 2023-06-08T04:02:44.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.541+0000 7fc878999700 1 -- 172.21.15.16:0/1457455879 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8600035b0 con 0x7fc8740b4b50 2023-06-08T04:02:44.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.541+0000 7fc87919a700 1 -- 172.21.15.16:0/1457455879 >> v2:172.21.15.169:3300/0 conn(0x7fc8740b83f0 msgr2=0x7fc874160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:44.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.541+0000 7fc87919a700 1 --2- 172.21.15.16:0/1457455879 >> v2:172.21.15.169:3300/0 conn(0x7fc8740b83f0 0x7fc874160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.541+0000 7fc87919a700 1 -- 172.21.15.16:0/1457455879 >> v1:172.21.15.169:6789/0 conn(0x7fc8740b4b50 legacy=0x7fc87406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.541+0000 7fc87919a700 1 -- 172.21.15.16:0/1457455879 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740cd4c0 con 0x7fc8740ced40 2023-06-08T04:02:44.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.542+0000 7fc87919a700 1 --2- 172.21.15.16:0/1457455879 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740ced40 0x7fc8740b4610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc864009840 tx=0x7fc864009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=364ababcef296c9f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:44.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.542+0000 7fc878999700 1 -- 172.21.15.16:0/1457455879 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864011830 con 0x7fc8740ced40 2023-06-08T04:02:44.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.542+0000 7fc878999700 1 -- 172.21.15.16:0/1457455879 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc864011990 con 0x7fc8740ced40 2023-06-08T04:02:44.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.542+0000 7fc878999700 1 -- 172.21.15.16:0/1457455879 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864011d20 con 0x7fc8740ced40 2023-06-08T04:02:44.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.542+0000 7fc87bbff700 1 -- 172.21.15.16:0/1457455879 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740ced40 msgr2=0x7fc8740b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.542+0000 7fc87bbff700 1 --2- 172.21.15.16:0/1457455879 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740ced40 0x7fc8740b4610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc864009840 tx=0x7fc864009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:44.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.543+0000 7fc87bbff700 1 -- 172.21.15.16:0/1457455879 shutdown_connections 2023-06-08T04:02:44.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.543+0000 7fc87bbff700 1 --2- 172.21.15.16:0/1457455879 >> v2:172.21.15.169:3300/0 conn(0x7fc8740b83f0 0x7fc874160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.543+0000 7fc87bbff700 1 --2- 172.21.15.16:0/1457455879 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740ced40 0x7fc8740b4610 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.543+0000 7fc87bbff700 1 -- 172.21.15.16:0/1457455879 >> 172.21.15.16:0/1457455879 conn(0x7fc8740cf610 msgr2=0x7fc8740cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:44.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.543+0000 7fc87bbff700 1 -- 172.21.15.16:0/1457455879 shutdown_connections 2023-06-08T04:02:44.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.543+0000 7fc87bbff700 1 -- 172.21.15.16:0/1457455879 wait complete. 2023-06-08T04:02:44.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.544+0000 7fc87bbff700 1 Processor -- start 2023-06-08T04:02:44.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.545+0000 7fc87bbff700 1 -- start start 2023-06-08T04:02:44.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87bbff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740b4b50 0x7fc8740c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87bbff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8740b83f0 0x7fc87415f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87bbff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8740ced40 0x7fc87415a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87bbff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87415cb10 con 0x7fc8740ced40 2023-06-08T04:02:44.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87bbff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8740c8ed0 con 0x7fc8740b83f0 2023-06-08T04:02:44.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87bbff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8740cbfc0 con 0x7fc8740b4b50 2023-06-08T04:02:44.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87a19c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8740ced40 0x7fc87415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87a19c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8740ced40 0x7fc87415a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45244/0 (socket says 172.21.15.16:45244) 2023-06-08T04:02:44.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87a19c700 1 -- 172.21.15.16:0/3228115525 learned_addr learned my addr 172.21.15.16:0/3228115525 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:44.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87999b700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740b4b50 0x7fc8740c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87919a700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8740b83f0 0x7fc87415f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87a19c700 1 -- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740b4b50 msgr2=0x7fc8740c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87a19c700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740b4b50 0x7fc8740c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87a19c700 1 -- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8740b83f0 msgr2=0x7fc87415f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87a19c700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8740b83f0 0x7fc87415f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.546+0000 7fc87a19c700 1 -- 172.21.15.16:0/3228115525 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8640094a0 con 0x7fc8740ced40 2023-06-08T04:02:44.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.547+0000 7fc87a19c700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8740ced40 0x7fc87415a830 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00cb40 tx=0x7fc86c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:44.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.547+0000 7fc86a7fc700 1 -- 172.21.15.16:0/3228115525 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00a9e0 con 0x7fc8740ced40 2023-06-08T04:02:44.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.547+0000 7fc86a7fc700 1 -- 172.21.15.16:0/3228115525 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c00ab40 con 0x7fc8740ced40 2023-06-08T04:02:44.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.547+0000 7fc86a7fc700 1 -- 172.21.15.16:0/3228115525 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c012400 con 0x7fc8740ced40 2023-06-08T04:02:44.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.547+0000 7fc87bbff700 1 -- 172.21.15.16:0/3228115525 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8740cc2a0 con 0x7fc8740ced40 2023-06-08T04:02:44.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.547+0000 7fc87bbff700 1 -- 172.21.15.16:0/3228115525 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8740cc860 con 0x7fc8740ced40 2023-06-08T04:02:44.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.548+0000 7fc87bbff700 1 -- 172.21.15.16:0/3228115525 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87415cc50 con 0x7fc8740ced40 2023-06-08T04:02:44.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.549+0000 7fc86a7fc700 1 -- 172.21.15.16:0/3228115525 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc86c01b3b0 con 0x7fc8740ced40 2023-06-08T04:02:44.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.550+0000 7fc86a7fc700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc85806ad30 0x7fc85806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.550+0000 7fc86a7fc700 1 -- 172.21.15.16:0/3228115525 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc86c088ff0 con 0x7fc8740ced40 2023-06-08T04:02:44.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.551+0000 7fc87999b700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc85806ad30 0x7fc85806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.551+0000 7fc87999b700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc85806ad30 0x7fc85806d1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc870009be0 tx=0x7fc870009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:44.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.554+0000 7fc86a7fc700 1 -- 172.21.15.16:0/3228115525 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc86c0bb310 con 0x7fc8740ced40 2023-06-08T04:02:44.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.760+0000 7fc87bbff700 1 -- 172.21.15.16:0/3228115525 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc8740740e0 con 0x7fc8740ced40 2023-06-08T04:02:44.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.761+0000 7fc86a7fc700 1 -- 172.21.15.16:0/3228115525 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc86c017020 con 0x7fc8740ced40 2023-06-08T04:02:44.765 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:02:44.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 -- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc85806ad30 msgr2=0x7fc85806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc85806ad30 0x7fc85806d1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc870009be0 tx=0x7fc870009210 comp rx=0 tx=0).stop 2023-06-08T04:02:44.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 -- 172.21.15.16:0/3228115525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8740ced40 msgr2=0x7fc87415a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8740ced40 0x7fc87415a830 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00cb40 tx=0x7fc86c00ce50 comp rx=0 tx=0).stop 2023-06-08T04:02:44.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 -- 172.21.15.16:0/3228115525 shutdown_connections 2023-06-08T04:02:44.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc85806ad30 0x7fc85806d1e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8740ced40 0x7fc87415a830 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8740b4b50 0x7fc8740c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 --2- 172.21.15.16:0/3228115525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc8740b83f0 0x7fc87415f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 -- 172.21.15.16:0/3228115525 >> 172.21.15.16:0/3228115525 conn(0x7fc8740cf610 msgr2=0x7fc8740b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:44.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 -- 172.21.15.16:0/3228115525 shutdown_connections 2023-06-08T04:02:44.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.763+0000 7fc87bbff700 1 -- 172.21.15.16:0/3228115525 wait complete. 2023-06-08T04:02:44.786 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:02:44.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.986+0000 7f75bb7ff700 1 Processor -- start 2023-06-08T04:02:44.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.987+0000 7f75bb7ff700 1 -- start start 2023-06-08T04:02:44.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.988+0000 7f75bb7ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f75b40b4d20 0x7f75b4167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.988+0000 7f75bb7ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b40d0800 con 0x7f75b40b83f0 2023-06-08T04:02:44.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.988+0000 7f75bb7ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b40cd1e0 con 0x7f75b4160a60 2023-06-08T04:02:44.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.988+0000 7f75bb7ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b4160ed0 con 0x7f75b40b4d20 2023-06-08T04:02:44.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.988+0000 7f75b9d9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f75b40b4d20 0x7f75b4167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.988+0000 7f75b959b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f75b40b83f0 0x7f75b40ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34364/0 (socket says 172.21.15.16:34364) 2023-06-08T04:02:44.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.988+0000 7f75b959b700 1 -- 172.21.15.16:0/1529596976 learned_addr learned my addr 172.21.15.16:0/1529596976 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:44.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.989+0000 7f75b9d9c700 1 -- 172.21.15.16:0/1529596976 >> v1:172.21.15.169:6789/0 conn(0x7f75b4160a60 legacy=0x7f75b40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:44.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.989+0000 7f75b9d9c700 1 -- 172.21.15.16:0/1529596976 >> v1:172.21.15.16:6789/0 conn(0x7f75b40b83f0 legacy=0x7f75b40ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.989+0000 7f75b9d9c700 1 -- 172.21.15.16:0/1529596976 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b40cd4c0 con 0x7f75b40b4d20 2023-06-08T04:02:44.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.989+0000 7f75b9d9c700 1 --2- 172.21.15.16:0/1529596976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75b40b4d20 0x7f75b4167260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009d90 tx=0x7f75ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a283ff8805ed2934 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:44.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.989+0000 7f75abfff700 1 -- 172.21.15.16:0/1529596976 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00e070 con 0x7f75b40b4d20 2023-06-08T04:02:44.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.989+0000 7f75abfff700 1 -- 172.21.15.16:0/1529596976 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac00bb90 con 0x7f75b40b4d20 2023-06-08T04:02:44.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.989+0000 7f75abfff700 1 -- 172.21.15.16:0/1529596976 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac003a20 con 0x7f75b40b4d20 2023-06-08T04:02:44.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.990+0000 7f75bb7ff700 1 -- 172.21.15.16:0/1529596976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75b40b4d20 msgr2=0x7f75b4167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:44.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.990+0000 7f75bb7ff700 1 --2- 172.21.15.16:0/1529596976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75b40b4d20 0x7f75b4167260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009d90 tx=0x7f75ac00b330 comp rx=0 tx=0).stop 2023-06-08T04:02:44.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.990+0000 7f75bb7ff700 1 -- 172.21.15.16:0/1529596976 shutdown_connections 2023-06-08T04:02:44.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.990+0000 7f75bb7ff700 1 --2- 172.21.15.16:0/1529596976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75b40b4d20 0x7f75b4167260 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:44.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.990+0000 7f75bb7ff700 1 -- 172.21.15.16:0/1529596976 >> 172.21.15.16:0/1529596976 conn(0x7f75b40cf610 msgr2=0x7f75b40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:44.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.990+0000 7f75bb7ff700 1 -- 172.21.15.16:0/1529596976 shutdown_connections 2023-06-08T04:02:44.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.990+0000 7f75bb7ff700 1 -- 172.21.15.16:0/1529596976 wait complete. 2023-06-08T04:02:44.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.991+0000 7f75bb7ff700 1 Processor -- start 2023-06-08T04:02:44.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.992+0000 7f75bb7ff700 1 -- start start 2023-06-08T04:02:44.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.992+0000 7f75bb7ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75b40b4d20 0x7f75b414cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.992+0000 7f75bb7ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75b40b83f0 0x7f75b40c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75bb7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b4160a60 0x7f75b406b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:44.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75bb7ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b40c9120 con 0x7f75b40b4d20 2023-06-08T04:02:44.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75bb7ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b40c9540 con 0x7f75b40b83f0 2023-06-08T04:02:44.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75bb7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b40c84a0 con 0x7f75b4160a60 2023-06-08T04:02:44.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75b959b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75b40b4d20 0x7f75b414cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:44.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75b959b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75b40b4d20 0x7f75b414cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45258/0 (socket says 172.21.15.16:45258) 2023-06-08T04:02:44.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75b959b700 1 -- 172.21.15.16:0/2132643039 learned_addr learned my addr 172.21.15.16:0/2132643039 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:45.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75b8d9a700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75b40b83f0 0x7f75b40c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75b9d9c700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b4160a60 0x7f75b406b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75b959b700 1 -- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b4160a60 msgr2=0x7f75b406b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75b959b700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b4160a60 0x7f75b406b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75b959b700 1 -- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75b40b83f0 msgr2=0x7f75b40c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75b959b700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75b40b83f0 0x7f75b40c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75b959b700 1 -- 172.21.15.16:0/2132643039 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac009a70 con 0x7f75b40b4d20 2023-06-08T04:02:45.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.993+0000 7f75b8d9a700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75b40b83f0 0x7f75b40c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:45.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.994+0000 7f75b959b700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75b40b4d20 0x7f75b414cd30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c4c0 tx=0x7f75b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:45.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.994+0000 7f75a9ffb700 1 -- 172.21.15.16:0/2132643039 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0005d70 con 0x7f75b40b4d20 2023-06-08T04:02:45.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.994+0000 7f75a9ffb700 1 -- 172.21.15.16:0/2132643039 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b00070d0 con 0x7f75b40b4d20 2023-06-08T04:02:45.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.994+0000 7f75a9ffb700 1 -- 172.21.15.16:0/2132643039 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0007460 con 0x7f75b40b4d20 2023-06-08T04:02:45.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.994+0000 7f75bb7ff700 1 -- 172.21.15.16:0/2132643039 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b40c8780 con 0x7f75b40b4d20 2023-06-08T04:02:45.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.994+0000 7f75bb7ff700 1 -- 172.21.15.16:0/2132643039 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b40c8d40 con 0x7f75b40b4d20 2023-06-08T04:02:45.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.995+0000 7f75bb7ff700 1 -- 172.21.15.16:0/2132643039 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b40740e0 con 0x7f75b40b4d20 2023-06-08T04:02:45.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.996+0000 7f75a9ffb700 1 -- 172.21.15.16:0/2132643039 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f75b00075c0 con 0x7f75b40b4d20 2023-06-08T04:02:45.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.997+0000 7f75a9ffb700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f759806ace0 0x7f759806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.997+0000 7f75a9ffb700 1 -- 172.21.15.16:0/2132643039 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f75b0088ac0 con 0x7f75b40b4d20 2023-06-08T04:02:45.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.997+0000 7f75b8d9a700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f759806ace0 0x7f759806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:44.998+0000 7f75b8d9a700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f759806ace0 0x7f759806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f75b40d2800 tx=0x7f75a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:45.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.001+0000 7f75a9ffb700 1 -- 172.21.15.16:0/2132643039 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f75b0053b20 con 0x7f75b40b4d20 2023-06-08T04:02:45.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.206+0000 7f75bb7ff700 1 -- 172.21.15.16:0/2132643039 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75b40c6460 con 0x7f75b40b4d20 2023-06-08T04:02:45.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.207+0000 7f75a9ffb700 1 -- 172.21.15.16:0/2132643039 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75b00170a0 con 0x7f75b40b4d20 2023-06-08T04:02:45.211 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:02:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 -- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f759806ace0 msgr2=0x7f759806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f759806ace0 0x7f759806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f75b40d2800 tx=0x7f75a4008040 comp rx=0 tx=0).stop 2023-06-08T04:02:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 -- 172.21.15.16:0/2132643039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75b40b4d20 msgr2=0x7f75b414cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75b40b4d20 0x7f75b414cd30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c4c0 tx=0x7f75b000c880 comp rx=0 tx=0).stop 2023-06-08T04:02:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 -- 172.21.15.16:0/2132643039 shutdown_connections 2023-06-08T04:02:45.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f759806ace0 0x7f759806d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f75b4160a60 0x7f75b406b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f75b40b4d20 0x7f75b414cd30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 --2- 172.21.15.16:0/2132643039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f75b40b83f0 0x7f75b40c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 -- 172.21.15.16:0/2132643039 >> 172.21.15.16:0/2132643039 conn(0x7f75b40cf610 msgr2=0x7f75b40b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 -- 172.21.15.16:0/2132643039 shutdown_connections 2023-06-08T04:02:45.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.209+0000 7f75bb7ff700 1 -- 172.21.15.16:0/2132643039 wait complete. 2023-06-08T04:02:45.232 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:02:45.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.434+0000 7f99245ff700 1 Processor -- start 2023-06-08T04:02:45.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.435+0000 7f99245ff700 1 -- start start 2023-06-08T04:02:45.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.436+0000 7f99245ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f991c160a60 0x7f991c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.436+0000 7f99245ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f991c0b4b50 0x7f991c0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.436+0000 7f99245ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0d0800 con 0x7f991c0b83f0 2023-06-08T04:02:45.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.436+0000 7f99245ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c160ed0 con 0x7f991c0b4b50 2023-06-08T04:02:45.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.436+0000 7f99245ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0b4fd0 con 0x7f991c160a60 2023-06-08T04:02:45.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.436+0000 7f9922b9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f991c0b4b50 0x7f991c0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.436+0000 7f992239b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f991c0b83f0 0x7f991c0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34370/0 (socket says 172.21.15.16:34370) 2023-06-08T04:02:45.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.436+0000 7f9922b9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f991c0b4b50 0x7f991c0d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45272/0 (socket says 172.21.15.16:45272) 2023-06-08T04:02:45.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.436+0000 7f992239b700 1 -- 172.21.15.16:0/1146398898 learned_addr learned my addr 172.21.15.16:0/1146398898 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:45.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.436+0000 7f9921b9a700 1 --2- 172.21.15.16:0/1146398898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f991c160a60 0x7f991c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.437+0000 7f9922b9c700 1 -- 172.21.15.16:0/1146398898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f991c160a60 msgr2=0x7f991c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:45.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.437+0000 7f9922b9c700 1 --2- 172.21.15.16:0/1146398898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f991c160a60 0x7f991c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.437+0000 7f9922b9c700 1 -- 172.21.15.16:0/1146398898 >> v1:172.21.15.16:6789/0 conn(0x7f991c0b83f0 legacy=0x7f991c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.437+0000 7f9922b9c700 1 -- 172.21.15.16:0/1146398898 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0cd1e0 con 0x7f991c0b4b50 2023-06-08T04:02:45.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.437+0000 7f9921399700 1 -- 172.21.15.16:0/1146398898 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780539695 0 0) 0x7f991c0d0800 con 0x7f991c0b83f0 2023-06-08T04:02:45.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.437+0000 7f9922b9c700 1 --2- 172.21.15.16:0/1146398898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f991c0b4b50 0x7f991c0d0fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9914009d90 tx=0x7f991400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afc71febb4f3084 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:45.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.437+0000 7f9921399700 1 -- 172.21.15.16:0/1146398898 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991400e070 con 0x7f991c0b4b50 2023-06-08T04:02:45.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.437+0000 7f9921399700 1 -- 172.21.15.16:0/1146398898 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991400bb20 con 0x7f991c0b4b50 2023-06-08T04:02:45.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.437+0000 7f9921399700 1 -- 172.21.15.16:0/1146398898 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914012430 con 0x7f991c0b4b50 2023-06-08T04:02:45.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.438+0000 7f99245ff700 1 -- 172.21.15.16:0/1146398898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f991c0b4b50 msgr2=0x7f991c0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.438+0000 7f99245ff700 1 --2- 172.21.15.16:0/1146398898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f991c0b4b50 0x7f991c0d0fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9914009d90 tx=0x7f991400b330 comp rx=0 tx=0).stop 2023-06-08T04:02:45.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.438+0000 7f99245ff700 1 -- 172.21.15.16:0/1146398898 shutdown_connections 2023-06-08T04:02:45.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.438+0000 7f99245ff700 1 --2- 172.21.15.16:0/1146398898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f991c0b4b50 0x7f991c0d0fc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.438+0000 7f99245ff700 1 --2- 172.21.15.16:0/1146398898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f991c160a60 0x7f991c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.438+0000 7f99245ff700 1 -- 172.21.15.16:0/1146398898 >> 172.21.15.16:0/1146398898 conn(0x7f991c0cf610 msgr2=0x7f991c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:45.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.438+0000 7f99245ff700 1 -- 172.21.15.16:0/1146398898 shutdown_connections 2023-06-08T04:02:45.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.438+0000 7f99245ff700 1 -- 172.21.15.16:0/1146398898 wait complete. 2023-06-08T04:02:45.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.440+0000 7f99245ff700 1 Processor -- start 2023-06-08T04:02:45.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.440+0000 7f99245ff700 1 -- start start 2023-06-08T04:02:45.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.441+0000 7f99245ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f991c0b4b50 0x7f991c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.441+0000 7f99245ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f991c0b83f0 0x7f991c0a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.441+0000 7f99245ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f991c160a60 0x7f991c15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.441+0000 7f99245ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c159f60 con 0x7f991c160a60 2023-06-08T04:02:45.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.441+0000 7f99245ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c1f1940 con 0x7f991c0b4b50 2023-06-08T04:02:45.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.441+0000 7f99245ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c1f1bc0 con 0x7f991c0b83f0 2023-06-08T04:02:45.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.441+0000 7f9922b9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f991c160a60 0x7f991c15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.441+0000 7f9922b9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f991c160a60 0x7f991c15a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45288/0 (socket says 172.21.15.16:45288) 2023-06-08T04:02:45.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.441+0000 7f9922b9c700 1 -- 172.21.15.16:0/3290251594 learned_addr learned my addr 172.21.15.16:0/3290251594 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:45.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.441+0000 7f9921b9a700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f991c0b83f0 0x7f991c0a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.441+0000 7f992239b700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f991c0b4b50 0x7f991c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.442+0000 7f9922b9c700 1 -- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f991c0b83f0 msgr2=0x7f991c0a9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.442+0000 7f9922b9c700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f991c0b83f0 0x7f991c0a9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.442+0000 7f9922b9c700 1 -- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f991c0b4b50 msgr2=0x7f991c159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.442+0000 7f9922b9c700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f991c0b4b50 0x7f991c159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.442+0000 7f9922b9c700 1 -- 172.21.15.16:0/3290251594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914009a70 con 0x7f991c160a60 2023-06-08T04:02:45.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.442+0000 7f9922b9c700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f991c160a60 0x7f991c15a9c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9914014040 tx=0x7f9914004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:45.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.442+0000 7f9912ffd700 1 -- 172.21.15.16:0/3290251594 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914012430 con 0x7f991c160a60 2023-06-08T04:02:45.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.442+0000 7f9912ffd700 1 -- 172.21.15.16:0/3290251594 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9914020070 con 0x7f991c160a60 2023-06-08T04:02:45.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.442+0000 7f9912ffd700 1 -- 172.21.15.16:0/3290251594 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914004280 con 0x7f991c160a60 2023-06-08T04:02:45.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.442+0000 7f99245ff700 1 -- 172.21.15.16:0/3290251594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c1f2940 con 0x7f991c160a60 2023-06-08T04:02:45.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.443+0000 7f99245ff700 1 -- 172.21.15.16:0/3290251594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c1f2140 con 0x7f991c160a60 2023-06-08T04:02:45.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.444+0000 7f9910ff9700 1 -- 172.21.15.16:0/3290251594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c0740e0 con 0x7f991c160a60 2023-06-08T04:02:45.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.445+0000 7f9912ffd700 1 -- 172.21.15.16:0/3290251594 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99140043e0 con 0x7f991c160a60 2023-06-08T04:02:45.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.446+0000 7f9912ffd700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f990006ace0 0x7f990006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.446+0000 7f9912ffd700 1 -- 172.21.15.16:0/3290251594 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9914022070 con 0x7f991c160a60 2023-06-08T04:02:45.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.447+0000 7f992239b700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f990006ace0 0x7f990006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.448+0000 7f992239b700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f990006ace0 0x7f990006d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9918007fd0 tx=0x7f9918007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:45.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.451+0000 7f9912ffd700 1 -- 172.21.15.16:0/3290251594 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9914056160 con 0x7f991c160a60 2023-06-08T04:02:45.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.655+0000 7f9910ff9700 1 -- 172.21.15.16:0/3290251594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f991c0cfd60 con 0x7f991c160a60 2023-06-08T04:02:45.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.655+0000 7f9912ffd700 1 -- 172.21.15.16:0/3290251594 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9914059780 con 0x7f991c160a60 2023-06-08T04:02:45.660 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:02:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 -- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f990006ace0 msgr2=0x7f990006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f990006ace0 0x7f990006d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9918007fd0 tx=0x7f9918007de0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 -- 172.21.15.16:0/3290251594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f991c160a60 msgr2=0x7f991c15a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f991c160a60 0x7f991c15a9c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9914014040 tx=0x7f9914004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 -- 172.21.15.16:0/3290251594 shutdown_connections 2023-06-08T04:02:45.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f990006ace0 0x7f990006d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f991c160a60 0x7f991c15a9c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f991c0b4b50 0x7f991c159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 --2- 172.21.15.16:0/3290251594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f991c0b83f0 0x7f991c0a9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 -- 172.21.15.16:0/3290251594 >> 172.21.15.16:0/3290251594 conn(0x7f991c0cf610 msgr2=0x7f991c0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:45.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 -- 172.21.15.16:0/3290251594 shutdown_connections 2023-06-08T04:02:45.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.658+0000 7f9910ff9700 1 -- 172.21.15.16:0/3290251594 wait complete. 2023-06-08T04:02:45.680 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:02:45.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.879+0000 7f55ffbff700 1 Processor -- start 2023-06-08T04:02:45.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.879+0000 7f55ffbff700 1 -- start start 2023-06-08T04:02:45.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.880+0000 7f55ffbff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f55f815d4f0 0x7f55f80cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.880+0000 7f55ffbff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f80cd270 con 0x7f55f80cf030 2023-06-08T04:02:45.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.880+0000 7f55ffbff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f80cda80 con 0x7f55f8156a80 2023-06-08T04:02:45.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.880+0000 7f55ffbff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f815d970 con 0x7f55f815d4f0 2023-06-08T04:02:45.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.880+0000 7f55fe19c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f55f815d4f0 0x7f55f80cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.880+0000 7f55fe19c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f55f815d4f0 0x7f55f80cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45296/0 (socket says 172.21.15.16:45296) 2023-06-08T04:02:45.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.880+0000 7f55fd19a700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f55f80cf030 0x7f55f80d3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34378/0 (socket says 172.21.15.16:34378) 2023-06-08T04:02:45.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.880+0000 7f55fe19c700 1 -- 172.21.15.16:0/1634472961 learned_addr learned my addr 172.21.15.16:0/1634472961 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:45.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.881+0000 7f55fe19c700 1 -- 172.21.15.16:0/1634472961 >> v1:172.21.15.169:6789/0 conn(0x7f55f8156a80 legacy=0x7f55f80d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.881+0000 7f55fe19c700 1 -- 172.21.15.16:0/1634472961 >> v1:172.21.15.16:6789/0 conn(0x7f55f80cf030 legacy=0x7f55f80d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.881+0000 7f55fe19c700 1 -- 172.21.15.16:0/1634472961 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80cd4c0 con 0x7f55f815d4f0 2023-06-08T04:02:45.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.881+0000 7f55fe19c700 1 --2- 172.21.15.16:0/1634472961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f815d4f0 0x7f55f80cf5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009e50 tx=0x7f55f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e172b238de966d server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:45.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.881+0000 7f55fc999700 1 -- 172.21.15.16:0/1634472961 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000e070 con 0x7f55f815d4f0 2023-06-08T04:02:45.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.881+0000 7f55fc999700 1 -- 172.21.15.16:0/1634472961 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f000b9c0 con 0x7f55f815d4f0 2023-06-08T04:02:45.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.881+0000 7f55fc999700 1 -- 172.21.15.16:0/1634472961 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f000bd70 con 0x7f55f815d4f0 2023-06-08T04:02:45.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.882+0000 7f55ffbff700 1 -- 172.21.15.16:0/1634472961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f815d4f0 msgr2=0x7f55f80cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.882+0000 7f55ffbff700 1 --2- 172.21.15.16:0/1634472961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f815d4f0 0x7f55f80cf5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009e50 tx=0x7f55f000b330 comp rx=0 tx=0).stop 2023-06-08T04:02:45.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.882+0000 7f55ffbff700 1 -- 172.21.15.16:0/1634472961 shutdown_connections 2023-06-08T04:02:45.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.882+0000 7f55ffbff700 1 --2- 172.21.15.16:0/1634472961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f815d4f0 0x7f55f80cf5a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.882+0000 7f55ffbff700 1 -- 172.21.15.16:0/1634472961 >> 172.21.15.16:0/1634472961 conn(0x7f55f806b2e0 msgr2=0x7f55f806b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:45.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.882+0000 7f55ffbff700 1 -- 172.21.15.16:0/1634472961 shutdown_connections 2023-06-08T04:02:45.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.882+0000 7f55ffbff700 1 -- 172.21.15.16:0/1634472961 wait complete. 2023-06-08T04:02:45.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.884+0000 7f55ffbff700 1 Processor -- start 2023-06-08T04:02:45.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.884+0000 7f55ffbff700 1 -- start start 2023-06-08T04:02:45.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55ffbff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55f80cf030 0x7f55f80b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55ffbff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55f8156a80 0x7f55f81507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55ffbff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f815d4f0 0x7f55f80d1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55ffbff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80b70c0 con 0x7f55f815d4f0 2023-06-08T04:02:45.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55ffbff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f81f6520 con 0x7f55f80cf030 2023-06-08T04:02:45.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55ffbff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f81f5910 con 0x7f55f8156a80 2023-06-08T04:02:45.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fe19c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f815d4f0 0x7f55f80d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fe19c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f815d4f0 0x7f55f80d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45310/0 (socket says 172.21.15.16:45310) 2023-06-08T04:02:45.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fe19c700 1 -- 172.21.15.16:0/8195739 learned_addr learned my addr 172.21.15.16:0/8195739 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:45.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fd19a700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55f8156a80 0x7f55f81507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fd99b700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55f80cf030 0x7f55f80b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fe19c700 1 -- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55f8156a80 msgr2=0x7f55f81507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fe19c700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55f8156a80 0x7f55f81507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fe19c700 1 -- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55f80cf030 msgr2=0x7f55f80b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:45.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fe19c700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55f80cf030 0x7f55f80b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:45.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fe19c700 1 -- 172.21.15.16:0/8195739 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0009b30 con 0x7f55f815d4f0 2023-06-08T04:02:45.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fd99b700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55f80cf030 0x7f55f80b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:45.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.886+0000 7f55fd19a700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55f8156a80 0x7f55f81507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:45.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.887+0000 7f55fe19c700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f815d4f0 0x7f55f80d1640 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f55f806bf80 tx=0x7f55f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:45.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.887+0000 7f55ee7fc700 1 -- 172.21.15.16:0/8195739 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0004960 con 0x7f55f815d4f0 2023-06-08T04:02:45.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.887+0000 7f55ee7fc700 1 -- 172.21.15.16:0/8195739 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f00099b0 con 0x7f55f815d4f0 2023-06-08T04:02:45.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.887+0000 7f55ee7fc700 1 -- 172.21.15.16:0/8195739 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f001b670 con 0x7f55f815d4f0 2023-06-08T04:02:45.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.887+0000 7f55ffbff700 1 -- 172.21.15.16:0/8195739 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f81f5bf0 con 0x7f55f815d4f0 2023-06-08T04:02:45.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.887+0000 7f55ffbff700 1 -- 172.21.15.16:0/8195739 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f81f61b0 con 0x7f55f815d4f0 2023-06-08T04:02:45.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.888+0000 7f55ffbff700 1 -- 172.21.15.16:0/8195739 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f80c7810 con 0x7f55f815d4f0 2023-06-08T04:02:45.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.889+0000 7f55ee7fc700 1 -- 172.21.15.16:0/8195739 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f55f001b7d0 con 0x7f55f815d4f0 2023-06-08T04:02:45.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.890+0000 7f55ee7fc700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f55dc06ace0 0x7f55dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:45.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.890+0000 7f55ee7fc700 1 -- 172.21.15.16:0/8195739 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f55f008af60 con 0x7f55f815d4f0 2023-06-08T04:02:45.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.891+0000 7f55fd99b700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f55dc06ace0 0x7f55dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:45.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.891+0000 7f55fd99b700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f55dc06ace0 0x7f55dc06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f55f4000f60 tx=0x7f55f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:45.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:45.894+0000 7f55ee7fc700 1 -- 172.21.15.16:0/8195739 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f55f80c7810 con 0x7f55f815d4f0 2023-06-08T04:02:46.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.102+0000 7f55ffbff700 1 -- 172.21.15.16:0/8195739 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f55f80c7810 con 0x7f55f815d4f0 2023-06-08T04:02:46.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.103+0000 7f55ee7fc700 1 -- 172.21.15.16:0/8195739 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f55f80c7810 con 0x7f55f815d4f0 2023-06-08T04:02:46.108 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:02:46.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 -- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f55dc06ace0 msgr2=0x7f55dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:46.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f55dc06ace0 0x7f55dc06d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f55f4000f60 tx=0x7f55f4009040 comp rx=0 tx=0).stop 2023-06-08T04:02:46.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 -- 172.21.15.16:0/8195739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f815d4f0 msgr2=0x7f55f80d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:46.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f815d4f0 0x7f55f80d1640 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f55f806bf80 tx=0x7f55f0004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 -- 172.21.15.16:0/8195739 shutdown_connections 2023-06-08T04:02:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f55dc06ace0 0x7f55dc06d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55f815d4f0 0x7f55f80d1640 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f55f80cf030 0x7f55f80b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 --2- 172.21.15.16:0/8195739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f55f8156a80 0x7f55f81507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 -- 172.21.15.16:0/8195739 >> 172.21.15.16:0/8195739 conn(0x7f55f806b2e0 msgr2=0x7f55f8154eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:46.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 -- 172.21.15.16:0/8195739 shutdown_connections 2023-06-08T04:02:46.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.105+0000 7f55ffbff700 1 -- 172.21.15.16:0/8195739 wait complete. 2023-06-08T04:02:46.128 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T04:02:46.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.324+0000 7f6c883ff700 1 Processor -- start 2023-06-08T04:02:46.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.324+0000 7f6c883ff700 1 -- start start 2023-06-08T04:02:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.325+0000 7f6c883ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800b83f0 0x7f6c80160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.325+0000 7f6c883ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c800d0800 con 0x7f6c800b4d20 2023-06-08T04:02:46.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.325+0000 7f6c883ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c800cd1e0 con 0x7f6c800ced40 2023-06-08T04:02:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.325+0000 7f6c883ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c800cd4c0 con 0x7f6c800b83f0 2023-06-08T04:02:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.325+0000 7f6c8699c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6c800b4d20 0x7f6c800d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34384/0 (socket says 172.21.15.16:34384) 2023-06-08T04:02:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.325+0000 7f6c8699c700 1 -- 172.21.15.16:0/593164503 learned_addr learned my addr 172.21.15.16:0/593164503 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:46.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.326+0000 7f6c8619b700 1 --2- 172.21.15.16:0/593164503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800b83f0 0x7f6c80160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.326+0000 7f6c85199700 1 -- 172.21.15.16:0/593164503 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988036848 0 0) 0x7f6c800d0800 con 0x7f6c800b4d20 2023-06-08T04:02:46.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.326+0000 7f6c85199700 1 -- 172.21.15.16:0/593164503 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c6c0035b0 con 0x7f6c800b4d20 2023-06-08T04:02:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.326+0000 7f6c85199700 1 -- 172.21.15.16:0/593164503 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70282013 0 0) 0x7f6c800cd1e0 con 0x7f6c800ced40 2023-06-08T04:02:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.326+0000 7f6c85199700 1 -- 172.21.15.16:0/593164503 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c800d0800 con 0x7f6c800ced40 2023-06-08T04:02:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.326+0000 7f6c8619b700 1 -- 172.21.15.16:0/593164503 >> v1:172.21.15.169:6789/0 conn(0x7f6c800ced40 legacy=0x7f6c800b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.326+0000 7f6c8619b700 1 -- 172.21.15.16:0/593164503 >> v1:172.21.15.16:6789/0 conn(0x7f6c800b4d20 legacy=0x7f6c800d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.326+0000 7f6c8619b700 1 -- 172.21.15.16:0/593164503 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c800d0aa0 con 0x7f6c800b83f0 2023-06-08T04:02:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.327+0000 7f6c8619b700 1 --2- 172.21.15.16:0/593164503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800b83f0 0x7f6c80160a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009870 tx=0x7f6c7c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a75f7f623fe448e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.327+0000 7f6c85199700 1 -- 172.21.15.16:0/593164503 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c011830 con 0x7f6c800b83f0 2023-06-08T04:02:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.327+0000 7f6c85199700 1 -- 172.21.15.16:0/593164503 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c011990 con 0x7f6c800b83f0 2023-06-08T04:02:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.327+0000 7f6c85199700 1 -- 172.21.15.16:0/593164503 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c011d00 con 0x7f6c800b83f0 2023-06-08T04:02:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.327+0000 7f6c883ff700 1 -- 172.21.15.16:0/593164503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800b83f0 msgr2=0x7f6c80160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.327+0000 7f6c883ff700 1 --2- 172.21.15.16:0/593164503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800b83f0 0x7f6c80160a60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009870 tx=0x7f6c7c009b80 comp rx=0 tx=0).stop 2023-06-08T04:02:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.327+0000 7f6c883ff700 1 -- 172.21.15.16:0/593164503 shutdown_connections 2023-06-08T04:02:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.327+0000 7f6c883ff700 1 --2- 172.21.15.16:0/593164503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800b83f0 0x7f6c80160a60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.327+0000 7f6c883ff700 1 -- 172.21.15.16:0/593164503 >> 172.21.15.16:0/593164503 conn(0x7f6c800cf610 msgr2=0x7f6c800cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:46.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.328+0000 7f6c883ff700 1 -- 172.21.15.16:0/593164503 shutdown_connections 2023-06-08T04:02:46.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.328+0000 7f6c883ff700 1 -- 172.21.15.16:0/593164503 wait complete. 2023-06-08T04:02:46.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.329+0000 7f6c883ff700 1 Processor -- start 2023-06-08T04:02:46.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.329+0000 7f6c883ff700 1 -- start start 2023-06-08T04:02:46.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.330+0000 7f6c883ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c800b4d20 0x7f6c800b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:46.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.330+0000 7f6c883ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c800b83f0 0x7f6c801f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:46.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.330+0000 7f6c883ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800ced40 0x7f6c801f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:46.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.330+0000 7f6c883ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8015cd40 con 0x7f6c800b83f0 2023-06-08T04:02:46.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.330+0000 7f6c883ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8015ca10 con 0x7f6c800b4d20 2023-06-08T04:02:46.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.330+0000 7f6c883ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c800c7100 con 0x7f6c800ced40 2023-06-08T04:02:46.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8599a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c800b83f0 0x7f6c801f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:46.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8599a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c800b83f0 0x7f6c801f10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45318/0 (socket says 172.21.15.16:45318) 2023-06-08T04:02:46.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8599a700 1 -- 172.21.15.16:0/294539814 learned_addr learned my addr 172.21.15.16:0/294539814 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:46.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8619b700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c800b4d20 0x7f6c800b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:46.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8699c700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800ced40 0x7f6c801f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:46.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8599a700 1 -- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800ced40 msgr2=0x7f6c801f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:46.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8599a700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800ced40 0x7f6c801f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8599a700 1 -- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c800b4d20 msgr2=0x7f6c800b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:46.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8599a700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c800b4d20 0x7f6c800b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8599a700 1 -- 172.21.15.16:0/294539814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0094a0 con 0x7f6c800b83f0 2023-06-08T04:02:46.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8699c700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800ced40 0x7f6c801f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:46.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.331+0000 7f6c8599a700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c800b83f0 0x7f6c801f10f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c500 tx=0x7f6c7000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:46.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.332+0000 7f6c76ffd700 1 -- 172.21.15.16:0/294539814 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700052d0 con 0x7f6c800b83f0 2023-06-08T04:02:46.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.332+0000 7f6c76ffd700 1 -- 172.21.15.16:0/294539814 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c70005450 con 0x7f6c800b83f0 2023-06-08T04:02:46.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.332+0000 7f6c76ffd700 1 -- 172.21.15.16:0/294539814 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700038c0 con 0x7f6c800b83f0 2023-06-08T04:02:46.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.332+0000 7f6c883ff700 1 -- 172.21.15.16:0/294539814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c800c73e0 con 0x7f6c800b83f0 2023-06-08T04:02:46.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.332+0000 7f6c883ff700 1 -- 172.21.15.16:0/294539814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c800c76c0 con 0x7f6c800b83f0 2023-06-08T04:02:46.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.333+0000 7f6c883ff700 1 -- 172.21.15.16:0/294539814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8015ceb0 con 0x7f6c800b83f0 2023-06-08T04:02:46.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.334+0000 7f6c76ffd700 1 -- 172.21.15.16:0/294539814 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c70003a20 con 0x7f6c800b83f0 2023-06-08T04:02:46.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.335+0000 7f6c76ffd700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6c6406ace0 0x7f6c6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:46.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.335+0000 7f6c76ffd700 1 -- 172.21.15.16:0/294539814 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6c70088920 con 0x7f6c800b83f0 2023-06-08T04:02:46.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.335+0000 7f6c8619b700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6c6406ace0 0x7f6c6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:46.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.336+0000 7f6c8619b700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6c6406ace0 0x7f6c6406d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0090b0 tx=0x7f6c7c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:46.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.339+0000 7f6c76ffd700 1 -- 172.21.15.16:0/294539814 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c70053980 con 0x7f6c800b83f0 2023-06-08T04:02:46.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.562+0000 7f6c883ff700 1 -- 172.21.15.16:0/294539814 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c800740e0 con 0x7f6c800b83f0 2023-06-08T04:02:46.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.562+0000 7f6c76ffd700 1 -- 172.21.15.16:0/294539814 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c70056fa0 con 0x7f6c800b83f0 2023-06-08T04:02:46.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 -- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6c6406ace0 msgr2=0x7f6c6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:46.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6c6406ace0 0x7f6c6406d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0090b0 tx=0x7f6c7c008030 comp rx=0 tx=0).stop 2023-06-08T04:02:46.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 -- 172.21.15.16:0/294539814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c800b83f0 msgr2=0x7f6c801f10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:46.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c800b83f0 0x7f6c801f10f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c500 tx=0x7f6c7000c810 comp rx=0 tx=0).stop 2023-06-08T04:02:46.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 -- 172.21.15.16:0/294539814 shutdown_connections 2023-06-08T04:02:46.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f6c6406ace0 0x7f6c6406d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c800ced40 0x7f6c801f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c800b4d20 0x7f6c800b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 --2- 172.21.15.16:0/294539814 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c800b83f0 0x7f6c801f10f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:46.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 -- 172.21.15.16:0/294539814 >> 172.21.15.16:0/294539814 conn(0x7f6c800cf610 msgr2=0x7f6c8015a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:46.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 -- 172.21.15.16:0/294539814 shutdown_connections 2023-06-08T04:02:46.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:46.565+0000 7f6c883ff700 1 -- 172.21.15.16:0/294539814 wait complete. 2023-06-08T04:02:46.572 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-06-08T04:02:46.588 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-06-08T04:02:46.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:46.589 DEBUG:teuthology.orchestra.run.smithi169:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-06-08T04:02:46.689 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2023-06-08T04:02:46.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:46.690 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-08T04:02:46.747 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:02:46.748 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:46.794 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:02:46.794 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:46.879 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:02:46.879 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:46.966 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:47.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.200+0000 7fa280fff700 1 Processor -- start 2023-06-08T04:02:47.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.201+0000 7fa280fff700 1 -- start start 2023-06-08T04:02:47.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.202+0000 7fa280fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa27c160a60 0x7fa27c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:47.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.202+0000 7fa280fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa27c0b4b50 0x7fa27c0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:47.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.202+0000 7fa280fff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27c0d0800 con 0x7fa27c0b83f0 2023-06-08T04:02:47.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.202+0000 7fa280fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c160ed0 con 0x7fa27c160a60 2023-06-08T04:02:47.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.202+0000 7fa280fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0b4fd0 con 0x7fa27c0b4b50 2023-06-08T04:02:47.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.202+0000 7fa273fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa27c160a60 0x7fa27c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:47.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.202+0000 7fa273fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa27c160a60 0x7fa27c0b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45320/0 (socket says 172.21.15.16:45320) 2023-06-08T04:02:47.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.202+0000 7fa273fff700 1 -- 172.21.15.16:0/644510622 learned_addr learned my addr 172.21.15.16:0/644510622 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:47.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.202+0000 7fa27ad9d700 1 --2- 172.21.15.16:0/644510622 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa27c0b4b50 0x7fa27c0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:47.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.203+0000 7fa273fff700 1 -- 172.21.15.16:0/644510622 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa27c0b4b50 msgr2=0x7fa27c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:47.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.203+0000 7fa273fff700 1 --2- 172.21.15.16:0/644510622 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa27c0b4b50 0x7fa27c0d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.203+0000 7fa273fff700 1 -- 172.21.15.16:0/644510622 >> v1:172.21.15.169:6789/0 conn(0x7fa27c0b83f0 legacy=0x7fa27c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.203+0000 7fa273fff700 1 -- 172.21.15.16:0/644510622 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c0cd1e0 con 0x7fa27c160a60 2023-06-08T04:02:47.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.203+0000 7fa273fff700 1 --2- 172.21.15.16:0/644510622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa27c160a60 0x7fa27c0b4610 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa2640098f0 tx=0x7fa264009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4822bd3ca11f439 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:47.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.203+0000 7fa279d9b700 1 -- 172.21.15.16:0/644510622 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264011830 con 0x7fa27c160a60 2023-06-08T04:02:47.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.203+0000 7fa279d9b700 1 -- 172.21.15.16:0/644510622 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264011990 con 0x7fa27c160a60 2023-06-08T04:02:47.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.203+0000 7fa279d9b700 1 -- 172.21.15.16:0/644510622 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264011d20 con 0x7fa27c160a60 2023-06-08T04:02:47.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.204+0000 7fa280fff700 1 -- 172.21.15.16:0/644510622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa27c160a60 msgr2=0x7fa27c0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.204+0000 7fa280fff700 1 --2- 172.21.15.16:0/644510622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa27c160a60 0x7fa27c0b4610 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa2640098f0 tx=0x7fa264009c00 comp rx=0 tx=0).stop 2023-06-08T04:02:47.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.204+0000 7fa280fff700 1 -- 172.21.15.16:0/644510622 shutdown_connections 2023-06-08T04:02:47.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.204+0000 7fa280fff700 1 --2- 172.21.15.16:0/644510622 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa27c0b4b50 0x7fa27c0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.204+0000 7fa280fff700 1 --2- 172.21.15.16:0/644510622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa27c160a60 0x7fa27c0b4610 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.204+0000 7fa280fff700 1 -- 172.21.15.16:0/644510622 >> 172.21.15.16:0/644510622 conn(0x7fa27c0cf610 msgr2=0x7fa27c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:47.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.204+0000 7fa280fff700 1 -- 172.21.15.16:0/644510622 shutdown_connections 2023-06-08T04:02:47.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.204+0000 7fa280fff700 1 -- 172.21.15.16:0/644510622 wait complete. 2023-06-08T04:02:47.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.206+0000 7fa280fff700 1 Processor -- start 2023-06-08T04:02:47.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.206+0000 7fa280fff700 1 -- start start 2023-06-08T04:02:47.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa280fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa27c0b4b50 0x7fa27c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:47.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa280fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa27c0b83f0 0x7fa27c0c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:47.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa280fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa27c160a60 0x7fa27c0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:47.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa280fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0ca010 con 0x7fa27c160a60 2023-06-08T04:02:47.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa280fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0cca80 con 0x7fa27c0b4b50 2023-06-08T04:02:47.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa280fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0cc7a0 con 0x7fa27c0b83f0 2023-06-08T04:02:47.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa27ad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa27c160a60 0x7fa27c0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:47.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa27ad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa27c160a60 0x7fa27c0c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45324/0 (socket says 172.21.15.16:45324) 2023-06-08T04:02:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa27ad9d700 1 -- 172.21.15.16:0/942371563 learned_addr learned my addr 172.21.15.16:0/942371563 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa273fff700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa27c0b83f0 0x7fa27c0c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa27a59c700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa27c0b4b50 0x7fa27c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa27ad9d700 1 -- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa27c0b83f0 msgr2=0x7fa27c0c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa27ad9d700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa27c0b83f0 0x7fa27c0c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa27ad9d700 1 -- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa27c0b4b50 msgr2=0x7fa27c0b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa27ad9d700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa27c0b4b50 0x7fa27c0b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.207+0000 7fa27ad9d700 1 -- 172.21.15.16:0/942371563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa264009550 con 0x7fa27c160a60 2023-06-08T04:02:47.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.208+0000 7fa27ad9d700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa27c160a60 0x7fa27c0c8aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa27400efc0 tx=0x7fa27400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:47.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.208+0000 7fa272ffd700 1 -- 172.21.15.16:0/942371563 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa274009ea0 con 0x7fa27c160a60 2023-06-08T04:02:47.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.208+0000 7fa272ffd700 1 -- 172.21.15.16:0/942371563 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27400f040 con 0x7fa27c160a60 2023-06-08T04:02:47.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.208+0000 7fa280fff700 1 -- 172.21.15.16:0/942371563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27c149c30 con 0x7fa27c160a60 2023-06-08T04:02:47.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.208+0000 7fa272ffd700 1 -- 172.21.15.16:0/942371563 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400ced0 con 0x7fa27c160a60 2023-06-08T04:02:47.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.208+0000 7fa280fff700 1 -- 172.21.15.16:0/942371563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c14a1f0 con 0x7fa27c160a60 2023-06-08T04:02:47.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.209+0000 7fa280fff700 1 -- 172.21.15.16:0/942371563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27c0740e0 con 0x7fa27c160a60 2023-06-08T04:02:47.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.210+0000 7fa272ffd700 1 -- 172.21.15.16:0/942371563 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa274014480 con 0x7fa27c160a60 2023-06-08T04:02:47.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.211+0000 7fa272ffd700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa25c06ace0 0x7fa25c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:47.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.211+0000 7fa272ffd700 1 -- 172.21.15.16:0/942371563 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa274089d80 con 0x7fa27c160a60 2023-06-08T04:02:47.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.211+0000 7fa27a59c700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa25c06ace0 0x7fa25c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:47.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.212+0000 7fa27a59c700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa25c06ace0 0x7fa25c06d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa26c007fd0 tx=0x7fa26c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:47.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.216+0000 7fa272ffd700 1 -- 172.21.15.16:0/942371563 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa274054d50 con 0x7fa27c160a60 2023-06-08T04:02:47.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.421+0000 7fa280fff700 1 -- 172.21.15.16:0/942371563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa27c14a3e0 con 0x7fa27c160a60 2023-06-08T04:02:47.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.423+0000 7fa272ffd700 1 -- 172.21.15.16:0/942371563 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18293 (secure 0 0 0) 0x7fa274018090 con 0x7fa27c160a60 2023-06-08T04:02:47.428 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:47.428 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:02:45.925594+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.26","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.425+0000 7fa280fff700 1 -- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa25c06ace0 msgr2=0x7fa25c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.425+0000 7fa280fff700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa25c06ace0 0x7fa25c06d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa26c007fd0 tx=0x7fa26c009040 comp rx=0 tx=0).stop 2023-06-08T04:02:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.425+0000 7fa280fff700 1 -- 172.21.15.16:0/942371563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa27c160a60 msgr2=0x7fa27c0c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.425+0000 7fa280fff700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa27c160a60 0x7fa27c0c8aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa27400efc0 tx=0x7fa27400c3a0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.425+0000 7fa280fff700 1 -- 172.21.15.16:0/942371563 shutdown_connections 2023-06-08T04:02:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.425+0000 7fa280fff700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa25c06ace0 0x7fa25c06d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.425+0000 7fa280fff700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa27c160a60 0x7fa27c0c8aa0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.425+0000 7fa280fff700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa27c0b4b50 0x7fa27c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.425+0000 7fa280fff700 1 --2- 172.21.15.16:0/942371563 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa27c0b83f0 0x7fa27c0c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.425+0000 7fa280fff700 1 -- 172.21.15.16:0/942371563 >> 172.21.15.16:0/942371563 conn(0x7fa27c0cf610 msgr2=0x7fa27c0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:47.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.425+0000 7fa280fff700 1 -- 172.21.15.16:0/942371563 shutdown_connections 2023-06-08T04:02:47.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.426+0000 7fa280fff700 1 -- 172.21.15.16:0/942371563 wait complete. 2023-06-08T04:02:47.448 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:01:54.980592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:01:56.264608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:02:47.449 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:02:47.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.647+0000 7f77321ff700 1 Processor -- start 2023-06-08T04:02:47.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.648+0000 7f77321ff700 1 -- start start 2023-06-08T04:02:47.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.649+0000 7f77321ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f772c0b4d20 0x7f772c167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:47.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.649+0000 7f77321ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c0d0800 con 0x7f772c0b83f0 2023-06-08T04:02:47.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.649+0000 7f77321ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c0cd1e0 con 0x7f772c160a60 2023-06-08T04:02:47.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.649+0000 7f77321ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772c160ed0 con 0x7f772c0b4d20 2023-06-08T04:02:47.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.649+0000 7f772b7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f772c0b83f0 0x7f772c0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34394/0 (socket says 172.21.15.16:34394) 2023-06-08T04:02:47.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.649+0000 7f772b7fe700 1 -- 172.21.15.16:0/4124934446 learned_addr learned my addr 172.21.15.16:0/4124934446 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.649+0000 7f772bfff700 1 --2- 172.21.15.16:0/4124934446 >> v2:172.21.15.169:3300/0 conn(0x7f772c0b4d20 0x7f772c167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.650+0000 7f772affd700 1 -- 172.21.15.16:0/4124934446 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639709637 0 0) 0x7f772c0d0800 con 0x7f772c0b83f0 2023-06-08T04:02:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.650+0000 7f772affd700 1 -- 172.21.15.16:0/4124934446 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77180035b0 con 0x7f772c0b83f0 2023-06-08T04:02:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.650+0000 7f772affd700 1 -- 172.21.15.16:0/4124934446 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054124588 0 0) 0x7f772c0cd1e0 con 0x7f772c160a60 2023-06-08T04:02:47.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.650+0000 7f772affd700 1 -- 172.21.15.16:0/4124934446 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f772c0d0800 con 0x7f772c160a60 2023-06-08T04:02:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.650+0000 7f772bfff700 1 -- 172.21.15.16:0/4124934446 >> v1:172.21.15.169:6789/0 conn(0x7f772c160a60 legacy=0x7f772c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.650+0000 7f772affd700 1 -- 172.21.15.16:0/4124934446 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 218851408 0 0) 0x7f77180035b0 con 0x7f772c0b83f0 2023-06-08T04:02:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.650+0000 7f772bfff700 1 -- 172.21.15.16:0/4124934446 >> v1:172.21.15.16:6789/0 conn(0x7f772c0b83f0 legacy=0x7f772c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.650+0000 7f772bfff700 1 -- 172.21.15.16:0/4124934446 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c0cd4c0 con 0x7f772c0b4d20 2023-06-08T04:02:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.650+0000 7f772bfff700 1 --2- 172.21.15.16:0/4124934446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c0b4d20 0x7f772c167260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7724009d90 tx=0x7f772400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e4098444cd5c29 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:47.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.651+0000 7f772affd700 1 -- 172.21.15.16:0/4124934446 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400e070 con 0x7f772c0b4d20 2023-06-08T04:02:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.651+0000 7f772affd700 1 -- 172.21.15.16:0/4124934446 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7724003a20 con 0x7f772c0b4d20 2023-06-08T04:02:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.651+0000 7f772affd700 1 -- 172.21.15.16:0/4124934446 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c001670 con 0x7f772c0b4d20 2023-06-08T04:02:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.651+0000 7f77321ff700 1 -- 172.21.15.16:0/4124934446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c0b4d20 msgr2=0x7f772c167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.651+0000 7f77321ff700 1 --2- 172.21.15.16:0/4124934446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c0b4d20 0x7f772c167260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7724009d90 tx=0x7f772400b330 comp rx=0 tx=0).stop 2023-06-08T04:02:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.651+0000 7f77321ff700 1 -- 172.21.15.16:0/4124934446 shutdown_connections 2023-06-08T04:02:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.651+0000 7f77321ff700 1 --2- 172.21.15.16:0/4124934446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c0b4d20 0x7f772c167260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.651+0000 7f77321ff700 1 -- 172.21.15.16:0/4124934446 >> 172.21.15.16:0/4124934446 conn(0x7f772c0cf610 msgr2=0x7f772c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.651+0000 7f77321ff700 1 -- 172.21.15.16:0/4124934446 shutdown_connections 2023-06-08T04:02:47.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.651+0000 7f77321ff700 1 -- 172.21.15.16:0/4124934446 wait complete. 2023-06-08T04:02:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.653+0000 7f77321ff700 1 Processor -- start 2023-06-08T04:02:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.653+0000 7f77321ff700 1 -- start start 2023-06-08T04:02:47.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.654+0000 7f77321ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c0b4d20 0x7f772c0cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.654+0000 7f77321ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f772c0b83f0 0x7f772c1e6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.654+0000 7f77321ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f772c160a60 0x7f772c15ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.654+0000 7f77321ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c1e7df0 con 0x7f772c0b83f0 2023-06-08T04:02:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.654+0000 7f77321ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c1e7170 con 0x7f772c0b4d20 2023-06-08T04:02:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.654+0000 7f77321ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c1e7450 con 0x7f772c160a60 2023-06-08T04:02:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.655+0000 7f7723fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f772c0b83f0 0x7f772c1e6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:47.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.655+0000 7f7723fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f772c0b83f0 0x7f772c1e6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45334/0 (socket says 172.21.15.16:45334) 2023-06-08T04:02:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.655+0000 7f7723fff700 1 -- 172.21.15.16:0/1951010101 learned_addr learned my addr 172.21.15.16:0/1951010101 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.655+0000 7f772b7fe700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c0b4d20 0x7f772c0cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.655+0000 7f772bfff700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f772c160a60 0x7f772c15ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.655+0000 7f7723fff700 1 -- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f772c160a60 msgr2=0x7f772c15ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.655+0000 7f7723fff700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f772c160a60 0x7f772c15ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.655+0000 7f7723fff700 1 -- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c0b4d20 msgr2=0x7f772c0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.655+0000 7f7723fff700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c0b4d20 0x7f772c0cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.655+0000 7f7723fff700 1 -- 172.21.15.16:0/1951010101 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7724009a70 con 0x7f772c0b83f0 2023-06-08T04:02:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.655+0000 7f7723fff700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f772c0b83f0 0x7f772c1e6720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f771400c520 tx=0x7f771400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.656+0000 7f7728ff9700 1 -- 172.21.15.16:0/1951010101 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77140052d0 con 0x7f772c0b83f0 2023-06-08T04:02:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.656+0000 7f7728ff9700 1 -- 172.21.15.16:0/1951010101 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7714005430 con 0x7f772c0b83f0 2023-06-08T04:02:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.656+0000 7f77321ff700 1 -- 172.21.15.16:0/1951010101 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c1e7730 con 0x7f772c0b83f0 2023-06-08T04:02:47.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.656+0000 7f7728ff9700 1 -- 172.21.15.16:0/1951010101 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77140038c0 con 0x7f772c0b83f0 2023-06-08T04:02:47.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.656+0000 7f77321ff700 1 -- 172.21.15.16:0/1951010101 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c1f1b90 con 0x7f772c0b83f0 2023-06-08T04:02:47.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.657+0000 7f77321ff700 1 -- 172.21.15.16:0/1951010101 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c0740e0 con 0x7f772c0b83f0 2023-06-08T04:02:47.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.658+0000 7f7728ff9700 1 -- 172.21.15.16:0/1951010101 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7714003a20 con 0x7f772c0b83f0 2023-06-08T04:02:47.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.659+0000 7f7728ff9700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f770c06ace0 0x7f770c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:47.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.659+0000 7f7728ff9700 1 -- 172.21.15.16:0/1951010101 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7714088960 con 0x7f772c0b83f0 2023-06-08T04:02:47.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.659+0000 7f772b7fe700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f770c06ace0 0x7f770c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:47.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.660+0000 7f772b7fe700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f770c06ace0 0x7f770c06d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f771c0011e0 tx=0x7f771c000ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:47.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.663+0000 7f7728ff9700 1 -- 172.21.15.16:0/1951010101 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f77140539e0 con 0x7f772c0b83f0 2023-06-08T04:02:47.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.869+0000 7f77321ff700 1 -- 172.21.15.16:0/1951010101 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f772c0d0a80 con 0x7f772c0b83f0 2023-06-08T04:02:47.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.870+0000 7f7728ff9700 1 -- 172.21.15.16:0/1951010101 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f772c0d0a80 con 0x7f772c0b83f0 2023-06-08T04:02:47.875 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:02:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 -- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f770c06ace0 msgr2=0x7f770c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f770c06ace0 0x7f770c06d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f771c0011e0 tx=0x7f771c000ed0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 -- 172.21.15.16:0/1951010101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f772c0b83f0 msgr2=0x7f772c1e6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f772c0b83f0 0x7f772c1e6720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f771400c520 tx=0x7f771400c830 comp rx=0 tx=0).stop 2023-06-08T04:02:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 -- 172.21.15.16:0/1951010101 shutdown_connections 2023-06-08T04:02:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f770c06ace0 0x7f770c06d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f772c160a60 0x7f772c15ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f772c0b4d20 0x7f772c0cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 --2- 172.21.15.16:0/1951010101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f772c0b83f0 0x7f772c1e6720 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:47.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 -- 172.21.15.16:0/1951010101 >> 172.21.15.16:0/1951010101 conn(0x7f772c0cf610 msgr2=0x7f772c0ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:47.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 -- 172.21.15.16:0/1951010101 shutdown_connections 2023-06-08T04:02:47.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:47.872+0000 7f77321ff700 1 -- 172.21.15.16:0/1951010101 wait complete. 2023-06-08T04:02:47.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:02:48.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.094+0000 7fc0091ff700 1 Processor -- start 2023-06-08T04:02:48.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.094+0000 7fc0091ff700 1 -- start start 2023-06-08T04:02:48.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.096+0000 7fc0091ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc0040c9d60 0x7fc0040ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.096+0000 7fc0091ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc004158c30 con 0x7fc004158860 2023-06-08T04:02:48.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.096+0000 7fc0091ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0040c98d0 con 0x7fc0040ccca0 2023-06-08T04:02:48.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.096+0000 7fc0091ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0040cd1d0 con 0x7fc0040c9d60 2023-06-08T04:02:48.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.096+0000 7fc002d9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc004158860 0x7fc004070c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34406/0 (socket says 172.21.15.16:34406) 2023-06-08T04:02:48.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.096+0000 7fc002d9d700 1 -- 172.21.15.16:0/3152719271 learned_addr learned my addr 172.21.15.16:0/3152719271 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:48.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.096+0000 7fc00359e700 1 --2- 172.21.15.16:0/3152719271 >> v2:172.21.15.169:3300/0 conn(0x7fc0040c9d60 0x7fc0040ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.096+0000 7fc00259c700 1 -- 172.21.15.16:0/3152719271 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578452635 0 0) 0x7fbff4001110 con 0x7fc004158860 2023-06-08T04:02:48.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.096+0000 7fc00259c700 1 -- 172.21.15.16:0/3152719271 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff00035b0 con 0x7fc004158860 2023-06-08T04:02:48.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.097+0000 7fc00259c700 1 -- 172.21.15.16:0/3152719271 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079268892 0 0) 0x7fc0040c98d0 con 0x7fc0040ccca0 2023-06-08T04:02:48.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.097+0000 7fc00259c700 1 -- 172.21.15.16:0/3152719271 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff4001110 con 0x7fc0040ccca0 2023-06-08T04:02:48.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.097+0000 7fc00359e700 1 -- 172.21.15.16:0/3152719271 >> v1:172.21.15.169:6789/0 conn(0x7fc0040ccca0 legacy=0x7fc00406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.097+0000 7fc00359e700 1 -- 172.21.15.16:0/3152719271 >> v1:172.21.15.16:6789/0 conn(0x7fc004158860 legacy=0x7fc004070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.097+0000 7fc00259c700 1 -- 172.21.15.16:0/3152719271 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1095882459 0 0) 0x7fbff00035b0 con 0x7fc004158860 2023-06-08T04:02:48.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.097+0000 7fc00359e700 1 -- 172.21.15.16:0/3152719271 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0040c8fa0 con 0x7fc0040c9d60 2023-06-08T04:02:48.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.097+0000 7fc00359e700 1 --2- 172.21.15.16:0/3152719271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0040c9d60 0x7fc0040ca1e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00aea0 tx=0x7fbffc00c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f938ff2a35105390 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:48.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.097+0000 7fc00259c700 1 -- 172.21.15.16:0/3152719271 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00a2d0 con 0x7fc0040c9d60 2023-06-08T04:02:48.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.097+0000 7fc00259c700 1 -- 172.21.15.16:0/3152719271 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc00c8b0 con 0x7fc0040c9d60 2023-06-08T04:02:48.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.097+0000 7fc00259c700 1 -- 172.21.15.16:0/3152719271 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00cc20 con 0x7fc0040c9d60 2023-06-08T04:02:48.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.098+0000 7fc0091ff700 1 -- 172.21.15.16:0/3152719271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0040c9d60 msgr2=0x7fc0040ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.098+0000 7fc0091ff700 1 --2- 172.21.15.16:0/3152719271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0040c9d60 0x7fc0040ca1e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00aea0 tx=0x7fbffc00c330 comp rx=0 tx=0).stop 2023-06-08T04:02:48.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.098+0000 7fc0091ff700 1 -- 172.21.15.16:0/3152719271 shutdown_connections 2023-06-08T04:02:48.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.098+0000 7fc0091ff700 1 --2- 172.21.15.16:0/3152719271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0040c9d60 0x7fc0040ca1e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.098+0000 7fc0091ff700 1 -- 172.21.15.16:0/3152719271 >> 172.21.15.16:0/3152719271 conn(0x7fc00406aa40 msgr2=0x7fc0040b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:48.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.098+0000 7fc0091ff700 1 -- 172.21.15.16:0/3152719271 shutdown_connections 2023-06-08T04:02:48.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.098+0000 7fc0091ff700 1 -- 172.21.15.16:0/3152719271 wait complete. 2023-06-08T04:02:48.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.100+0000 7fc0091ff700 1 Processor -- start 2023-06-08T04:02:48.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.100+0000 7fc0091ff700 1 -- start start 2023-06-08T04:02:48.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.101+0000 7fc0091ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0040c9d60 0x7fc0041545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.101+0000 7fc0091ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0040ccca0 0x7fc004159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.101+0000 7fc0091ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc004158860 0x7fc0041f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.101+0000 7fc0091ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00415a3c0 con 0x7fc004158860 2023-06-08T04:02:48.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.101+0000 7fc0091ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00415a6a0 con 0x7fc0040ccca0 2023-06-08T04:02:48.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.101+0000 7fc0091ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00415a980 con 0x7fc0040c9d60 2023-06-08T04:02:48.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.101+0000 7fc00359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc004158860 0x7fc0041f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.101+0000 7fc00359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc004158860 0x7fc0041f1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45340/0 (socket says 172.21.15.16:45340) 2023-06-08T04:02:48.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.101+0000 7fc00359e700 1 -- 172.21.15.16:0/569529889 learned_addr learned my addr 172.21.15.16:0/569529889 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:48.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.101+0000 7fc002d9d700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0040c9d60 0x7fc0041545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.101+0000 7fbffbfff700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0040ccca0 0x7fc004159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.102+0000 7fc00359e700 1 -- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0040c9d60 msgr2=0x7fc0041545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.102+0000 7fc00359e700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0040c9d60 0x7fc0041545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.102+0000 7fc00359e700 1 -- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0040ccca0 msgr2=0x7fc004159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.102+0000 7fc00359e700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0040ccca0 0x7fc004159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.102+0000 7fc00359e700 1 -- 172.21.15.16:0/569529889 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc00ab80 con 0x7fc004158860 2023-06-08T04:02:48.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.102+0000 7fc00359e700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc004158860 0x7fc0041f1400 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc004072270 tx=0x7fbffc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:48.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.102+0000 7fbffb7fe700 1 -- 172.21.15.16:0/569529889 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc008850 con 0x7fc004158860 2023-06-08T04:02:48.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.102+0000 7fbffb7fe700 1 -- 172.21.15.16:0/569529889 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc00ce90 con 0x7fc004158860 2023-06-08T04:02:48.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.102+0000 7fc0091ff700 1 -- 172.21.15.16:0/569529889 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0040af3a0 con 0x7fc004158860 2023-06-08T04:02:48.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.102+0000 7fbffb7fe700 1 -- 172.21.15.16:0/569529889 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc008bf0 con 0x7fc004158860 2023-06-08T04:02:48.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.102+0000 7fc0091ff700 1 -- 172.21.15.16:0/569529889 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc004154b10 con 0x7fc004158860 2023-06-08T04:02:48.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.103+0000 7fc0091ff700 1 -- 172.21.15.16:0/569529889 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0040740e0 con 0x7fc004158860 2023-06-08T04:02:48.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.104+0000 7fbffb7fe700 1 -- 172.21.15.16:0/569529889 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbffc011070 con 0x7fc004158860 2023-06-08T04:02:48.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.106+0000 7fbffb7fe700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfe406ace0 0x7fbfe406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.106+0000 7fbffb7fe700 1 -- 172.21.15.16:0/569529889 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbffc08a650 con 0x7fc004158860 2023-06-08T04:02:48.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.106+0000 7fc002d9d700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfe406ace0 0x7fbfe406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.107+0000 7fc002d9d700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfe406ace0 0x7fbfe406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbff4007ad0 tx=0x7fbff4007a20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:48.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.110+0000 7fbffb7fe700 1 -- 172.21.15.16:0/569529889 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbffc0556b0 con 0x7fc004158860 2023-06-08T04:02:48.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.313+0000 7fc0091ff700 1 -- 172.21.15.16:0/569529889 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0040af8c0 con 0x7fc004158860 2023-06-08T04:02:48.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.314+0000 7fbffb7fe700 1 -- 172.21.15.16:0/569529889 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0040af8c0 con 0x7fc004158860 2023-06-08T04:02:48.319 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:02:48.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 -- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfe406ace0 msgr2=0x7fbfe406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfe406ace0 0x7fbfe406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbff4007ad0 tx=0x7fbff4007a20 comp rx=0 tx=0).stop 2023-06-08T04:02:48.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 -- 172.21.15.16:0/569529889 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc004158860 msgr2=0x7fc0041f1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc004158860 0x7fc0041f1400 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc004072270 tx=0x7fbffc004ad0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 -- 172.21.15.16:0/569529889 shutdown_connections 2023-06-08T04:02:48.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbfe406ace0 0x7fbfe406d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc004158860 0x7fc0041f1400 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0040c9d60 0x7fc0041545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 --2- 172.21.15.16:0/569529889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0040ccca0 0x7fc004159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 -- 172.21.15.16:0/569529889 >> 172.21.15.16:0/569529889 conn(0x7fc00406aa40 msgr2=0x7fc004155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:48.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 -- 172.21.15.16:0/569529889 shutdown_connections 2023-06-08T04:02:48.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.316+0000 7fc0091ff700 1 -- 172.21.15.16:0/569529889 wait complete. 2023-06-08T04:02:48.339 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:02:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.538+0000 7faa44fff700 1 Processor -- start 2023-06-08T04:02:48.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.538+0000 7faa44fff700 1 -- start start 2023-06-08T04:02:48.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.539+0000 7faa44fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b83f0 0x7faa40160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.539+0000 7faa44fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faa400ced40 0x7faa400b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.539+0000 7faa44fff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa400d0800 con 0x7faa400b4b50 2023-06-08T04:02:48.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.539+0000 7faa44fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa400b4fd0 con 0x7faa400ced40 2023-06-08T04:02:48.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.539+0000 7faa44fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa400cd1e0 con 0x7faa400b83f0 2023-06-08T04:02:48.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.540+0000 7faa3dd9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faa400ced40 0x7faa400b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.540+0000 7faa3dd9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faa400ced40 0x7faa400b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45346/0 (socket says 172.21.15.16:45346) 2023-06-08T04:02:48.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.540+0000 7faa3dd9b700 1 -- 172.21.15.16:0/1868149757 learned_addr learned my addr 172.21.15.16:0/1868149757 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:48.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.540+0000 7faa3e59c700 1 --2- 172.21.15.16:0/1868149757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b83f0 0x7faa40160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.540+0000 7faa3dd9b700 1 -- 172.21.15.16:0/1868149757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b83f0 msgr2=0x7faa40160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:48.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.540+0000 7faa3dd9b700 1 --2- 172.21.15.16:0/1868149757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b83f0 0x7faa40160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.540+0000 7faa3dd9b700 1 -- 172.21.15.16:0/1868149757 >> v1:172.21.15.169:6789/0 conn(0x7faa400b4b50 legacy=0x7faa4006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.540+0000 7faa3dd9b700 1 -- 172.21.15.16:0/1868149757 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400cd4c0 con 0x7faa400ced40 2023-06-08T04:02:48.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.540+0000 7faa3e59c700 1 --2- 172.21.15.16:0/1868149757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b83f0 0x7faa40160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:48.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.541+0000 7faa3dd9b700 1 --2- 172.21.15.16:0/1868149757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa400ced40 0x7faa400b4610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faa340098f0 tx=0x7faa34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f2869cc8fda7ef server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:48.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.541+0000 7faa3d59a700 1 -- 172.21.15.16:0/1868149757 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3400b8a0 con 0x7faa400ced40 2023-06-08T04:02:48.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.541+0000 7faa3d59a700 1 -- 172.21.15.16:0/1868149757 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3400ba00 con 0x7faa400ced40 2023-06-08T04:02:48.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.541+0000 7faa3d59a700 1 -- 172.21.15.16:0/1868149757 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3400bd90 con 0x7faa400ced40 2023-06-08T04:02:48.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.541+0000 7faa44fff700 1 -- 172.21.15.16:0/1868149757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa400ced40 msgr2=0x7faa400b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.541+0000 7faa44fff700 1 --2- 172.21.15.16:0/1868149757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa400ced40 0x7faa400b4610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faa340098f0 tx=0x7faa34009c00 comp rx=0 tx=0).stop 2023-06-08T04:02:48.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.541+0000 7faa44fff700 1 -- 172.21.15.16:0/1868149757 shutdown_connections 2023-06-08T04:02:48.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.541+0000 7faa44fff700 1 --2- 172.21.15.16:0/1868149757 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b83f0 0x7faa40160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.541+0000 7faa44fff700 1 --2- 172.21.15.16:0/1868149757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa400ced40 0x7faa400b4610 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.541+0000 7faa44fff700 1 -- 172.21.15.16:0/1868149757 >> 172.21.15.16:0/1868149757 conn(0x7faa400cf610 msgr2=0x7faa400cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:48.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.541+0000 7faa44fff700 1 -- 172.21.15.16:0/1868149757 shutdown_connections 2023-06-08T04:02:48.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.542+0000 7faa44fff700 1 -- 172.21.15.16:0/1868149757 wait complete. 2023-06-08T04:02:48.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.543+0000 7faa44fff700 1 Processor -- start 2023-06-08T04:02:48.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.543+0000 7faa44fff700 1 -- start start 2023-06-08T04:02:48.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.544+0000 7faa44fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b4b50 0x7faa400c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.544+0000 7faa44fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa400b83f0 0x7faa400ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.544+0000 7faa44fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa400ced40 0x7faa401e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.544+0000 7faa44fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa400c91f0 con 0x7faa400b83f0 2023-06-08T04:02:48.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.544+0000 7faa44fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa40146780 con 0x7faa400ced40 2023-06-08T04:02:48.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.544+0000 7faa44fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa400caa10 con 0x7faa400b4b50 2023-06-08T04:02:48.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3dd9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa400b83f0 0x7faa400ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3dd9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa400b83f0 0x7faa400ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45360/0 (socket says 172.21.15.16:45360) 2023-06-08T04:02:48.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3dd9b700 1 -- 172.21.15.16:0/3677518927 learned_addr learned my addr 172.21.15.16:0/3677518927 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:48.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3e59c700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b4b50 0x7faa400c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3ed9d700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa400ced40 0x7faa401e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3dd9b700 1 -- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b4b50 msgr2=0x7faa400c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3dd9b700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b4b50 0x7faa400c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3dd9b700 1 -- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa400ced40 msgr2=0x7faa401e5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3dd9b700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa400ced40 0x7faa401e5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3dd9b700 1 -- 172.21.15.16:0/3677518927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa34009550 con 0x7faa400b83f0 2023-06-08T04:02:48.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3e59c700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b4b50 0x7faa400c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:48.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.545+0000 7faa3dd9b700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa400b83f0 0x7faa400ca1c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faa34009c40 tx=0x7faa34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:48.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.546+0000 7faa2effd700 1 -- 172.21.15.16:0/3677518927 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340036a0 con 0x7faa400b83f0 2023-06-08T04:02:48.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.546+0000 7faa2effd700 1 -- 172.21.15.16:0/3677518927 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3401e070 con 0x7faa400b83f0 2023-06-08T04:02:48.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.546+0000 7faa2effd700 1 -- 172.21.15.16:0/3677518927 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34003a60 con 0x7faa400b83f0 2023-06-08T04:02:48.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.546+0000 7faa44fff700 1 -- 172.21.15.16:0/3677518927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa400cacf0 con 0x7faa400b83f0 2023-06-08T04:02:48.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.546+0000 7faa44fff700 1 -- 172.21.15.16:0/3677518927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa400cb2b0 con 0x7faa400b83f0 2023-06-08T04:02:48.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.547+0000 7faa44fff700 1 -- 172.21.15.16:0/3677518927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa400b4600 con 0x7faa400b83f0 2023-06-08T04:02:48.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.548+0000 7faa2effd700 1 -- 172.21.15.16:0/3677518927 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faa34003bc0 con 0x7faa400b83f0 2023-06-08T04:02:48.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.549+0000 7faa2effd700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faa2006ace0 0x7faa2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.549+0000 7faa2effd700 1 -- 172.21.15.16:0/3677518927 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7faa34020070 con 0x7faa400b83f0 2023-06-08T04:02:48.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.549+0000 7faa3e59c700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faa2006ace0 0x7faa2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.550+0000 7faa3e59c700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faa2006ace0 0x7faa2006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa401498a0 tx=0x7faa30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:48.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.553+0000 7faa2effd700 1 -- 172.21.15.16:0/3677518927 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faa34055a50 con 0x7faa400b83f0 2023-06-08T04:02:48.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.761+0000 7faa44fff700 1 -- 172.21.15.16:0/3677518927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa400740e0 con 0x7faa400b83f0 2023-06-08T04:02:48.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.761+0000 7faa2effd700 1 -- 172.21.15.16:0/3677518927 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa34059070 con 0x7faa400b83f0 2023-06-08T04:02:48.766 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:02:48.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 -- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faa2006ace0 msgr2=0x7faa2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faa2006ace0 0x7faa2006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa401498a0 tx=0x7faa30008040 comp rx=0 tx=0).stop 2023-06-08T04:02:48.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 -- 172.21.15.16:0/3677518927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa400b83f0 msgr2=0x7faa400ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa400b83f0 0x7faa400ca1c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faa34009c40 tx=0x7faa34004750 comp rx=0 tx=0).stop 2023-06-08T04:02:48.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 -- 172.21.15.16:0/3677518927 shutdown_connections 2023-06-08T04:02:48.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faa2006ace0 0x7faa2006d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa400ced40 0x7faa401e5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faa400b4b50 0x7faa400c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 --2- 172.21.15.16:0/3677518927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa400b83f0 0x7faa400ca1c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 -- 172.21.15.16:0/3677518927 >> 172.21.15.16:0/3677518927 conn(0x7faa400cf610 msgr2=0x7faa4015a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:48.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 -- 172.21.15.16:0/3677518927 shutdown_connections 2023-06-08T04:02:48.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.764+0000 7faa44fff700 1 -- 172.21.15.16:0/3677518927 wait complete. 2023-06-08T04:02:48.786 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:02:48.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.987+0000 7fa84d5ff700 1 Processor -- start 2023-06-08T04:02:48.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.988+0000 7fa84d5ff700 1 -- start start 2023-06-08T04:02:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa84d5ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa848160a60 0x7fa8480b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa84d5ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa8480b4b50 0x7fa8480d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa84d5ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8480d0800 con 0x7fa8480b83f0 2023-06-08T04:02:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa84d5ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa848160ed0 con 0x7fa848160a60 2023-06-08T04:02:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa84d5ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480b4fd0 con 0x7fa8480b4b50 2023-06-08T04:02:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa8467fc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa848160a60 0x7fa8480b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa846ffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa8480b83f0 0x7fa8480ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34410/0 (socket says 172.21.15.16:34410) 2023-06-08T04:02:48.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa846ffd700 1 -- 172.21.15.16:0/1022493578 learned_addr learned my addr 172.21.15.16:0/1022493578 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:48.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa8477fe700 1 --2- 172.21.15.16:0/1022493578 >> v2:172.21.15.169:3300/0 conn(0x7fa8480b4b50 0x7fa8480d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:48.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa8467fc700 1 -- 172.21.15.16:0/1022493578 >> v2:172.21.15.169:3300/0 conn(0x7fa8480b4b50 msgr2=0x7fa8480d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:48.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa8467fc700 1 --2- 172.21.15.16:0/1022493578 >> v2:172.21.15.169:3300/0 conn(0x7fa8480b4b50 0x7fa8480d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.989+0000 7fa8467fc700 1 -- 172.21.15.16:0/1022493578 >> v1:172.21.15.16:6789/0 conn(0x7fa8480b83f0 legacy=0x7fa8480ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.990+0000 7fa8467fc700 1 -- 172.21.15.16:0/1022493578 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480cd1e0 con 0x7fa848160a60 2023-06-08T04:02:48.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.990+0000 7fa8467fc700 1 --2- 172.21.15.16:0/1022493578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa848160a60 0x7fa8480b4610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa8480b2590 tx=0x7fa83c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfe3000b40e38ef server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:48.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.990+0000 7fa845ffb700 1 -- 172.21.15.16:0/1022493578 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c011830 con 0x7fa848160a60 2023-06-08T04:02:48.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.990+0000 7fa845ffb700 1 -- 172.21.15.16:0/1022493578 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c011990 con 0x7fa848160a60 2023-06-08T04:02:48.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.990+0000 7fa845ffb700 1 -- 172.21.15.16:0/1022493578 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c011d20 con 0x7fa848160a60 2023-06-08T04:02:48.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.991+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1022493578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa848160a60 msgr2=0x7fa8480b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:48.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.991+0000 7fa84d5ff700 1 --2- 172.21.15.16:0/1022493578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa848160a60 0x7fa8480b4610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa8480b2590 tx=0x7fa83c009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:48.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.991+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1022493578 shutdown_connections 2023-06-08T04:02:48.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.991+0000 7fa84d5ff700 1 --2- 172.21.15.16:0/1022493578 >> v2:172.21.15.169:3300/0 conn(0x7fa8480b4b50 0x7fa8480d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.991+0000 7fa84d5ff700 1 --2- 172.21.15.16:0/1022493578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa848160a60 0x7fa8480b4610 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:48.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.991+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1022493578 >> 172.21.15.16:0/1022493578 conn(0x7fa8480cf610 msgr2=0x7fa8480cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:48.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.991+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1022493578 shutdown_connections 2023-06-08T04:02:48.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.991+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1022493578 wait complete. 2023-06-08T04:02:48.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.992+0000 7fa84d5ff700 1 Processor -- start 2023-06-08T04:02:48.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.993+0000 7fa84d5ff700 1 -- start start 2023-06-08T04:02:48.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.993+0000 7fa84d5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8480b4b50 0x7fa8480c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:48.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.993+0000 7fa84d5ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8480b83f0 0x7fa84814ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:49.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa84d5ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa848160a60 0x7fa84814f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:49.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa84d5ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480ca410 con 0x7fa848160a60 2023-06-08T04:02:49.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa84d5ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480c93f0 con 0x7fa8480b83f0 2023-06-08T04:02:49.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa84d5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480c96d0 con 0x7fa8480b4b50 2023-06-08T04:02:49.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa8477fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa848160a60 0x7fa84814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:49.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa8477fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa848160a60 0x7fa84814f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45378/0 (socket says 172.21.15.16:45378) 2023-06-08T04:02:49.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa8477fe700 1 -- 172.21.15.16:0/1865235209 learned_addr learned my addr 172.21.15.16:0/1865235209 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:49.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa846ffd700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8480b4b50 0x7fa8480c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:49.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa8467fc700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8480b83f0 0x7fa84814ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:49.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa8477fe700 1 -- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8480b4b50 msgr2=0x7fa8480c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:49.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa8477fe700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8480b4b50 0x7fa8480c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa8477fe700 1 -- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8480b83f0 msgr2=0x7fa84814ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:49.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa8477fe700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8480b83f0 0x7fa84814ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.994+0000 7fa8477fe700 1 -- 172.21.15.16:0/1865235209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0094a0 con 0x7fa848160a60 2023-06-08T04:02:49.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.995+0000 7fa8477fe700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa848160a60 0x7fa84814f190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa840007e40 tx=0x7fa84000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:49.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.995+0000 7fa82f7fe700 1 -- 172.21.15.16:0/1865235209 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84000eea0 con 0x7fa848160a60 2023-06-08T04:02:49.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.995+0000 7fa82f7fe700 1 -- 172.21.15.16:0/1865235209 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa840014420 con 0x7fa848160a60 2023-06-08T04:02:49.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.995+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1865235209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8480c99b0 con 0x7fa848160a60 2023-06-08T04:02:49.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.995+0000 7fa82f7fe700 1 -- 172.21.15.16:0/1865235209 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8400147b0 con 0x7fa848160a60 2023-06-08T04:02:49.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.995+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1865235209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8480c6c70 con 0x7fa848160a60 2023-06-08T04:02:49.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.996+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1865235209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8480740e0 con 0x7fa848160a60 2023-06-08T04:02:49.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.997+0000 7fa82f7fe700 1 -- 172.21.15.16:0/1865235209 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa840014910 con 0x7fa848160a60 2023-06-08T04:02:49.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.998+0000 7fa82f7fe700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa83406ace0 0x7fa83406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:49.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.998+0000 7fa82f7fe700 1 -- 172.21.15.16:0/1865235209 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa840089da0 con 0x7fa848160a60 2023-06-08T04:02:49.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.999+0000 7fa846ffd700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa83406ace0 0x7fa83406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:49.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:48.999+0000 7fa846ffd700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa83406ace0 0x7fa83406d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa838005910 tx=0x7fa838009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:49.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.003+0000 7fa82f7fe700 1 -- 172.21.15.16:0/1865235209 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa840054d70 con 0x7fa848160a60 2023-06-08T04:02:49.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.208+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1865235209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8480c6460 con 0x7fa848160a60 2023-06-08T04:02:49.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.208+0000 7fa82f7fe700 1 -- 172.21.15.16:0/1865235209 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa840058390 con 0x7fa848160a60 2023-06-08T04:02:49.213 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:02:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.210+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa83406ace0 msgr2=0x7fa83406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.210+0000 7fa84d5ff700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa83406ace0 0x7fa83406d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa838005910 tx=0x7fa838009040 comp rx=0 tx=0).stop 2023-06-08T04:02:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.210+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1865235209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa848160a60 msgr2=0x7fa84814f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.210+0000 7fa84d5ff700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa848160a60 0x7fa84814f190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa840007e40 tx=0x7fa84000e3c0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.210+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1865235209 shutdown_connections 2023-06-08T04:02:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.210+0000 7fa84d5ff700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa83406ace0 0x7fa83406d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.210+0000 7fa84d5ff700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa848160a60 0x7fa84814f190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.210+0000 7fa84d5ff700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8480b4b50 0x7fa8480c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.210+0000 7fa84d5ff700 1 --2- 172.21.15.16:0/1865235209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8480b83f0 0x7fa84814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.211+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1865235209 >> 172.21.15.16:0/1865235209 conn(0x7fa8480cf610 msgr2=0x7fa8480cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:49.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.211+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1865235209 shutdown_connections 2023-06-08T04:02:49.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.211+0000 7fa84d5ff700 1 -- 172.21.15.16:0/1865235209 wait complete. 2023-06-08T04:02:49.233 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T04:02:49.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.430+0000 7f5a6e1ff700 1 Processor -- start 2023-06-08T04:02:49.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.430+0000 7f5a6e1ff700 1 -- start start 2023-06-08T04:02:49.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.431+0000 7f5a6e1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a68160a60 0x7f5a680b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:49.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.431+0000 7f5a6e1ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5a680b4b50 0x7f5a680d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:49.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.431+0000 7f5a6e1ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a680d0800 con 0x7f5a680b83f0 2023-06-08T04:02:49.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.431+0000 7f5a6e1ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a68160ed0 con 0x7f5a680b4b50 2023-06-08T04:02:49.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.431+0000 7f5a6e1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680b4fd0 con 0x7f5a68160a60 2023-06-08T04:02:49.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.432+0000 7f5a677fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5a680b83f0 0x7f5a680ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34420/0 (socket says 172.21.15.16:34420) 2023-06-08T04:02:49.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.432+0000 7f5a677fe700 1 -- 172.21.15.16:0/1805487271 learned_addr learned my addr 172.21.15.16:0/1805487271 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:49.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.432+0000 7f5a66ffd700 1 --2- 172.21.15.16:0/1805487271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a68160a60 0x7f5a680b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:49.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.432+0000 7f5a67fff700 1 --2- 172.21.15.16:0/1805487271 >> v2:172.21.15.169:3300/0 conn(0x7f5a680b4b50 0x7f5a680d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:49.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.432+0000 7f5a667fc700 1 -- 172.21.15.16:0/1805487271 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750803303 0 0) 0x7f5a680d0800 con 0x7f5a680b83f0 2023-06-08T04:02:49.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.432+0000 7f5a667fc700 1 -- 172.21.15.16:0/1805487271 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a500035b0 con 0x7f5a680b83f0 2023-06-08T04:02:49.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.432+0000 7f5a667fc700 1 -- 172.21.15.16:0/1805487271 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766727368 0 0) 0x7f5a500035b0 con 0x7f5a680b83f0 2023-06-08T04:02:49.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.432+0000 7f5a66ffd700 1 -- 172.21.15.16:0/1805487271 >> v2:172.21.15.169:3300/0 conn(0x7f5a680b4b50 msgr2=0x7f5a680d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:49.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.432+0000 7f5a66ffd700 1 --2- 172.21.15.16:0/1805487271 >> v2:172.21.15.169:3300/0 conn(0x7f5a680b4b50 0x7f5a680d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.432+0000 7f5a66ffd700 1 -- 172.21.15.16:0/1805487271 >> v1:172.21.15.16:6789/0 conn(0x7f5a680b83f0 legacy=0x7f5a680ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:49.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.432+0000 7f5a66ffd700 1 -- 172.21.15.16:0/1805487271 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680cd1e0 con 0x7f5a68160a60 2023-06-08T04:02:49.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.433+0000 7f5a66ffd700 1 --2- 172.21.15.16:0/1805487271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a68160a60 0x7f5a680b4610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009840 tx=0x7f5a5c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea860e1ce3fcae15 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:49.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.433+0000 7f5a667fc700 1 -- 172.21.15.16:0/1805487271 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58001670 con 0x7f5a68160a60 2023-06-08T04:02:49.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.433+0000 7f5a667fc700 1 -- 172.21.15.16:0/1805487271 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c004030 con 0x7f5a68160a60 2023-06-08T04:02:49.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.433+0000 7f5a667fc700 1 -- 172.21.15.16:0/1805487271 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c0043a0 con 0x7f5a68160a60 2023-06-08T04:02:49.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.434+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/1805487271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a68160a60 msgr2=0x7f5a680b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:49.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.434+0000 7f5a6e1ff700 1 --2- 172.21.15.16:0/1805487271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a68160a60 0x7f5a680b4610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009840 tx=0x7f5a5c009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:49.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.434+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/1805487271 shutdown_connections 2023-06-08T04:02:49.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.434+0000 7f5a6e1ff700 1 --2- 172.21.15.16:0/1805487271 >> v2:172.21.15.169:3300/0 conn(0x7f5a680b4b50 0x7f5a680d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.434+0000 7f5a6e1ff700 1 --2- 172.21.15.16:0/1805487271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a68160a60 0x7f5a680b4610 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.434+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/1805487271 >> 172.21.15.16:0/1805487271 conn(0x7f5a680cf610 msgr2=0x7f5a680cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:49.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.434+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/1805487271 shutdown_connections 2023-06-08T04:02:49.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.434+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/1805487271 wait complete. 2023-06-08T04:02:49.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.435+0000 7f5a6e1ff700 1 Processor -- start 2023-06-08T04:02:49.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.436+0000 7f5a6e1ff700 1 -- start start 2023-06-08T04:02:49.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.436+0000 7f5a6e1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a680b4b50 0x7f5a680cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:49.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.436+0000 7f5a6e1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a680b83f0 0x7f5a680c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:49.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a6e1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a68160a60 0x7f5a680cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:49.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a6e1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6815f8d0 con 0x7f5a680b4b50 2023-06-08T04:02:49.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a6e1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680c8ed0 con 0x7f5a68160a60 2023-06-08T04:02:49.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a6e1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6815cf30 con 0x7f5a680b83f0 2023-06-08T04:02:49.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a677fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a680b4b50 0x7f5a680cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:49.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a677fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a680b4b50 0x7f5a680cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45380/0 (socket says 172.21.15.16:45380) 2023-06-08T04:02:49.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a677fe700 1 -- 172.21.15.16:0/3986095390 learned_addr learned my addr 172.21.15.16:0/3986095390 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:49.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a67fff700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a68160a60 0x7f5a680cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:49.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a66ffd700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a680b83f0 0x7f5a680c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:49.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a677fe700 1 -- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a680b83f0 msgr2=0x7f5a680c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:49.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a677fe700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a680b83f0 0x7f5a680c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a677fe700 1 -- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a68160a60 msgr2=0x7f5a680cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:49.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a677fe700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a68160a60 0x7f5a680cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a677fe700 1 -- 172.21.15.16:0/3986095390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c0094a0 con 0x7f5a680b4b50 2023-06-08T04:02:49.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a66ffd700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a680b83f0 0x7f5a680c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:49.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.437+0000 7f5a677fe700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a680b4b50 0x7f5a680cc730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800c550 tx=0x7f5a5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:49.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.438+0000 7f5a4ffff700 1 -- 172.21.15.16:0/3986095390 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58004c80 con 0x7f5a680b4b50 2023-06-08T04:02:49.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.438+0000 7f5a4ffff700 1 -- 172.21.15.16:0/3986095390 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a58004de0 con 0x7f5a680b4b50 2023-06-08T04:02:49.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.438+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/3986095390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6815f350 con 0x7f5a680b4b50 2023-06-08T04:02:49.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.438+0000 7f5a4ffff700 1 -- 172.21.15.16:0/3986095390 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a580072f0 con 0x7f5a680b4b50 2023-06-08T04:02:49.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.438+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/3986095390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a680cc210 con 0x7f5a680b4b50 2023-06-08T04:02:49.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.439+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/3986095390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a680cc580 con 0x7f5a680b4b50 2023-06-08T04:02:49.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.440+0000 7f5a4ffff700 1 -- 172.21.15.16:0/3986095390 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a58007450 con 0x7f5a680b4b50 2023-06-08T04:02:49.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.441+0000 7f5a4ffff700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5a5406ace0 0x7f5a5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:49.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.441+0000 7f5a4ffff700 1 -- 172.21.15.16:0/3986095390 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5a58089230 con 0x7f5a680b4b50 2023-06-08T04:02:49.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.441+0000 7f5a66ffd700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5a5406ace0 0x7f5a5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:49.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.442+0000 7f5a66ffd700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5a5406ace0 0x7f5a5406d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5a680d27e0 tx=0x7f5a5c013040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:49.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.445+0000 7f5a4ffff700 1 -- 172.21.15.16:0/3986095390 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5a58054330 con 0x7f5a680b4b50 2023-06-08T04:02:49.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.668+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/3986095390 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5a680740e0 con 0x7f5a680b4b50 2023-06-08T04:02:49.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.668+0000 7f5a4ffff700 1 -- 172.21.15.16:0/3986095390 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5a58007700 con 0x7f5a680b4b50 2023-06-08T04:02:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5a5406ace0 msgr2=0x7f5a5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5a5406ace0 0x7f5a5406d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5a680d27e0 tx=0x7f5a5c013040 comp rx=0 tx=0).stop 2023-06-08T04:02:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/3986095390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a680b4b50 msgr2=0x7f5a680cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:49.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a680b4b50 0x7f5a680cc730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800c550 tx=0x7f5a5800c910 comp rx=0 tx=0).stop 2023-06-08T04:02:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/3986095390 shutdown_connections 2023-06-08T04:02:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5a5406ace0 0x7f5a5406d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a68160a60 0x7f5a680cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a680b4b50 0x7f5a680cc730 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 --2- 172.21.15.16:0/3986095390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5a680b83f0 0x7f5a680c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/3986095390 >> 172.21.15.16:0/3986095390 conn(0x7f5a680cf610 msgr2=0x7f5a680cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:49.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/3986095390 shutdown_connections 2023-06-08T04:02:49.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:49.671+0000 7f5a6e1ff700 1 -- 172.21.15.16:0/3986095390 wait complete. 2023-06-08T04:02:49.678 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-06-08T04:02:49.693 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-06-08T04:02:49.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:49.694 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-06-08T04:02:49.776 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2023-06-08T04:02:49.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:49.777 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-08T04:02:49.823 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:02:49.823 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:49.874 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:02:49.874 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:49.922 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:02:49.922 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:02:50.008 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:50.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.205+0000 7fb318dff700 1 Processor -- start 2023-06-08T04:02:50.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.205+0000 7fb318dff700 1 -- start start 2023-06-08T04:02:50.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.206+0000 7fb318dff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb3140b83f0 0x7fb314160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.206+0000 7fb318dff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb3140ced40 0x7fb3140b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.206+0000 7fb318dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3140b4b50 0x7fb31406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.206+0000 7fb318dff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3140b4fd0 con 0x7fb3140ced40 2023-06-08T04:02:50.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb318dff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3140d0800 con 0x7fb3140b83f0 2023-06-08T04:02:50.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb318dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140cd1e0 con 0x7fb3140b4b50 2023-06-08T04:02:50.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb30bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb3140ced40 0x7fb3140b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb30bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb3140ced40 0x7fb3140b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45384/0 (socket says 172.21.15.16:45384) 2023-06-08T04:02:50.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb30bfff700 1 -- 172.21.15.16:0/4155297767 learned_addr learned my addr 172.21.15.16:0/4155297767 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:50.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb31259c700 1 --2- 172.21.15.16:0/4155297767 >> v2:172.21.15.169:3300/0 conn(0x7fb3140b83f0 0x7fb314160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb312d9d700 1 --2- 172.21.15.16:0/4155297767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3140b4b50 0x7fb31406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb30bfff700 1 -- 172.21.15.16:0/4155297767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3140b4b50 msgr2=0x7fb31406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:50.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb30bfff700 1 --2- 172.21.15.16:0/4155297767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3140b4b50 0x7fb31406b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb30bfff700 1 -- 172.21.15.16:0/4155297767 >> v2:172.21.15.169:3300/0 conn(0x7fb3140b83f0 msgr2=0x7fb314160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:50.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb30bfff700 1 --2- 172.21.15.16:0/4155297767 >> v2:172.21.15.169:3300/0 conn(0x7fb3140b83f0 0x7fb314160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.207+0000 7fb30bfff700 1 -- 172.21.15.16:0/4155297767 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3140cd4c0 con 0x7fb3140ced40 2023-06-08T04:02:50.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb30bfff700 1 --2- 172.21.15.16:0/4155297767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3140ced40 0x7fb3140b4610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb31406ca80 tx=0x7fb2fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43823770a603e3dd server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:50.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb311d9b700 1 -- 172.21.15.16:0/4155297767 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc011830 con 0x7fb3140ced40 2023-06-08T04:02:50.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb311d9b700 1 -- 172.21.15.16:0/4155297767 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc011990 con 0x7fb3140ced40 2023-06-08T04:02:50.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb311d9b700 1 -- 172.21.15.16:0/4155297767 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc011d20 con 0x7fb3140ced40 2023-06-08T04:02:50.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb318dff700 1 -- 172.21.15.16:0/4155297767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3140ced40 msgr2=0x7fb3140b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:50.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb318dff700 1 --2- 172.21.15.16:0/4155297767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3140ced40 0x7fb3140b4610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb31406ca80 tx=0x7fb2fc009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb318dff700 1 -- 172.21.15.16:0/4155297767 shutdown_connections 2023-06-08T04:02:50.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb318dff700 1 --2- 172.21.15.16:0/4155297767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3140b4b50 0x7fb31406b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb318dff700 1 --2- 172.21.15.16:0/4155297767 >> v2:172.21.15.169:3300/0 conn(0x7fb3140b83f0 0x7fb314160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb318dff700 1 --2- 172.21.15.16:0/4155297767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3140ced40 0x7fb3140b4610 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb318dff700 1 -- 172.21.15.16:0/4155297767 >> 172.21.15.16:0/4155297767 conn(0x7fb3140cf610 msgr2=0x7fb3140cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:50.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.208+0000 7fb318dff700 1 -- 172.21.15.16:0/4155297767 shutdown_connections 2023-06-08T04:02:50.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.209+0000 7fb318dff700 1 -- 172.21.15.16:0/4155297767 wait complete. 2023-06-08T04:02:50.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.211+0000 7fb318dff700 1 Processor -- start 2023-06-08T04:02:50.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.211+0000 7fb318dff700 1 -- start start 2023-06-08T04:02:50.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.212+0000 7fb318dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3140b4b50 0x7fb3140caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.212+0000 7fb318dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3140b83f0 0x7fb31415f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.212+0000 7fb318dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3140ced40 0x7fb3141f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.212+0000 7fb318dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31415ec50 con 0x7fb3140ced40 2023-06-08T04:02:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.212+0000 7fb318dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31415dcf0 con 0x7fb3140b83f0 2023-06-08T04:02:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.212+0000 7fb318dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31415dfd0 con 0x7fb3140b4b50 2023-06-08T04:02:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb312d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3140ced40 0x7fb3141f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb312d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3140ced40 0x7fb3141f2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45386/0 (socket says 172.21.15.16:45386) 2023-06-08T04:02:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb312d9d700 1 -- 172.21.15.16:0/1586300144 learned_addr learned my addr 172.21.15.16:0/1586300144 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb31259c700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3140b4b50 0x7fb3140caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb30bfff700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3140b83f0 0x7fb31415f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb312d9d700 1 -- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3140b4b50 msgr2=0x7fb3140caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:50.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb312d9d700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3140b4b50 0x7fb3140caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb312d9d700 1 -- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3140b83f0 msgr2=0x7fb31415f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:50.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb312d9d700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3140b83f0 0x7fb31415f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb312d9d700 1 -- 172.21.15.16:0/1586300144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc009550 con 0x7fb3140ced40 2023-06-08T04:02:50.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb30bfff700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3140b83f0 0x7fb31415f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:50.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb312d9d700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3140ced40 0x7fb3141f2300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00eed0 tx=0x7fb30c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:50.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.213+0000 7fb30affd700 1 -- 172.21.15.16:0/1586300144 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c010040 con 0x7fb3140ced40 2023-06-08T04:02:50.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.214+0000 7fb30affd700 1 -- 172.21.15.16:0/1586300144 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c00bd30 con 0x7fb3140ced40 2023-06-08T04:02:50.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.214+0000 7fb318dff700 1 -- 172.21.15.16:0/1586300144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31415e2b0 con 0x7fb3140ced40 2023-06-08T04:02:50.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.214+0000 7fb30affd700 1 -- 172.21.15.16:0/1586300144 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c009ea0 con 0x7fb3140ced40 2023-06-08T04:02:50.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.214+0000 7fb318dff700 1 -- 172.21.15.16:0/1586300144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31415e870 con 0x7fb3140ced40 2023-06-08T04:02:50.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.215+0000 7fb318dff700 1 -- 172.21.15.16:0/1586300144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31415ed90 con 0x7fb3140ced40 2023-06-08T04:02:50.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.216+0000 7fb30affd700 1 -- 172.21.15.16:0/1586300144 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb30c014640 con 0x7fb3140ced40 2023-06-08T04:02:50.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.217+0000 7fb30affd700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2f406ace0 0x7fb2f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.217+0000 7fb30affd700 1 -- 172.21.15.16:0/1586300144 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb30c089b60 con 0x7fb3140ced40 2023-06-08T04:02:50.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.217+0000 7fb31259c700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2f406ace0 0x7fb2f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.218+0000 7fb31259c700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2f406ace0 0x7fb2f406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb31415dc80 tx=0x7fb304008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:50.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.221+0000 7fb30affd700 1 -- 172.21.15.16:0/1586300144 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb31415ed90 con 0x7fb3140ced40 2023-06-08T04:02:50.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.426+0000 7fb318dff700 1 -- 172.21.15.16:0/1586300144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb31415ed90 con 0x7fb3140ced40 2023-06-08T04:02:50.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.428+0000 7fb30affd700 1 -- 172.21.15.16:0/1586300144 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18293 (secure 0 0 0) 0x7fb30c018070 con 0x7fb3140ced40 2023-06-08T04:02:50.433 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:50.433 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:02:45.925594+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.26","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:50.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 -- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2f406ace0 msgr2=0x7fb2f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:50.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2f406ace0 0x7fb2f406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb31415dc80 tx=0x7fb304008040 comp rx=0 tx=0).stop 2023-06-08T04:02:50.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 -- 172.21.15.16:0/1586300144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3140ced40 msgr2=0x7fb3141f2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:50.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3140ced40 0x7fb3141f2300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00eed0 tx=0x7fb30c00b390 comp rx=0 tx=0).stop 2023-06-08T04:02:50.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 -- 172.21.15.16:0/1586300144 shutdown_connections 2023-06-08T04:02:50.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2f406ace0 0x7fb2f406d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3140ced40 0x7fb3141f2300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3140b4b50 0x7fb3140caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 --2- 172.21.15.16:0/1586300144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3140b83f0 0x7fb31415f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 -- 172.21.15.16:0/1586300144 >> 172.21.15.16:0/1586300144 conn(0x7fb3140cf610 msgr2=0x7fb3140cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:50.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 -- 172.21.15.16:0/1586300144 shutdown_connections 2023-06-08T04:02:50.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.430+0000 7fb318dff700 1 -- 172.21.15.16:0/1586300144 wait complete. 2023-06-08T04:02:50.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:01:54.980592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:01:56.264608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:02:50.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:02:50.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.652+0000 7f3644bff700 1 Processor -- start 2023-06-08T04:02:50.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.652+0000 7f3644bff700 1 -- start start 2023-06-08T04:02:50.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.652+0000 7f3644bff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f36400b83f0 0x7f3640160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.652+0000 7f3644bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36400ced40 0x7f36400b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.652+0000 7f3644bff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36400d0800 con 0x7f36400b4b50 2023-06-08T04:02:50.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.652+0000 7f3644bff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36400b4fd0 con 0x7f36400b83f0 2023-06-08T04:02:50.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.652+0000 7f3644bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36400cd1e0 con 0x7f36400ced40 2023-06-08T04:02:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.652+0000 7f363ed9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f36400b4b50 0x7f364006b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34424/0 (socket says 172.21.15.16:34424) 2023-06-08T04:02:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.652+0000 7f363ed9d700 1 -- 172.21.15.16:0/1286574513 learned_addr learned my addr 172.21.15.16:0/1286574513 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.653+0000 7f363e59c700 1 --2- 172.21.15.16:0/1286574513 >> v2:172.21.15.169:3300/0 conn(0x7f36400b83f0 0x7f3640160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.653+0000 7f363dd9b700 1 --2- 172.21.15.16:0/1286574513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36400ced40 0x7f36400b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.653+0000 7f363d59a700 1 -- 172.21.15.16:0/1286574513 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410909340 0 0) 0x7f36400d0800 con 0x7f36400b4b50 2023-06-08T04:02:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.653+0000 7f363d59a700 1 -- 172.21.15.16:0/1286574513 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36280035b0 con 0x7f36400b4b50 2023-06-08T04:02:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.653+0000 7f363e59c700 1 -- 172.21.15.16:0/1286574513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36400ced40 msgr2=0x7f36400b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.653+0000 7f363e59c700 1 --2- 172.21.15.16:0/1286574513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36400ced40 0x7f36400b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.653+0000 7f363e59c700 1 -- 172.21.15.16:0/1286574513 >> v1:172.21.15.16:6789/0 conn(0x7f36400b4b50 legacy=0x7f364006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.653+0000 7f363e59c700 1 -- 172.21.15.16:0/1286574513 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400cd4c0 con 0x7f36400b83f0 2023-06-08T04:02:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.653+0000 7f363e59c700 1 --2- 172.21.15.16:0/1286574513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36400b83f0 0x7f3640160a60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3630009840 tx=0x7f3630009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d4c3bd23aa9551 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.654+0000 7f363d59a700 1 -- 172.21.15.16:0/1286574513 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630011830 con 0x7f36400b83f0 2023-06-08T04:02:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.654+0000 7f363d59a700 1 -- 172.21.15.16:0/1286574513 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630011990 con 0x7f36400b83f0 2023-06-08T04:02:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.654+0000 7f363d59a700 1 -- 172.21.15.16:0/1286574513 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630011d20 con 0x7f36400b83f0 2023-06-08T04:02:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.654+0000 7f3644bff700 1 -- 172.21.15.16:0/1286574513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36400b83f0 msgr2=0x7f3640160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.654+0000 7f3644bff700 1 --2- 172.21.15.16:0/1286574513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36400b83f0 0x7f3640160a60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3630009840 tx=0x7f3630009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.654+0000 7f3644bff700 1 -- 172.21.15.16:0/1286574513 shutdown_connections 2023-06-08T04:02:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.654+0000 7f3644bff700 1 --2- 172.21.15.16:0/1286574513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36400b83f0 0x7f3640160a60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.654+0000 7f3644bff700 1 --2- 172.21.15.16:0/1286574513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36400ced40 0x7f36400b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.654+0000 7f3644bff700 1 -- 172.21.15.16:0/1286574513 >> 172.21.15.16:0/1286574513 conn(0x7f36400cf610 msgr2=0x7f36400cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.654+0000 7f3644bff700 1 -- 172.21.15.16:0/1286574513 shutdown_connections 2023-06-08T04:02:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.654+0000 7f3644bff700 1 -- 172.21.15.16:0/1286574513 wait complete. 2023-06-08T04:02:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.656+0000 7f3644bff700 1 Processor -- start 2023-06-08T04:02:50.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.656+0000 7f3644bff700 1 -- start start 2023-06-08T04:02:50.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.657+0000 7f3644bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36400b4b50 0x7f36401ef120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.657+0000 7f3644bff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36400b83f0 0x7f36401587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.657+0000 7f3644bff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36400ced40 0x7f36401e6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.657+0000 7f3644bff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3640159e30 con 0x7f36400b83f0 2023-06-08T04:02:50.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.657+0000 7f3644bff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36401ef660 con 0x7f36400ced40 2023-06-08T04:02:50.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.657+0000 7f3644bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3640159220 con 0x7f36400b4b50 2023-06-08T04:02:50.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363dd9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36400b83f0 0x7f36401587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363dd9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36400b83f0 0x7f36401587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45394/0 (socket says 172.21.15.16:45394) 2023-06-08T04:02:50.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363dd9b700 1 -- 172.21.15.16:0/4106144049 learned_addr learned my addr 172.21.15.16:0/4106144049 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:50.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363ed9d700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36400ced40 0x7f36401e6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363e59c700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36400b4b50 0x7f36401ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363dd9b700 1 -- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36400b4b50 msgr2=0x7f36401ef120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:50.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363dd9b700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36400b4b50 0x7f36401ef120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363dd9b700 1 -- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36400ced40 msgr2=0x7f36401e6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:50.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363dd9b700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36400ced40 0x7f36401e6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363dd9b700 1 -- 172.21.15.16:0/4106144049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36300094a0 con 0x7f36400b83f0 2023-06-08T04:02:50.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363e59c700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36400b4b50 0x7f36401ef120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:50.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.658+0000 7f363dd9b700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36400b83f0 0x7f36401587a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f363400e870 tx=0x7f363400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:50.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.659+0000 7f362effd700 1 -- 172.21.15.16:0/4106144049 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3634009590 con 0x7f36400b83f0 2023-06-08T04:02:50.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.659+0000 7f362effd700 1 -- 172.21.15.16:0/4106144049 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3634013680 con 0x7f36400b83f0 2023-06-08T04:02:50.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.659+0000 7f3644bff700 1 -- 172.21.15.16:0/4106144049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3640159500 con 0x7f36400b83f0 2023-06-08T04:02:50.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.659+0000 7f362effd700 1 -- 172.21.15.16:0/4106144049 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36340139f0 con 0x7f36400b83f0 2023-06-08T04:02:50.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.659+0000 7f3644bff700 1 -- 172.21.15.16:0/4106144049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3640159ac0 con 0x7f36400b83f0 2023-06-08T04:02:50.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.660+0000 7f3644bff700 1 -- 172.21.15.16:0/4106144049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36400740e0 con 0x7f36400b83f0 2023-06-08T04:02:50.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.662+0000 7f362effd700 1 -- 172.21.15.16:0/4106144049 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3634013b50 con 0x7f36400b83f0 2023-06-08T04:02:50.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.662+0000 7f362effd700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f362006ace0 0x7f362006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:50.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.662+0000 7f362effd700 1 -- 172.21.15.16:0/4106144049 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3634089540 con 0x7f36400b83f0 2023-06-08T04:02:50.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.662+0000 7f363e59c700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f362006ace0 0x7f362006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:50.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.663+0000 7f363e59c700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f362006ace0 0x7f362006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3630000c00 tx=0x7f3630008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:50.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.667+0000 7f362effd700 1 -- 172.21.15.16:0/4106144049 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3634054490 con 0x7f36400b83f0 2023-06-08T04:02:50.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.874+0000 7f3644bff700 1 -- 172.21.15.16:0/4106144049 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3640159f70 con 0x7f36400b83f0 2023-06-08T04:02:50.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.874+0000 7f362effd700 1 -- 172.21.15.16:0/4106144049 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3640159f70 con 0x7f36400b83f0 2023-06-08T04:02:50.879 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:02:50.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 -- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f362006ace0 msgr2=0x7f362006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:50.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f362006ace0 0x7f362006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3630000c00 tx=0x7f3630008030 comp rx=0 tx=0).stop 2023-06-08T04:02:50.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 -- 172.21.15.16:0/4106144049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36400b83f0 msgr2=0x7f36401587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:50.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36400b83f0 0x7f36401587a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f363400e870 tx=0x7f363400eb80 comp rx=0 tx=0).stop 2023-06-08T04:02:50.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 -- 172.21.15.16:0/4106144049 shutdown_connections 2023-06-08T04:02:50.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f362006ace0 0x7f362006d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f36400ced40 0x7f36401e6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36400b4b50 0x7f36401ef120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 --2- 172.21.15.16:0/4106144049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36400b83f0 0x7f36401587a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:50.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 -- 172.21.15.16:0/4106144049 >> 172.21.15.16:0/4106144049 conn(0x7f36400cf610 msgr2=0x7f36400b72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:50.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 -- 172.21.15.16:0/4106144049 shutdown_connections 2023-06-08T04:02:50.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:50.877+0000 7f3644bff700 1 -- 172.21.15.16:0/4106144049 wait complete. 2023-06-08T04:02:50.900 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:02:51.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.099+0000 7f3ac8dff700 1 Processor -- start 2023-06-08T04:02:51.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.099+0000 7f3ac8dff700 1 -- start start 2023-06-08T04:02:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.100+0000 7f3ac8dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac40b83f0 0x7f3ac4160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.100+0000 7f3ac8dff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3ac40b4d20 0x7f3ac40d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.100+0000 7f3ac8dff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac40d0800 con 0x7f3ac40ced40 2023-06-08T04:02:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.100+0000 7f3ac8dff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac40cd1e0 con 0x7f3ac40b4d20 2023-06-08T04:02:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.100+0000 7f3ac8dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40cd4c0 con 0x7f3ac40b83f0 2023-06-08T04:02:51.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.100+0000 7f3abbfff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3ac40ced40 0x7f3ac40b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34430/0 (socket says 172.21.15.16:34430) 2023-06-08T04:02:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.100+0000 7f3abbfff700 1 -- 172.21.15.16:0/3668230239 learned_addr learned my addr 172.21.15.16:0/3668230239 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.100+0000 7f3ac259c700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac40b83f0 0x7f3ac4160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.100+0000 7f3ac2d9d700 1 --2- 172.21.15.16:0/3668230239 >> v2:172.21.15.169:3300/0 conn(0x7f3ac40b4d20 0x7f3ac40d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519482788 0 0) 0x7f3ac40d0800 con 0x7f3ac40ced40 2023-06-08T04:02:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ab00035b0 con 0x7f3ac40ced40 2023-06-08T04:02:51.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1294354448 0 0) 0x7f3ab00035b0 con 0x7f3ac40ced40 2023-06-08T04:02:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac40b83f0 msgr2=0x7f3ac4160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac40b83f0 0x7f3ac4160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 >> v2:172.21.15.169:3300/0 conn(0x7f3ac40b4d20 msgr2=0x7f3ac40d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 --2- 172.21.15.16:0/3668230239 >> v2:172.21.15.169:3300/0 conn(0x7f3ac40b4d20 0x7f3ac40d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac40d0aa0 con 0x7f3ac40ced40 2023-06-08T04:02:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7f3aac001670 con 0x7f3ac40ced40 2023-06-08T04:02:51.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 >> v1:172.21.15.16:6789/0 conn(0x7f3ac40ced40 legacy=0x7f3ac40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 0x7f3ab0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab0004850 0x7f3ab0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac40b83f0 0x7f3ab0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40cd1e0 con 0x7f3ab0003a00 2023-06-08T04:02:51.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40cd4c0 con 0x7f3ab0004850 2023-06-08T04:02:51.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab000ba40 con 0x7f3ac40b83f0 2023-06-08T04:02:51.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.101+0000 7f3ac259c700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 0x7f3ab0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.102+0000 7f3abbfff700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab0004850 0x7f3ab0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.102+0000 7f3ac2d9d700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac40b83f0 0x7f3ab0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.102+0000 7f3ac259c700 1 -- 172.21.15.16:0/3668230239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac40b83f0 msgr2=0x7f3ab0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:51.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.102+0000 7f3ac259c700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac40b83f0 0x7f3ab0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.102+0000 7f3ac259c700 1 -- 172.21.15.16:0/3668230239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab0004850 msgr2=0x7f3ab0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:51.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.102+0000 7f3ac259c700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ab0004850 0x7f3ab0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.102+0000 7f3ac259c700 1 -- 172.21.15.16:0/3668230239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00035b0 con 0x7f3ab0003a00 2023-06-08T04:02:51.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.102+0000 7f3ac259c700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 0x7f3ab0003e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009b60 tx=0x7f3ab0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6311aece2f919f69 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:51.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.102+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab400e6c0 con 0x7f3ab0003a00 2023-06-08T04:02:51.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.102+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab400e820 con 0x7f3ab0003a00 2023-06-08T04:02:51.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.102+0000 7f3ac1d9b700 1 -- 172.21.15.16:0/3668230239 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab400eb90 con 0x7f3ab0003a00 2023-06-08T04:02:51.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.103+0000 7f3ac8dff700 1 -- 172.21.15.16:0/3668230239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 msgr2=0x7f3ab0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.103+0000 7f3ac8dff700 1 --2- 172.21.15.16:0/3668230239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 0x7f3ab0003e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009b60 tx=0x7f3ab0005880 comp rx=0 tx=0).stop 2023-06-08T04:02:51.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.103+0000 7f3ac2d9d700 1 -- 172.21.15.16:0/3668230239 reap_dead start 2023-06-08T04:02:51.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.103+0000 7f3ac8dff700 1 -- 172.21.15.16:0/3668230239 shutdown_connections 2023-06-08T04:02:51.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.103+0000 7f3ac8dff700 1 -- 172.21.15.16:0/3668230239 >> 172.21.15.16:0/3668230239 conn(0x7f3ac40cf610 msgr2=0x7f3ac40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:51.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.103+0000 7f3ac8dff700 1 -- 172.21.15.16:0/3668230239 shutdown_connections 2023-06-08T04:02:51.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.103+0000 7f3ac8dff700 1 -- 172.21.15.16:0/3668230239 wait complete. 2023-06-08T04:02:51.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.106+0000 7f3ac8dff700 1 Processor -- start 2023-06-08T04:02:51.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.106+0000 7f3ac8dff700 1 -- start start 2023-06-08T04:02:51.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac8dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 0x7f3ac40cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac8dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac4157110 0x7f3ac40b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac8dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ac414c9f0 0x7f3ac414ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac8dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40cc890 con 0x7f3ab0003a00 2023-06-08T04:02:51.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac8dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4157940 con 0x7f3ac414c9f0 2023-06-08T04:02:51.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac8dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40ccae0 con 0x7f3ac4157110 2023-06-08T04:02:51.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 0x7f3ac40cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 0x7f3ac40cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45416/0 (socket says 172.21.15.16:45416) 2023-06-08T04:02:51.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac259c700 1 -- 172.21.15.16:0/2868869548 learned_addr learned my addr 172.21.15.16:0/2868869548 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:51.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3abbfff700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac4157110 0x7f3ac40b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac2d9d700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ac414c9f0 0x7f3ac414ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac259c700 1 -- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac4157110 msgr2=0x7f3ac40b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac259c700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac4157110 0x7f3ac40b69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac259c700 1 -- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ac414c9f0 msgr2=0x7f3ac414ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac259c700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ac414c9f0 0x7f3ac414ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac259c700 1 -- 172.21.15.16:0/2868869548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac415dae0 con 0x7f3ab0003a00 2023-06-08T04:02:51.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3abbfff700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac4157110 0x7f3ac40b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:51.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac259c700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 0x7f3ac40cc350 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0004760 tx=0x7f3ab40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:51.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3abaffd700 1 -- 172.21.15.16:0/2868869548 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab400e6c0 con 0x7f3ab0003a00 2023-06-08T04:02:51.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3abaffd700 1 -- 172.21.15.16:0/2868869548 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4003ad0 con 0x7f3ab0003a00 2023-06-08T04:02:51.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3abaffd700 1 -- 172.21.15.16:0/2868869548 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4003e80 con 0x7f3ab0003a00 2023-06-08T04:02:51.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac8dff700 1 -- 172.21.15.16:0/2868869548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac40cc890 con 0x7f3ab0003a00 2023-06-08T04:02:51.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.107+0000 7f3ac8dff700 1 -- 172.21.15.16:0/2868869548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac415e0a0 con 0x7f3ab0003a00 2023-06-08T04:02:51.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.108+0000 7f3ac8dff700 1 -- 172.21.15.16:0/2868869548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac40740e0 con 0x7f3ab0003a00 2023-06-08T04:02:51.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.109+0000 7f3abaffd700 1 -- 172.21.15.16:0/2868869548 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ab4013470 con 0x7f3ab0003a00 2023-06-08T04:02:51.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.110+0000 7f3abaffd700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3aa406ace0 0x7f3aa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.110+0000 7f3abaffd700 1 -- 172.21.15.16:0/2868869548 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3ab408ad90 con 0x7f3ab0003a00 2023-06-08T04:02:51.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.111+0000 7f3abbfff700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3aa406ace0 0x7f3aa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.111+0000 7f3abbfff700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3aa406ace0 0x7f3aa406d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3aac001050 tx=0x7f3aac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:51.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.114+0000 7f3abaffd700 1 -- 172.21.15.16:0/2868869548 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3ab4055f10 con 0x7f3ab0003a00 2023-06-08T04:02:51.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.319+0000 7f3ac8dff700 1 -- 172.21.15.16:0/2868869548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ac414d3d0 con 0x7f3ab0003a00 2023-06-08T04:02:51.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.319+0000 7f3abaffd700 1 -- 172.21.15.16:0/2868869548 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ab4059530 con 0x7f3ab0003a00 2023-06-08T04:02:51.324 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:02:51.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.322+0000 7f3ac8dff700 1 -- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3aa406ace0 msgr2=0x7f3aa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.322+0000 7f3ac8dff700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3aa406ace0 0x7f3aa406d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3aac001050 tx=0x7f3aac009040 comp rx=0 tx=0).stop 2023-06-08T04:02:51.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.322+0000 7f3ac8dff700 1 -- 172.21.15.16:0/2868869548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 msgr2=0x7f3ac40cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.322+0000 7f3ac8dff700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 0x7f3ac40cc350 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0004760 tx=0x7f3ab40047c0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.323+0000 7f3ac8dff700 1 -- 172.21.15.16:0/2868869548 shutdown_connections 2023-06-08T04:02:51.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.323+0000 7f3ac8dff700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3aa406ace0 0x7f3aa406d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.323+0000 7f3ac8dff700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ac414c9f0 0x7f3ac414ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.323+0000 7f3ac8dff700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0003a00 0x7f3ac40cc350 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.323+0000 7f3ac8dff700 1 --2- 172.21.15.16:0/2868869548 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ac4157110 0x7f3ac40b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.323+0000 7f3ac8dff700 1 -- 172.21.15.16:0/2868869548 >> 172.21.15.16:0/2868869548 conn(0x7f3ac40cf610 msgr2=0x7f3ac40b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:51.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.323+0000 7f3ac8dff700 1 -- 172.21.15.16:0/2868869548 shutdown_connections 2023-06-08T04:02:51.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.323+0000 7f3ac8dff700 1 -- 172.21.15.16:0/2868869548 wait complete. 2023-06-08T04:02:51.344 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:02:51.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.543+0000 7ffa9fdff700 1 Processor -- start 2023-06-08T04:02:51.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.544+0000 7ffa9fdff700 1 -- start start 2023-06-08T04:02:51.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.545+0000 7ffa9fdff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa98160a60 0x7ffa980b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.545+0000 7ffa9fdff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffa980b4b50 0x7ffa980d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.545+0000 7ffa9fdff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa980d0800 con 0x7ffa980b83f0 2023-06-08T04:02:51.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.545+0000 7ffa9fdff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa98160ed0 con 0x7ffa98160a60 2023-06-08T04:02:51.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.545+0000 7ffa9fdff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa980b4fd0 con 0x7ffa980b4b50 2023-06-08T04:02:51.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.545+0000 7ffa9d39a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa98160a60 0x7ffa980b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.545+0000 7ffa9d39a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa98160a60 0x7ffa980b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45420/0 (socket says 172.21.15.16:45420) 2023-06-08T04:02:51.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.545+0000 7ffa9d39a700 1 -- 172.21.15.16:0/936540810 learned_addr learned my addr 172.21.15.16:0/936540810 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:51.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.545+0000 7ffa9e39c700 1 --2- 172.21.15.16:0/936540810 >> v2:172.21.15.169:3300/0 conn(0x7ffa980b4b50 0x7ffa980d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.546+0000 7ffa9d39a700 1 -- 172.21.15.16:0/936540810 >> v2:172.21.15.169:3300/0 conn(0x7ffa980b4b50 msgr2=0x7ffa980d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:51.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.546+0000 7ffa9d39a700 1 --2- 172.21.15.16:0/936540810 >> v2:172.21.15.169:3300/0 conn(0x7ffa980b4b50 0x7ffa980d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.546+0000 7ffa9d39a700 1 -- 172.21.15.16:0/936540810 >> v1:172.21.15.169:6789/0 conn(0x7ffa980b83f0 legacy=0x7ffa980ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.546+0000 7ffa9d39a700 1 -- 172.21.15.16:0/936540810 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa980cd1e0 con 0x7ffa98160a60 2023-06-08T04:02:51.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.546+0000 7ffa9d39a700 1 --2- 172.21.15.16:0/936540810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa98160a60 0x7ffa980b4610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa980b2590 tx=0x7ffa88009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb32c78d18ceeb35 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:51.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.546+0000 7ffa9cb99700 1 -- 172.21.15.16:0/936540810 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88011830 con 0x7ffa98160a60 2023-06-08T04:02:51.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.546+0000 7ffa9cb99700 1 -- 172.21.15.16:0/936540810 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa88011990 con 0x7ffa98160a60 2023-06-08T04:02:51.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.546+0000 7ffa9cb99700 1 -- 172.21.15.16:0/936540810 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88011d20 con 0x7ffa98160a60 2023-06-08T04:02:51.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.547+0000 7ffa9fdff700 1 -- 172.21.15.16:0/936540810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa98160a60 msgr2=0x7ffa980b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.547+0000 7ffa9fdff700 1 --2- 172.21.15.16:0/936540810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa98160a60 0x7ffa980b4610 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa980b2590 tx=0x7ffa88009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.547+0000 7ffa9fdff700 1 -- 172.21.15.16:0/936540810 shutdown_connections 2023-06-08T04:02:51.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.547+0000 7ffa9fdff700 1 --2- 172.21.15.16:0/936540810 >> v2:172.21.15.169:3300/0 conn(0x7ffa980b4b50 0x7ffa980d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.547+0000 7ffa9fdff700 1 --2- 172.21.15.16:0/936540810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa98160a60 0x7ffa980b4610 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.547+0000 7ffa9fdff700 1 -- 172.21.15.16:0/936540810 >> 172.21.15.16:0/936540810 conn(0x7ffa980cf610 msgr2=0x7ffa980cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:51.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.547+0000 7ffa9fdff700 1 -- 172.21.15.16:0/936540810 shutdown_connections 2023-06-08T04:02:51.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.547+0000 7ffa9fdff700 1 -- 172.21.15.16:0/936540810 wait complete. 2023-06-08T04:02:51.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.549+0000 7ffa9fdff700 1 Processor -- start 2023-06-08T04:02:51.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.549+0000 7ffa9fdff700 1 -- start start 2023-06-08T04:02:51.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9fdff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa980b4b50 0x7ffa980c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9fdff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa980b83f0 0x7ffa980cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9fdff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa98160a60 0x7ffa980cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9fdff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9815ea30 con 0x7ffa980b83f0 2023-06-08T04:02:51.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9fdff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9815ed10 con 0x7ffa98160a60 2023-06-08T04:02:51.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9fdff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9815eff0 con 0x7ffa980b4b50 2023-06-08T04:02:51.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9d39a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa980b83f0 0x7ffa980cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9d39a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa980b83f0 0x7ffa980cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45434/0 (socket says 172.21.15.16:45434) 2023-06-08T04:02:51.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9d39a700 1 -- 172.21.15.16:0/1526476027 learned_addr learned my addr 172.21.15.16:0/1526476027 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:51.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9e39c700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa98160a60 0x7ffa980cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9db9b700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa980b4b50 0x7ffa980c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9d39a700 1 -- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa980b4b50 msgr2=0x7ffa980c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9d39a700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa980b4b50 0x7ffa980c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9d39a700 1 -- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa98160a60 msgr2=0x7ffa980cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9d39a700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa98160a60 0x7ffa980cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.550+0000 7ffa9d39a700 1 -- 172.21.15.16:0/1526476027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88009550 con 0x7ffa980b83f0 2023-06-08T04:02:51.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.551+0000 7ffa9d39a700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa980b83f0 0x7ffa980cb7c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009c10 tx=0x7ffa88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:51.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.551+0000 7ffa8e7fc700 1 -- 172.21.15.16:0/1526476027 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880036a0 con 0x7ffa980b83f0 2023-06-08T04:02:51.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.551+0000 7ffa8e7fc700 1 -- 172.21.15.16:0/1526476027 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8801e070 con 0x7ffa980b83f0 2023-06-08T04:02:51.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.551+0000 7ffa8e7fc700 1 -- 172.21.15.16:0/1526476027 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88003a60 con 0x7ffa980b83f0 2023-06-08T04:02:51.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.551+0000 7ffa9fdff700 1 -- 172.21.15.16:0/1526476027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9815f2d0 con 0x7ffa980b83f0 2023-06-08T04:02:51.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.551+0000 7ffa9fdff700 1 -- 172.21.15.16:0/1526476027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa981e8320 con 0x7ffa980b83f0 2023-06-08T04:02:51.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.552+0000 7ffa7bfff700 1 -- 172.21.15.16:0/1526476027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa740052e0 con 0x7ffa980b83f0 2023-06-08T04:02:51.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.553+0000 7ffa8e7fc700 1 -- 172.21.15.16:0/1526476027 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa88003bc0 con 0x7ffa980b83f0 2023-06-08T04:02:51.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.554+0000 7ffa8e7fc700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa7c06ace0 0x7ffa7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.554+0000 7ffa8e7fc700 1 -- 172.21.15.16:0/1526476027 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ffa8808a460 con 0x7ffa980b83f0 2023-06-08T04:02:51.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.554+0000 7ffa9db9b700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa7c06ace0 0x7ffa7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.555+0000 7ffa9db9b700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa7c06ace0 0x7ffa7c06d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000f60 tx=0x7ffa94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:51.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.558+0000 7ffa8e7fc700 1 -- 172.21.15.16:0/1526476027 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffa880554c0 con 0x7ffa980b83f0 2023-06-08T04:02:51.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.764+0000 7ffa7bfff700 1 -- 172.21.15.16:0/1526476027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa74005b10 con 0x7ffa980b83f0 2023-06-08T04:02:51.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.764+0000 7ffa8e7fc700 1 -- 172.21.15.16:0/1526476027 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa88058ae0 con 0x7ffa980b83f0 2023-06-08T04:02:51.768 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:02:51.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 -- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa7c06ace0 msgr2=0x7ffa7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa7c06ace0 0x7ffa7c06d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000f60 tx=0x7ffa94009040 comp rx=0 tx=0).stop 2023-06-08T04:02:51.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 -- 172.21.15.16:0/1526476027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa980b83f0 msgr2=0x7ffa980cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa980b83f0 0x7ffa980cb7c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009c10 tx=0x7ffa88004750 comp rx=0 tx=0).stop 2023-06-08T04:02:51.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 -- 172.21.15.16:0/1526476027 shutdown_connections 2023-06-08T04:02:51.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ffa7c06ace0 0x7ffa7c06d190 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000f60 tx=0x7ffa94009040 comp rx=0 tx=0).stop 2023-06-08T04:02:51.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa98160a60 0x7ffa980cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa980b4b50 0x7ffa980c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 --2- 172.21.15.16:0/1526476027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa980b83f0 0x7ffa980cb7c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:51.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 -- 172.21.15.16:0/1526476027 >> 172.21.15.16:0/1526476027 conn(0x7ffa980cf610 msgr2=0x7ffa9806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:51.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 -- 172.21.15.16:0/1526476027 shutdown_connections 2023-06-08T04:02:51.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.767+0000 7ffa7bfff700 1 -- 172.21.15.16:0/1526476027 wait complete. 2023-06-08T04:02:51.788 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:02:51.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.989+0000 7fab095ff700 1 Processor -- start 2023-06-08T04:02:51.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.989+0000 7fab095ff700 1 -- start start 2023-06-08T04:02:51.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.991+0000 7fab095ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fab04160a60 0x7fab040b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.991+0000 7fab095ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab040d0800 con 0x7fab040b83f0 2023-06-08T04:02:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.991+0000 7fab095ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab040cd1e0 con 0x7fab040b4b50 2023-06-08T04:02:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.991+0000 7fab095ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab04160ed0 con 0x7fab04160a60 2023-06-08T04:02:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.991+0000 7fab02ffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fab040b83f0 0x7fab040ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34444/0 (socket says 172.21.15.16:34444) 2023-06-08T04:02:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.991+0000 7fab02ffd700 1 -- 172.21.15.16:0/1130224923 learned_addr learned my addr 172.21.15.16:0/1130224923 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.991+0000 7faafbfff700 1 --2- 172.21.15.16:0/1130224923 >> v2:172.21.15.169:3300/0 conn(0x7fab04160a60 0x7fab040b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.991+0000 7fab027fc700 1 -- 172.21.15.16:0/1130224923 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203611780 0 0) 0x7fab040d0800 con 0x7fab040b83f0 2023-06-08T04:02:51.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.991+0000 7fab027fc700 1 -- 172.21.15.16:0/1130224923 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaf00035b0 con 0x7fab040b83f0 2023-06-08T04:02:51.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.992+0000 7faafbfff700 1 -- 172.21.15.16:0/1130224923 >> v1:172.21.15.169:6789/0 conn(0x7fab040b4b50 legacy=0x7fab040d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.992+0000 7faafbfff700 1 -- 172.21.15.16:0/1130224923 >> v1:172.21.15.16:6789/0 conn(0x7fab040b83f0 legacy=0x7fab040ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:51.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.992+0000 7faafbfff700 1 -- 172.21.15.16:0/1130224923 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab040cd4c0 con 0x7fab04160a60 2023-06-08T04:02:51.999 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.992+0000 7faafbfff700 1 --2- 172.21.15.16:0/1130224923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab04160a60 0x7fab040b4610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faaec009840 tx=0x7faaec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff117d0eae10ab1c server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.992+0000 7fab027fc700 1 -- 172.21.15.16:0/1130224923 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec011830 con 0x7fab04160a60 2023-06-08T04:02:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.992+0000 7fab027fc700 1 -- 172.21.15.16:0/1130224923 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec011990 con 0x7fab04160a60 2023-06-08T04:02:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.992+0000 7fab027fc700 1 -- 172.21.15.16:0/1130224923 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec011d20 con 0x7fab04160a60 2023-06-08T04:02:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.993+0000 7fab095ff700 1 -- 172.21.15.16:0/1130224923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab04160a60 msgr2=0x7fab040b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:52.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.993+0000 7fab095ff700 1 --2- 172.21.15.16:0/1130224923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab04160a60 0x7fab040b4610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faaec009840 tx=0x7faaec009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:52.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.993+0000 7fab095ff700 1 -- 172.21.15.16:0/1130224923 shutdown_connections 2023-06-08T04:02:52.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.993+0000 7fab095ff700 1 --2- 172.21.15.16:0/1130224923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab04160a60 0x7fab040b4610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.993+0000 7fab095ff700 1 -- 172.21.15.16:0/1130224923 >> 172.21.15.16:0/1130224923 conn(0x7fab040cf610 msgr2=0x7fab040cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:52.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.993+0000 7fab095ff700 1 -- 172.21.15.16:0/1130224923 shutdown_connections 2023-06-08T04:02:52.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.993+0000 7fab095ff700 1 -- 172.21.15.16:0/1130224923 wait complete. 2023-06-08T04:02:52.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.995+0000 7fab095ff700 1 Processor -- start 2023-06-08T04:02:52.005 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.995+0000 7fab095ff700 1 -- start start 2023-06-08T04:02:52.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab095ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab040b4b50 0x7fab04150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:52.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab095ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab040b83f0 0x7fab0415f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:52.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab095ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab04160a60 0x7fab04150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:52.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab095ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0415df80 con 0x7fab040b4b50 2023-06-08T04:02:52.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab095ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0415e260 con 0x7fab04160a60 2023-06-08T04:02:52.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab095ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0415e540 con 0x7fab040b83f0 2023-06-08T04:02:52.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab02ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab040b4b50 0x7fab04150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:52.007 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab02ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab040b4b50 0x7fab04150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45446/0 (socket says 172.21.15.16:45446) 2023-06-08T04:02:52.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab02ffd700 1 -- 172.21.15.16:0/3784278053 learned_addr learned my addr 172.21.15.16:0/3784278053 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:52.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7faafbfff700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab040b83f0 0x7fab0415f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:52.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab037fe700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab04160a60 0x7fab04150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:52.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab02ffd700 1 -- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab040b83f0 msgr2=0x7fab0415f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:52.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab02ffd700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab040b83f0 0x7fab0415f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab02ffd700 1 -- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab04160a60 msgr2=0x7fab04150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:52.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab02ffd700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab04160a60 0x7fab04150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7fab02ffd700 1 -- 172.21.15.16:0/3784278053 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec0094a0 con 0x7fab040b4b50 2023-06-08T04:02:52.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.996+0000 7faafbfff700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab040b83f0 0x7fab0415f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:52.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.997+0000 7fab02ffd700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab040b4b50 0x7fab04150420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c700 tx=0x7faaf400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:52.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.997+0000 7faafb7fe700 1 -- 172.21.15.16:0/3784278053 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4005d70 con 0x7fab040b4b50 2023-06-08T04:02:52.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.997+0000 7faafb7fe700 1 -- 172.21.15.16:0/3784278053 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf40070d0 con 0x7fab040b4b50 2023-06-08T04:02:52.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.997+0000 7fab095ff700 1 -- 172.21.15.16:0/3784278053 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0415e820 con 0x7fab040b4b50 2023-06-08T04:02:52.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.997+0000 7faafb7fe700 1 -- 172.21.15.16:0/3784278053 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf4007460 con 0x7fab040b4b50 2023-06-08T04:02:52.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.997+0000 7fab095ff700 1 -- 172.21.15.16:0/3784278053 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab04150960 con 0x7fab040b4b50 2023-06-08T04:02:52.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.998+0000 7fab095ff700 1 -- 172.21.15.16:0/3784278053 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab040740e0 con 0x7fab040b4b50 2023-06-08T04:02:52.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:51.999+0000 7faafb7fe700 1 -- 172.21.15.16:0/3784278053 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faaf40075c0 con 0x7fab040b4b50 2023-06-08T04:02:52.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.000+0000 7faafb7fe700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faae406ad10 0x7faae406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:52.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.000+0000 7faafb7fe700 1 -- 172.21.15.16:0/3784278053 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7faaf4088b30 con 0x7fab040b4b50 2023-06-08T04:02:52.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.000+0000 7faafbfff700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faae406ad10 0x7faae406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:52.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.001+0000 7faafbfff700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faae406ad10 0x7faae406d1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faaec0090b0 tx=0x7faaec008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:52.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.005+0000 7faafb7fe700 1 -- 172.21.15.16:0/3784278053 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faaf4053b10 con 0x7fab040b4b50 2023-06-08T04:02:52.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.208+0000 7fab095ff700 1 -- 172.21.15.16:0/3784278053 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab040ccfc0 con 0x7fab040b4b50 2023-06-08T04:02:52.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.208+0000 7faafb7fe700 1 -- 172.21.15.16:0/3784278053 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7faaf4057130 con 0x7fab040b4b50 2023-06-08T04:02:52.213 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:02:52.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 -- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faae406ad10 msgr2=0x7faae406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:52.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faae406ad10 0x7faae406d1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faaec0090b0 tx=0x7faaec008030 comp rx=0 tx=0).stop 2023-06-08T04:02:52.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 -- 172.21.15.16:0/3784278053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab040b4b50 msgr2=0x7fab04150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:52.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab040b4b50 0x7fab04150420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faaf400c700 tx=0x7faaf400cac0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 -- 172.21.15.16:0/3784278053 shutdown_connections 2023-06-08T04:02:52.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faae406ad10 0x7faae406d1c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab04160a60 0x7fab04150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab040b4b50 0x7fab04150420 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 --2- 172.21.15.16:0/3784278053 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab040b83f0 0x7fab0415f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 -- 172.21.15.16:0/3784278053 >> 172.21.15.16:0/3784278053 conn(0x7fab040cf610 msgr2=0x7fab040b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:52.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 -- 172.21.15.16:0/3784278053 shutdown_connections 2023-06-08T04:02:52.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.211+0000 7fab095ff700 1 -- 172.21.15.16:0/3784278053 wait complete. 2023-06-08T04:02:52.233 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T04:02:52.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.431+0000 7f15787ff700 1 Processor -- start 2023-06-08T04:02:52.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.431+0000 7f15787ff700 1 -- start start 2023-06-08T04:02:52.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.432+0000 7f15787ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15700b83f0 0x7f1570160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:52.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.432+0000 7f15787ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f15700b4d20 0x7f15700d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:52.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.432+0000 7f15787ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15700d0800 con 0x7f15700ced40 2023-06-08T04:02:52.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.432+0000 7f15787ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15700cd1e0 con 0x7f15700b4d20 2023-06-08T04:02:52.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.432+0000 7f15787ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15700cd4c0 con 0x7f15700b83f0 2023-06-08T04:02:52.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.433+0000 7f1576d9c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f15700b4d20 0x7f15700d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:52.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.433+0000 7f157659b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15700b83f0 0x7f1570160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.433+0000 7f1575d9a700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f15700ced40 0x7f15700b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:54220/0 (socket says 172.21.15.16:54220) 2023-06-08T04:02:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.433+0000 7f1575d9a700 1 -- 172.21.15.16:0/1460955408 learned_addr learned my addr 172.21.15.16:0/1460955408 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:52.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.433+0000 7f1575599700 1 -- 172.21.15.16:0/1460955408 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547688600 0 0) 0x7f15700d0800 con 0x7f15700ced40 2023-06-08T04:02:52.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.433+0000 7f1575599700 1 -- 172.21.15.16:0/1460955408 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f155c0035b0 con 0x7f15700ced40 2023-06-08T04:02:52.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.433+0000 7f1576d9c700 1 -- 172.21.15.16:0/1460955408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15700b83f0 msgr2=0x7f1570160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:52.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.433+0000 7f1576d9c700 1 --2- 172.21.15.16:0/1460955408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15700b83f0 0x7f1570160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.433+0000 7f1576d9c700 1 -- 172.21.15.16:0/1460955408 >> v1:172.21.15.169:6789/0 conn(0x7f15700ced40 legacy=0x7f15700b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:52.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.433+0000 7f1576d9c700 1 -- 172.21.15.16:0/1460955408 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15700d0aa0 con 0x7f15700b4d20 2023-06-08T04:02:52.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.433+0000 7f157659b700 1 --2- 172.21.15.16:0/1460955408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15700b83f0 0x7f1570160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:02:52.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.434+0000 7f1576d9c700 1 --2- 172.21.15.16:0/1460955408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15700b4d20 0x7f15700d0fc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1568009d90 tx=0x7f156800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4923890e53b0e8 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:52.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.434+0000 7f1575599700 1 -- 172.21.15.16:0/1460955408 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156800e070 con 0x7f15700b4d20 2023-06-08T04:02:52.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.434+0000 7f1575599700 1 -- 172.21.15.16:0/1460955408 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156800bb20 con 0x7f15700b4d20 2023-06-08T04:02:52.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.434+0000 7f1575599700 1 -- 172.21.15.16:0/1460955408 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568012430 con 0x7f15700b4d20 2023-06-08T04:02:52.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.434+0000 7f15787ff700 1 -- 172.21.15.16:0/1460955408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15700b4d20 msgr2=0x7f15700d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:52.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.434+0000 7f15787ff700 1 --2- 172.21.15.16:0/1460955408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15700b4d20 0x7f15700d0fc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1568009d90 tx=0x7f156800b330 comp rx=0 tx=0).stop 2023-06-08T04:02:52.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.435+0000 7f15787ff700 1 -- 172.21.15.16:0/1460955408 shutdown_connections 2023-06-08T04:02:52.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.435+0000 7f15787ff700 1 --2- 172.21.15.16:0/1460955408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15700b4d20 0x7f15700d0fc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.435+0000 7f15787ff700 1 --2- 172.21.15.16:0/1460955408 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15700b83f0 0x7f1570160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.435+0000 7f15787ff700 1 -- 172.21.15.16:0/1460955408 >> 172.21.15.16:0/1460955408 conn(0x7f15700cf610 msgr2=0x7f15700cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:52.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.435+0000 7f15787ff700 1 -- 172.21.15.16:0/1460955408 shutdown_connections 2023-06-08T04:02:52.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.435+0000 7f15787ff700 1 -- 172.21.15.16:0/1460955408 wait complete. 2023-06-08T04:02:52.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.436+0000 7f15787ff700 1 Processor -- start 2023-06-08T04:02:52.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.436+0000 7f15787ff700 1 -- start start 2023-06-08T04:02:52.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.437+0000 7f15787ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15700b4d20 0x7f157015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:52.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.437+0000 7f15787ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15700b83f0 0x7f1570159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:52.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.437+0000 7f15787ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15700ced40 0x7f15701f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.437+0000 7f15787ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15700cac50 con 0x7f15700b4d20 2023-06-08T04:02:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.437+0000 7f15787ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15700ca040 con 0x7f15700b83f0 2023-06-08T04:02:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.437+0000 7f15787ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15700ca320 con 0x7f15700ced40 2023-06-08T04:02:52.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.438+0000 7f157659b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15700b4d20 0x7f157015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:52.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.438+0000 7f157659b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15700b4d20 0x7f157015de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39754/0 (socket says 172.21.15.16:39754) 2023-06-08T04:02:52.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.438+0000 7f157659b700 1 -- 172.21.15.16:0/3233949578 learned_addr learned my addr 172.21.15.16:0/3233949578 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:52.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.438+0000 7f1576d9c700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15700ced40 0x7f15701f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:52.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.438+0000 7f1575d9a700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15700b83f0 0x7f1570159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:52.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.438+0000 7f157659b700 1 -- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15700ced40 msgr2=0x7f15701f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:52.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.438+0000 7f157659b700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15700ced40 0x7f15701f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.438+0000 7f157659b700 1 -- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15700b83f0 msgr2=0x7f1570159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:52.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.438+0000 7f157659b700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15700b83f0 0x7f1570159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.438+0000 7f157659b700 1 -- 172.21.15.16:0/3233949578 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c0094a0 con 0x7f15700b4d20 2023-06-08T04:02:52.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.438+0000 7f157659b700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15700b4d20 0x7f157015de30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f156c00ebe0 tx=0x7f156c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:52.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.439+0000 7f1566ffd700 1 -- 172.21.15.16:0/3233949578 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c00c850 con 0x7f15700b4d20 2023-06-08T04:02:52.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.439+0000 7f1566ffd700 1 -- 172.21.15.16:0/3233949578 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c00c9b0 con 0x7f15700b4d20 2023-06-08T04:02:52.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.439+0000 7f1566ffd700 1 -- 172.21.15.16:0/3233949578 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c00cd40 con 0x7f15700b4d20 2023-06-08T04:02:52.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.439+0000 7f15787ff700 1 -- 172.21.15.16:0/3233949578 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1568009a70 con 0x7f15700b4d20 2023-06-08T04:02:52.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.439+0000 7f15787ff700 1 -- 172.21.15.16:0/3233949578 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15700ca8e0 con 0x7f15700b4d20 2023-06-08T04:02:52.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.440+0000 7f15787ff700 1 -- 172.21.15.16:0/3233949578 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15700cff60 con 0x7f15700b4d20 2023-06-08T04:02:52.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.441+0000 7f1566ffd700 1 -- 172.21.15.16:0/3233949578 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f156c013470 con 0x7f15700b4d20 2023-06-08T04:02:52.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.442+0000 7f1566ffd700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f155406ace0 0x7f155406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:52.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.442+0000 7f1566ffd700 1 -- 172.21.15.16:0/3233949578 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f156c089610 con 0x7f15700b4d20 2023-06-08T04:02:52.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.443+0000 7f1575d9a700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f155406ace0 0x7f155406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:52.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.443+0000 7f1575d9a700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f155406ace0 0x7f155406d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f15701f5410 tx=0x7f1560007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:52.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.446+0000 7f1566ffd700 1 -- 172.21.15.16:0/3233949578 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f156c0545e0 con 0x7f15700b4d20 2023-06-08T04:02:52.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.669+0000 7f15787ff700 1 -- 172.21.15.16:0/3233949578 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f15700740e0 con 0x7f15700b4d20 2023-06-08T04:02:52.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.670+0000 7f1566ffd700 1 -- 172.21.15.16:0/3233949578 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f156c00cea0 con 0x7f15700b4d20 2023-06-08T04:02:52.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 -- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f155406ace0 msgr2=0x7f155406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:52.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f155406ace0 0x7f155406d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f15701f5410 tx=0x7f1560007dc0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 -- 172.21.15.16:0/3233949578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15700b4d20 msgr2=0x7f157015de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:52.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15700b4d20 0x7f157015de30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f156c00ebe0 tx=0x7f156c00eef0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 -- 172.21.15.16:0/3233949578 shutdown_connections 2023-06-08T04:02:52.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f155406ace0 0x7f155406d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15700ced40 0x7f15701f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15700b4d20 0x7f157015de30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 --2- 172.21.15.16:0/3233949578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15700b83f0 0x7f1570159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:52.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 -- 172.21.15.16:0/3233949578 >> 172.21.15.16:0/3233949578 conn(0x7f15700cf610 msgr2=0x7f15700b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:52.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 -- 172.21.15.16:0/3233949578 shutdown_connections 2023-06-08T04:02:52.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:52.672+0000 7f15787ff700 1 -- 172.21.15.16:0/3233949578 wait complete. 2023-06-08T04:02:52.680 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-06-08T04:02:52.694 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-06-08T04:02:52.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:52.695 DEBUG:teuthology.orchestra.run.smithi169:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-06-08T04:02:52.790 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2023-06-08T04:02:52.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:02:52.791 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-08T04:02:52.839 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-08T04:02:52.840 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T04:02:53.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.038+0000 7faebd3ff700 1 Processor -- start 2023-06-08T04:02:53.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.038+0000 7faebd3ff700 1 -- start start 2023-06-08T04:02:53.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.039+0000 7faebd3ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faeb8160a60 0x7faeb80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.039+0000 7faebd3ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faeb80b4b50 0x7faeb80d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.039+0000 7faebd3ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80d0800 con 0x7faeb80b83f0 2023-06-08T04:02:53.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.039+0000 7faebd3ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb8160ed0 con 0x7faeb8160a60 2023-06-08T04:02:53.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.039+0000 7faebd3ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80b4fd0 con 0x7faeb80b4b50 2023-06-08T04:02:53.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.039+0000 7faeb67fc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faeb8160a60 0x7faeb80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.040+0000 7faeb6ffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7faeb80b83f0 0x7faeb80ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53512/0 (socket says 172.21.15.16:53512) 2023-06-08T04:02:53.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.040+0000 7faeb6ffd700 1 -- 172.21.15.16:0/2835028546 learned_addr learned my addr 172.21.15.16:0/2835028546 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:53.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.040+0000 7faeb77fe700 1 --2- 172.21.15.16:0/2835028546 >> v2:172.21.15.169:3300/0 conn(0x7faeb80b4b50 0x7faeb80d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.040+0000 7faeb5ffb700 1 -- 172.21.15.16:0/2835028546 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278523389 0 0) 0x7faeb80d0800 con 0x7faeb80b83f0 2023-06-08T04:02:53.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.040+0000 7faeb67fc700 1 -- 172.21.15.16:0/2835028546 >> v2:172.21.15.169:3300/0 conn(0x7faeb80b4b50 msgr2=0x7faeb80d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:53.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.040+0000 7faeb67fc700 1 --2- 172.21.15.16:0/2835028546 >> v2:172.21.15.169:3300/0 conn(0x7faeb80b4b50 0x7faeb80d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.040+0000 7faeb67fc700 1 -- 172.21.15.16:0/2835028546 >> v1:172.21.15.16:6789/0 conn(0x7faeb80b83f0 legacy=0x7faeb80ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.040+0000 7faeb67fc700 1 -- 172.21.15.16:0/2835028546 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80cd1e0 con 0x7faeb8160a60 2023-06-08T04:02:53.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.040+0000 7faeb67fc700 1 --2- 172.21.15.16:0/2835028546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faeb8160a60 0x7faeb80b4610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faeb80b2590 tx=0x7faeac009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e9d6a696720350 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:53.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.040+0000 7faeb5ffb700 1 -- 172.21.15.16:0/2835028546 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac011830 con 0x7faeb8160a60 2023-06-08T04:02:53.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.041+0000 7faeb5ffb700 1 -- 172.21.15.16:0/2835028546 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac011990 con 0x7faeb8160a60 2023-06-08T04:02:53.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.041+0000 7faeb5ffb700 1 -- 172.21.15.16:0/2835028546 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac011d20 con 0x7faeb8160a60 2023-06-08T04:02:53.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.041+0000 7faebd3ff700 1 -- 172.21.15.16:0/2835028546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faeb8160a60 msgr2=0x7faeb80b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.041+0000 7faebd3ff700 1 --2- 172.21.15.16:0/2835028546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faeb8160a60 0x7faeb80b4610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faeb80b2590 tx=0x7faeac009b20 comp rx=0 tx=0).stop 2023-06-08T04:02:53.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.041+0000 7faebd3ff700 1 -- 172.21.15.16:0/2835028546 shutdown_connections 2023-06-08T04:02:53.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.041+0000 7faebd3ff700 1 --2- 172.21.15.16:0/2835028546 >> v2:172.21.15.169:3300/0 conn(0x7faeb80b4b50 0x7faeb80d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.041+0000 7faebd3ff700 1 --2- 172.21.15.16:0/2835028546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faeb8160a60 0x7faeb80b4610 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.041+0000 7faebd3ff700 1 -- 172.21.15.16:0/2835028546 >> 172.21.15.16:0/2835028546 conn(0x7faeb80cf610 msgr2=0x7faeb80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:53.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.041+0000 7faebd3ff700 1 -- 172.21.15.16:0/2835028546 shutdown_connections 2023-06-08T04:02:53.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.041+0000 7faebd3ff700 1 -- 172.21.15.16:0/2835028546 wait complete. 2023-06-08T04:02:53.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.043+0000 7faebd3ff700 1 Processor -- start 2023-06-08T04:02:53.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.043+0000 7faebd3ff700 1 -- start start 2023-06-08T04:02:53.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.044+0000 7faebd3ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faeb80b4b50 0x7faeb814c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.044+0000 7faebd3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeb80b83f0 0x7faeb80cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.044+0000 7faebd3ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faeb8160a60 0x7faeb81f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.044+0000 7faebd3ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80ccd70 con 0x7faeb8160a60 2023-06-08T04:02:53.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.044+0000 7faebd3ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb814c570 con 0x7faeb80b4b50 2023-06-08T04:02:53.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.044+0000 7faebd3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80ccaa0 con 0x7faeb80b83f0 2023-06-08T04:02:53.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.044+0000 7faeb77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faeb8160a60 0x7faeb81f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.044+0000 7faeb77fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faeb8160a60 0x7faeb81f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39784/0 (socket says 172.21.15.16:39784) 2023-06-08T04:02:53.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.044+0000 7faeb77fe700 1 -- 172.21.15.16:0/808298592 learned_addr learned my addr 172.21.15.16:0/808298592 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:53.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.044+0000 7faeb6ffd700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faeb80b4b50 0x7faeb814c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.044+0000 7faeb67fc700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeb80b83f0 0x7faeb80cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.045+0000 7faeb77fe700 1 -- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeb80b83f0 msgr2=0x7faeb80cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.045+0000 7faeb77fe700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeb80b83f0 0x7faeb80cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.045+0000 7faeb77fe700 1 -- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faeb80b4b50 msgr2=0x7faeb814c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.045+0000 7faeb77fe700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faeb80b4b50 0x7faeb814c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.045+0000 7faeb77fe700 1 -- 172.21.15.16:0/808298592 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0094a0 con 0x7faeb8160a60 2023-06-08T04:02:53.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.045+0000 7faeb77fe700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faeb8160a60 0x7faeb81f5360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faeb000efc0 tx=0x7faeb000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:53.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.045+0000 7fae9f7fe700 1 -- 172.21.15.16:0/808298592 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0009ea0 con 0x7faeb8160a60 2023-06-08T04:02:53.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.045+0000 7fae9f7fe700 1 -- 172.21.15.16:0/808298592 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb000f040 con 0x7faeb8160a60 2023-06-08T04:02:53.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.045+0000 7fae9f7fe700 1 -- 172.21.15.16:0/808298592 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000ced0 con 0x7faeb8160a60 2023-06-08T04:02:53.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.045+0000 7faebd3ff700 1 -- 172.21.15.16:0/808298592 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb80c9e00 con 0x7faeb8160a60 2023-06-08T04:02:53.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.045+0000 7faebd3ff700 1 -- 172.21.15.16:0/808298592 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb80ca3c0 con 0x7faeb8160a60 2023-06-08T04:02:53.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.046+0000 7faebd3ff700 1 -- 172.21.15.16:0/808298592 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb80740e0 con 0x7faeb8160a60 2023-06-08T04:02:53.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.047+0000 7fae9f7fe700 1 -- 172.21.15.16:0/808298592 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faeb0014480 con 0x7faeb8160a60 2023-06-08T04:02:53.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.048+0000 7fae9f7fe700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faea406ace0 0x7faea406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.048+0000 7fae9f7fe700 1 -- 172.21.15.16:0/808298592 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7faeb0089cd0 con 0x7faeb8160a60 2023-06-08T04:02:53.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.049+0000 7faeb6ffd700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faea406ace0 0x7faea406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.050+0000 7faeb6ffd700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faea406ace0 0x7faea406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faea8007fd0 tx=0x7faea8007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:53.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.053+0000 7fae9f7fe700 1 -- 172.21.15.16:0/808298592 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faeb0054d30 con 0x7faeb8160a60 2023-06-08T04:02:53.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.301+0000 7faebd3ff700 1 -- 172.21.15.16:0/808298592 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faeb80b8870 con 0x7faeb8160a60 2023-06-08T04:02:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.301+0000 7fae9f7fe700 1 -- 172.21.15.16:0/808298592 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7faeb0018090 con 0x7faeb8160a60 2023-06-08T04:02:53.305 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:53.305 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3633702519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3633702519},{"type":"v1","addr":"172.21.15.16:6834","nonce":3633702519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/711045362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":711045362},{"type":"v1","addr":"172.21.15.169:6837","nonce":711045362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1926912680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1926912680},{"type":"v1","addr":"172.21.15.16:6835","nonce":1926912680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T04:01:57.284697+0000","modified":"2023-06-08T04:02:00.771168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6836/1286012043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1286012043},{"type":"v1","addr":"172.21.15.169:6836","nonce":1286012043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T04:02:53.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 -- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faea406ace0 msgr2=0x7faea406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faea406ace0 0x7faea406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faea8007fd0 tx=0x7faea8007de0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 -- 172.21.15.16:0/808298592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faeb8160a60 msgr2=0x7faeb81f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faeb8160a60 0x7faeb81f5360 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faeb000efc0 tx=0x7faeb000c3a0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 -- 172.21.15.16:0/808298592 shutdown_connections 2023-06-08T04:02:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7faea406ace0 0x7faea406d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faeb8160a60 0x7faeb81f5360 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faeb80b4b50 0x7faeb814c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 --2- 172.21.15.16:0/808298592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faeb80b83f0 0x7faeb80cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 -- 172.21.15.16:0/808298592 >> 172.21.15.16:0/808298592 conn(0x7faeb80cf610 msgr2=0x7faeb80b6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 -- 172.21.15.16:0/808298592 shutdown_connections 2023-06-08T04:02:53.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.304+0000 7faebd3ff700 1 -- 172.21.15.16:0/808298592 wait complete. 2023-06-08T04:02:53.310 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-06-08T04:02:53.328 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:53.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.525+0000 7f70e65ff700 1 Processor -- start 2023-06-08T04:02:53.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.525+0000 7f70e65ff700 1 -- start start 2023-06-08T04:02:53.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.526+0000 7f70e65ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f70e00b83f0 0x7f70e0160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.526+0000 7f70e65ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f70e00b4d20 0x7f70e00d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.526+0000 7f70e65ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e00d0800 con 0x7f70e00ced40 2023-06-08T04:02:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.526+0000 7f70e65ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e00cd1e0 con 0x7f70e00b83f0 2023-06-08T04:02:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.526+0000 7f70e65ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e00cd4c0 con 0x7f70e00b4d20 2023-06-08T04:02:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.526+0000 7f70dffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f70e00b83f0 0x7f70e0160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.526+0000 7f70dffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f70e00b83f0 0x7f70e0160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39790/0 (socket says 172.21.15.16:39790) 2023-06-08T04:02:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.527+0000 7f70dffff700 1 -- 172.21.15.16:0/1763975553 learned_addr learned my addr 172.21.15.16:0/1763975553 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:53.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.527+0000 7f70e4b9c700 1 --2- 172.21.15.16:0/1763975553 >> v2:172.21.15.169:3300/0 conn(0x7f70e00b4d20 0x7f70e00d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.527+0000 7f70dffff700 1 -- 172.21.15.16:0/1763975553 >> v2:172.21.15.169:3300/0 conn(0x7f70e00b4d20 msgr2=0x7f70e00d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:53.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.527+0000 7f70dffff700 1 --2- 172.21.15.16:0/1763975553 >> v2:172.21.15.169:3300/0 conn(0x7f70e00b4d20 0x7f70e00d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.527+0000 7f70dffff700 1 -- 172.21.15.16:0/1763975553 >> v1:172.21.15.169:6789/0 conn(0x7f70e00ced40 legacy=0x7f70e00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.527+0000 7f70dffff700 1 -- 172.21.15.16:0/1763975553 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00d0aa0 con 0x7f70e00b83f0 2023-06-08T04:02:53.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.527+0000 7f70dffff700 1 --2- 172.21.15.16:0/1763975553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70e00b83f0 0x7f70e0160a60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f70e0160fa0 tx=0x7f70d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ecc8c4b92ed9ed server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:53.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.527+0000 7f70deffd700 1 -- 172.21.15.16:0/1763975553 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d000b870 con 0x7f70e00b83f0 2023-06-08T04:02:53.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.527+0000 7f70deffd700 1 -- 172.21.15.16:0/1763975553 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d000b9d0 con 0x7f70e00b83f0 2023-06-08T04:02:53.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.528+0000 7f70deffd700 1 -- 172.21.15.16:0/1763975553 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d000bd60 con 0x7f70e00b83f0 2023-06-08T04:02:53.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.528+0000 7f70e65ff700 1 -- 172.21.15.16:0/1763975553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70e00b83f0 msgr2=0x7f70e0160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.528+0000 7f70e65ff700 1 --2- 172.21.15.16:0/1763975553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70e00b83f0 0x7f70e0160a60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f70e0160fa0 tx=0x7f70d0009bd0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.528+0000 7f70e65ff700 1 -- 172.21.15.16:0/1763975553 shutdown_connections 2023-06-08T04:02:53.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.528+0000 7f70e65ff700 1 --2- 172.21.15.16:0/1763975553 >> v2:172.21.15.169:3300/0 conn(0x7f70e00b4d20 0x7f70e00d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.528+0000 7f70e65ff700 1 --2- 172.21.15.16:0/1763975553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70e00b83f0 0x7f70e0160a60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.528+0000 7f70e65ff700 1 -- 172.21.15.16:0/1763975553 >> 172.21.15.16:0/1763975553 conn(0x7f70e00cf610 msgr2=0x7f70e00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:53.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.528+0000 7f70e65ff700 1 -- 172.21.15.16:0/1763975553 shutdown_connections 2023-06-08T04:02:53.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.528+0000 7f70e65ff700 1 -- 172.21.15.16:0/1763975553 wait complete. 2023-06-08T04:02:53.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.530+0000 7f70e65ff700 1 Processor -- start 2023-06-08T04:02:53.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.530+0000 7f70e65ff700 1 -- start start 2023-06-08T04:02:53.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.531+0000 7f70e65ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70e00b4d20 0x7f70e015ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.531+0000 7f70e65ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70e00b83f0 0x7f70e0151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.531+0000 7f70e65ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70e00ced40 0x7f70e01594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.531+0000 7f70e65ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e015da90 con 0x7f70e00b4d20 2023-06-08T04:02:53.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.531+0000 7f70e65ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e015d7b0 con 0x7f70e00ced40 2023-06-08T04:02:53.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.531+0000 7f70e65ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e015e240 con 0x7f70e00b83f0 2023-06-08T04:02:53.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.531+0000 7f70dffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70e00b4d20 0x7f70e015ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.531+0000 7f70dffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70e00b4d20 0x7f70e015ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39806/0 (socket says 172.21.15.16:39806) 2023-06-08T04:02:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.531+0000 7f70dffff700 1 -- 172.21.15.16:0/3813226941 learned_addr learned my addr 172.21.15.16:0/3813226941 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.531+0000 7f70df7fe700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70e00b83f0 0x7f70e0151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.531+0000 7f70e4b9c700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70e00ced40 0x7f70e01594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.532+0000 7f70dffff700 1 -- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70e00b83f0 msgr2=0x7f70e0151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.532+0000 7f70dffff700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70e00b83f0 0x7f70e0151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.532+0000 7f70dffff700 1 -- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70e00ced40 msgr2=0x7f70e01594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.532+0000 7f70dffff700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70e00ced40 0x7f70e01594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.538 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.532+0000 7f70dffff700 1 -- 172.21.15.16:0/3813226941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0009550 con 0x7f70e00b4d20 2023-06-08T04:02:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.532+0000 7f70dffff700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70e00b4d20 0x7f70e015ea30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f70d0000c00 tx=0x7f70d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.532+0000 7f70dcff9700 1 -- 172.21.15.16:0/3813226941 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0004540 con 0x7f70e00b4d20 2023-06-08T04:02:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.532+0000 7f70dcff9700 1 -- 172.21.15.16:0/3813226941 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d00036a0 con 0x7f70e00b4d20 2023-06-08T04:02:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.532+0000 7f70e65ff700 1 -- 172.21.15.16:0/3813226941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e015e520 con 0x7f70e00b4d20 2023-06-08T04:02:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.532+0000 7f70dcff9700 1 -- 172.21.15.16:0/3813226941 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0003a30 con 0x7f70e00b4d20 2023-06-08T04:02:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.532+0000 7f70e65ff700 1 -- 172.21.15.16:0/3813226941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e00cc900 con 0x7f70e00b4d20 2023-06-08T04:02:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.533+0000 7f70e65ff700 1 -- 172.21.15.16:0/3813226941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e015e0a0 con 0x7f70e00b4d20 2023-06-08T04:02:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.534+0000 7f70dcff9700 1 -- 172.21.15.16:0/3813226941 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f70d0021070 con 0x7f70e00b4d20 2023-06-08T04:02:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.536+0000 7f70dcff9700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f70cc06acb0 0x7f70cc06d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.536+0000 7f70dcff9700 1 -- 172.21.15.16:0/3813226941 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f70d008acd0 con 0x7f70e00b4d20 2023-06-08T04:02:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.536+0000 7f70df7fe700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f70cc06acb0 0x7f70cc06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.537+0000 7f70df7fe700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f70cc06acb0 0x7f70cc06d160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f70e00c97e0 tx=0x7f70d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:53.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.540+0000 7f70dcff9700 1 -- 172.21.15.16:0/3813226941 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f70e015e0a0 con 0x7f70e00b4d20 2023-06-08T04:02:53.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.749+0000 7f70e65ff700 1 -- 172.21.15.16:0/3813226941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70e015e0a0 con 0x7f70e00b4d20 2023-06-08T04:02:53.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.750+0000 7f70dcff9700 1 -- 172.21.15.16:0/3813226941 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18293 (secure 0 0 0) 0x7f70e015e0a0 con 0x7f70e00b4d20 2023-06-08T04:02:53.755 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:53.755 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:02:45.925594+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.26","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:53.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 -- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f70cc06acb0 msgr2=0x7f70cc06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f70cc06acb0 0x7f70cc06d160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f70e00c97e0 tx=0x7f70d4009040 comp rx=0 tx=0).stop 2023-06-08T04:02:53.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 -- 172.21.15.16:0/3813226941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70e00b4d20 msgr2=0x7f70e015ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70e00b4d20 0x7f70e015ea30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f70d0000c00 tx=0x7f70d0004750 comp rx=0 tx=0).stop 2023-06-08T04:02:53.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 -- 172.21.15.16:0/3813226941 shutdown_connections 2023-06-08T04:02:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f70cc06acb0 0x7f70cc06d160 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f70e00ced40 0x7f70e01594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70e00b4d20 0x7f70e015ea30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 --2- 172.21.15.16:0/3813226941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f70e00b83f0 0x7f70e0151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 -- 172.21.15.16:0/3813226941 >> 172.21.15.16:0/3813226941 conn(0x7f70e00cf610 msgr2=0x7f70e00b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:53.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 -- 172.21.15.16:0/3813226941 shutdown_connections 2023-06-08T04:02:53.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.753+0000 7f70e65ff700 1 -- 172.21.15.16:0/3813226941 wait complete. 2023-06-08T04:02:53.774 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:01:54.980592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:01:56.264608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:02:53.775 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:02:53.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.976+0000 7f2848dff700 1 Processor -- start 2023-06-08T04:02:53.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.976+0000 7f2848dff700 1 -- start start 2023-06-08T04:02:53.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.977+0000 7f2848dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844160a60 0x7f28440b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.977+0000 7f2848dff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f28440b4b50 0x7f28440d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.977+0000 7f2848dff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28440d0800 con 0x7f28440b83f0 2023-06-08T04:02:53.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.977+0000 7f2848dff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2844160ed0 con 0x7f28440b4b50 2023-06-08T04:02:53.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.977+0000 7f2848dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28440b4fd0 con 0x7f2844160a60 2023-06-08T04:02:53.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.977+0000 7f284259c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f28440b83f0 0x7f28440ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53514/0 (socket says 172.21.15.16:53514) 2023-06-08T04:02:53.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.977+0000 7f284259c700 1 -- 172.21.15.16:0/1244012050 learned_addr learned my addr 172.21.15.16:0/1244012050 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:53.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f2842d9d700 1 --2- 172.21.15.16:0/1244012050 >> v2:172.21.15.169:3300/0 conn(0x7f28440b4b50 0x7f28440d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f2841d9b700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844160a60 0x7f28440b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879856582 0 0) 0x7f28440d0800 con 0x7f28440b83f0 2023-06-08T04:02:53.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f282c0035b0 con 0x7f28440b83f0 2023-06-08T04:02:53.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4199355188 0 0) 0x7f282c0035b0 con 0x7f28440b83f0 2023-06-08T04:02:53.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844160a60 msgr2=0x7f28440b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:53.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844160a60 0x7f28440b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 >> v2:172.21.15.169:3300/0 conn(0x7f28440b4b50 msgr2=0x7f28440d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:53.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 --2- 172.21.15.16:0/1244012050 >> v2:172.21.15.169:3300/0 conn(0x7f28440b4b50 0x7f28440d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440cd1e0 con 0x7f28440b83f0 2023-06-08T04:02:53.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7f2834001670 con 0x7f28440b83f0 2023-06-08T04:02:53.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 >> v1:172.21.15.16:6789/0 conn(0x7f28440b83f0 legacy=0x7f28440ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c003a00 0x7f282c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f282c004430 0x7f282c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844160a60 0x7f282c005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440b4fd0 con 0x7f282c004430 2023-06-08T04:02:53.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282c00ba10 con 0x7f282c003a00 2023-06-08T04:02:53.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282c00bb50 con 0x7f2844160a60 2023-06-08T04:02:53.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.978+0000 7f2841d9b700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f282c004430 0x7f282c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.979+0000 7f2842d9d700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844160a60 0x7f282c005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.979+0000 7f284259c700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c003a00 0x7f282c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.979+0000 7f2841d9b700 1 -- 172.21.15.16:0/1244012050 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844160a60 msgr2=0x7f282c005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:53.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.979+0000 7f2841d9b700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844160a60 0x7f282c005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.979+0000 7f2841d9b700 1 -- 172.21.15.16:0/1244012050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c003a00 msgr2=0x7f282c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:53.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.979+0000 7f2841d9b700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c003a00 0x7f282c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.979+0000 7f2841d9b700 1 -- 172.21.15.16:0/1244012050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c0035b0 con 0x7f282c004430 2023-06-08T04:02:53.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.979+0000 7f2841d9b700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f282c004430 0x7f282c0048f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2838009b90 tx=0x7f282c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bd70074517a593 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:53.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.979+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283800e6c0 con 0x7f282c004430 2023-06-08T04:02:53.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.979+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283800e820 con 0x7f282c004430 2023-06-08T04:02:53.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.979+0000 7f284159a700 1 -- 172.21.15.16:0/1244012050 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283800eb90 con 0x7f282c004430 2023-06-08T04:02:53.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.980+0000 7f2848dff700 1 -- 172.21.15.16:0/1244012050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f282c004430 msgr2=0x7f282c0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.980+0000 7f2848dff700 1 --2- 172.21.15.16:0/1244012050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f282c004430 0x7f282c0048f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2838009b90 tx=0x7f282c005880 comp rx=0 tx=0).stop 2023-06-08T04:02:53.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.980+0000 7f2842d9d700 1 -- 172.21.15.16:0/1244012050 reap_dead start 2023-06-08T04:02:53.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.980+0000 7f2848dff700 1 -- 172.21.15.16:0/1244012050 shutdown_connections 2023-06-08T04:02:53.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.980+0000 7f2848dff700 1 -- 172.21.15.16:0/1244012050 >> 172.21.15.16:0/1244012050 conn(0x7f28440cf610 msgr2=0x7f28440cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:53.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.980+0000 7f2848dff700 1 -- 172.21.15.16:0/1244012050 shutdown_connections 2023-06-08T04:02:53.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.980+0000 7f2848dff700 1 -- 172.21.15.16:0/1244012050 wait complete. 2023-06-08T04:02:53.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.982+0000 7f2848dff700 1 Processor -- start 2023-06-08T04:02:53.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.982+0000 7f2848dff700 1 -- start start 2023-06-08T04:02:53.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.983+0000 7f2848dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c004430 0x7f28440c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.991 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.983+0000 7f2848dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844149890 0x7f28440cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.983+0000 7f2848dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28440cc1b0 0x7f284415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.983+0000 7f2848dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2844149400 con 0x7f28440cc1b0 2023-06-08T04:02:53.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.983+0000 7f2848dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440ccad0 con 0x7f282c004430 2023-06-08T04:02:53.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.983+0000 7f2848dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28440cc7f0 con 0x7f2844149890 2023-06-08T04:02:53.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.983+0000 7f2842d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28440cc1b0 0x7f284415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.983+0000 7f2842d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28440cc1b0 0x7f284415b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39828/0 (socket says 172.21.15.16:39828) 2023-06-08T04:02:53.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.983+0000 7f2842d9d700 1 -- 172.21.15.16:0/3265622448 learned_addr learned my addr 172.21.15.16:0/3265622448 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:53.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.983+0000 7f2841d9b700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844149890 0x7f28440cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.983+0000 7f284259c700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c004430 0x7f28440c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.984+0000 7f2842d9d700 1 -- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844149890 msgr2=0x7f28440cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.984+0000 7f2842d9d700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844149890 0x7f28440cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.984+0000 7f2842d9d700 1 -- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c004430 msgr2=0x7f28440c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:53.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.984+0000 7f2842d9d700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c004430 0x7f28440c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:53.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.984+0000 7f2842d9d700 1 -- 172.21.15.16:0/3265622448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844148db0 con 0x7f28440cc1b0 2023-06-08T04:02:53.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.984+0000 7f2842d9d700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28440cc1b0 0x7f284415b350 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f284408c030 tx=0x7f283c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:53.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.984+0000 7f2832ffd700 1 -- 172.21.15.16:0/3265622448 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c00e040 con 0x7f28440cc1b0 2023-06-08T04:02:53.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.984+0000 7f2832ffd700 1 -- 172.21.15.16:0/3265622448 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c00f040 con 0x7f28440cc1b0 2023-06-08T04:02:53.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.984+0000 7f2848dff700 1 -- 172.21.15.16:0/3265622448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2844149090 con 0x7f28440cc1b0 2023-06-08T04:02:53.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.984+0000 7f2832ffd700 1 -- 172.21.15.16:0/3265622448 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c00fe40 con 0x7f28440cc1b0 2023-06-08T04:02:53.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.984+0000 7f2848dff700 1 -- 172.21.15.16:0/3265622448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284415b890 con 0x7f28440cc1b0 2023-06-08T04:02:53.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.985+0000 7f2848dff700 1 -- 172.21.15.16:0/3265622448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2844149220 con 0x7f28440cc1b0 2023-06-08T04:02:53.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.986+0000 7f2832ffd700 1 -- 172.21.15.16:0/3265622448 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f283c022460 con 0x7f28440cc1b0 2023-06-08T04:02:53.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.987+0000 7f2832ffd700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f282406ace0 0x7f282406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:53.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.987+0000 7f2832ffd700 1 -- 172.21.15.16:0/3265622448 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f283c0899b0 con 0x7f28440cc1b0 2023-06-08T04:02:53.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.988+0000 7f284259c700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f282406ace0 0x7f282406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:53.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.988+0000 7f284259c700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f282406ace0 0x7f282406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2834001050 tx=0x7f2834007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:53.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:53.991+0000 7f2832ffd700 1 -- 172.21.15.16:0/3265622448 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f283c054a20 con 0x7f28440cc1b0 2023-06-08T04:02:54.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.198+0000 7f2848dff700 1 -- 172.21.15.16:0/3265622448 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28441496e0 con 0x7f28440cc1b0 2023-06-08T04:02:54.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.199+0000 7f2832ffd700 1 -- 172.21.15.16:0/3265622448 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f283c058040 con 0x7f28440cc1b0 2023-06-08T04:02:54.202 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:02:54.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 -- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f282406ace0 msgr2=0x7f282406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f282406ace0 0x7f282406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2834001050 tx=0x7f2834007040 comp rx=0 tx=0).stop 2023-06-08T04:02:54.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 -- 172.21.15.16:0/3265622448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28440cc1b0 msgr2=0x7f284415b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28440cc1b0 0x7f284415b350 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f284408c030 tx=0x7f283c011f60 comp rx=0 tx=0).stop 2023-06-08T04:02:54.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 -- 172.21.15.16:0/3265622448 shutdown_connections 2023-06-08T04:02:54.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f282406ace0 0x7f282406d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28440cc1b0 0x7f284415b350 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f282c004430 0x7f28440c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 --2- 172.21.15.16:0/3265622448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2844149890 0x7f28440cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 -- 172.21.15.16:0/3265622448 >> 172.21.15.16:0/3265622448 conn(0x7f28440cf610 msgr2=0x7f28440b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:54.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 -- 172.21.15.16:0/3265622448 shutdown_connections 2023-06-08T04:02:54.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.201+0000 7f2848dff700 1 -- 172.21.15.16:0/3265622448 wait complete. 2023-06-08T04:02:54.223 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:02:54.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.422+0000 7ff1d0bff700 1 Processor -- start 2023-06-08T04:02:54.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.422+0000 7ff1d0bff700 1 -- start start 2023-06-08T04:02:54.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.423+0000 7ff1d0bff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff1cc0b83f0 0x7ff1cc160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.423+0000 7ff1d0bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc0ced40 0x7ff1cc0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.423+0000 7ff1d0bff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0d0800 con 0x7ff1cc0b4b50 2023-06-08T04:02:54.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.423+0000 7ff1d0bff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b4fd0 con 0x7ff1cc0b83f0 2023-06-08T04:02:54.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.423+0000 7ff1d0bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0cd1e0 con 0x7ff1cc0ced40 2023-06-08T04:02:54.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.424+0000 7ff1cad9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff1cc0b4b50 0x7ff1cc06b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53518/0 (socket says 172.21.15.16:53518) 2023-06-08T04:02:54.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.424+0000 7ff1cad9d700 1 -- 172.21.15.16:0/312499701 learned_addr learned my addr 172.21.15.16:0/312499701 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:54.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.424+0000 7ff1ca59c700 1 --2- 172.21.15.16:0/312499701 >> v2:172.21.15.169:3300/0 conn(0x7ff1cc0b83f0 0x7ff1cc160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.424+0000 7ff1c3fff700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc0ced40 0x7ff1cc0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.424+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767986577 0 0) 0x7ff1cc0d0800 con 0x7ff1cc0b4b50 2023-06-08T04:02:54.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.424+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b80035b0 con 0x7ff1cc0b4b50 2023-06-08T04:02:54.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.424+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2870878992 0 0) 0x7ff1b80035b0 con 0x7ff1cc0b4b50 2023-06-08T04:02:54.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc0ced40 msgr2=0x7ff1cc0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:54.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc0ced40 0x7ff1cc0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 >> v2:172.21.15.169:3300/0 conn(0x7ff1cc0b83f0 msgr2=0x7ff1cc160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:54.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 --2- 172.21.15.16:0/312499701 >> v2:172.21.15.169:3300/0 conn(0x7ff1cc0b83f0 0x7ff1cc160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0cd4c0 con 0x7ff1cc0b4b50 2023-06-08T04:02:54.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7ff1c40019f0 con 0x7ff1cc0b4b50 2023-06-08T04:02:54.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 >> v1:172.21.15.16:6789/0 conn(0x7ff1cc0b4b50 legacy=0x7ff1cc06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1b8003a00 0x7ff1b8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1b8004850 0x7ff1b8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc0ced40 0x7ff1b8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b4fd0 con 0x7ff1b8004850 2023-06-08T04:02:54.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0cd1e0 con 0x7ff1b8003a00 2023-06-08T04:02:54.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b800ba40 con 0x7ff1cc0ced40 2023-06-08T04:02:54.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1ca59c700 1 --2- 172.21.15.16:0/312499701 >> v2:172.21.15.169:3300/0 conn(0x7ff1cc0b83f0 0x7ff1cc160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:02:54.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c3fff700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1b8004850 0x7ff1b8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1cad9d700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc0ced40 0x7ff1b8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1ca59c700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1b8003a00 0x7ff1b8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c3fff700 1 -- 172.21.15.16:0/312499701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc0ced40 msgr2=0x7ff1b8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:54.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c3fff700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc0ced40 0x7ff1b8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c3fff700 1 -- 172.21.15.16:0/312499701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1b8003a00 msgr2=0x7ff1b8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:54.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c3fff700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1b8003a00 0x7ff1b8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.425+0000 7ff1c3fff700 1 -- 172.21.15.16:0/312499701 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80035b0 con 0x7ff1b8004850 2023-06-08T04:02:54.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.426+0000 7ff1c3fff700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1b8004850 0x7ff1b8004cc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009b60 tx=0x7ff1b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee67df2311392fcc server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:54.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.426+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400e6c0 con 0x7ff1b8004850 2023-06-08T04:02:54.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.426+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b400e820 con 0x7ff1b8004850 2023-06-08T04:02:54.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.426+0000 7ff1c9d9b700 1 -- 172.21.15.16:0/312499701 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400eb90 con 0x7ff1b8004850 2023-06-08T04:02:54.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.426+0000 7ff1d0bff700 1 -- 172.21.15.16:0/312499701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1b8004850 msgr2=0x7ff1b8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.426+0000 7ff1d0bff700 1 --2- 172.21.15.16:0/312499701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1b8004850 0x7ff1b8004cc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009b60 tx=0x7ff1b8005880 comp rx=0 tx=0).stop 2023-06-08T04:02:54.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.426+0000 7ff1cad9d700 1 -- 172.21.15.16:0/312499701 reap_dead start 2023-06-08T04:02:54.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.427+0000 7ff1d0bff700 1 -- 172.21.15.16:0/312499701 shutdown_connections 2023-06-08T04:02:54.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.427+0000 7ff1d0bff700 1 -- 172.21.15.16:0/312499701 >> 172.21.15.16:0/312499701 conn(0x7ff1cc0cf610 msgr2=0x7ff1cc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:54.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.427+0000 7ff1d0bff700 1 -- 172.21.15.16:0/312499701 shutdown_connections 2023-06-08T04:02:54.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.427+0000 7ff1d0bff700 1 -- 172.21.15.16:0/312499701 wait complete. 2023-06-08T04:02:54.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.428+0000 7ff1d0bff700 1 Processor -- start 2023-06-08T04:02:54.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.429+0000 7ff1d0bff700 1 -- start start 2023-06-08T04:02:54.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.429+0000 7ff1d0bff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1b8004850 0x7ff1cc159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1d0bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc159990 0x7ff1cc0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1d0bff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1cc159ec0 0x7ff1cc0ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1d0bff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc1597d0 con 0x7ff1cc159ec0 2023-06-08T04:02:54.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1d0bff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc1e7450 con 0x7ff1b8004850 2023-06-08T04:02:54.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1d0bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0cc920 con 0x7ff1cc159990 2023-06-08T04:02:54.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1cad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1cc159ec0 0x7ff1cc0ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1cad9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1cc159ec0 0x7ff1cc0ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39832/0 (socket says 172.21.15.16:39832) 2023-06-08T04:02:54.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1cad9d700 1 -- 172.21.15.16:0/3230569661 learned_addr learned my addr 172.21.15.16:0/3230569661 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:54.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1c3fff700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc159990 0x7ff1cc0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1ca59c700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1b8004850 0x7ff1cc159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1cad9d700 1 -- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc159990 msgr2=0x7ff1cc0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1cad9d700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc159990 0x7ff1cc0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1cad9d700 1 -- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1b8004850 msgr2=0x7ff1cc159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1cad9d700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1b8004850 0x7ff1cc159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1cad9d700 1 -- 172.21.15.16:0/3230569661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0ccc00 con 0x7ff1cc159ec0 2023-06-08T04:02:54.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1ca59c700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1b8004850 0x7ff1cc159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:54.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.430+0000 7ff1cad9d700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1cc159ec0 0x7ff1cc0ca1a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc06c4e0 tx=0x7ff1c400a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:54.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.431+0000 7ff1c2ffd700 1 -- 172.21.15.16:0/3230569661 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400ad20 con 0x7ff1cc159ec0 2023-06-08T04:02:54.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.431+0000 7ff1c2ffd700 1 -- 172.21.15.16:0/3230569661 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c40133f0 con 0x7ff1cc159ec0 2023-06-08T04:02:54.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.431+0000 7ff1d0bff700 1 -- 172.21.15.16:0/3230569661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc1e6e00 con 0x7ff1cc159ec0 2023-06-08T04:02:54.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.431+0000 7ff1c2ffd700 1 -- 172.21.15.16:0/3230569661 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400aea0 con 0x7ff1cc159ec0 2023-06-08T04:02:54.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.431+0000 7ff1d0bff700 1 -- 172.21.15.16:0/3230569661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc0ccee0 con 0x7ff1cc159ec0 2023-06-08T04:02:54.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.432+0000 7ff1d0bff700 1 -- 172.21.15.16:0/3230569661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc1e7730 con 0x7ff1cc159ec0 2023-06-08T04:02:54.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.433+0000 7ff1c2ffd700 1 -- 172.21.15.16:0/3230569661 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff1c40137a0 con 0x7ff1cc159ec0 2023-06-08T04:02:54.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.434+0000 7ff1c2ffd700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff1ac06ace0 0x7ff1ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.434+0000 7ff1c2ffd700 1 -- 172.21.15.16:0/3230569661 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff1c408a080 con 0x7ff1cc159ec0 2023-06-08T04:02:54.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.434+0000 7ff1ca59c700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff1ac06ace0 0x7ff1ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.435+0000 7ff1ca59c700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff1ac06ace0 0x7ff1ac06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc15cfb0 tx=0x7ff1bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:54.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.438+0000 7ff1c2ffd700 1 -- 172.21.15.16:0/3230569661 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff1c40bc310 con 0x7ff1cc159ec0 2023-06-08T04:02:54.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.640+0000 7ff1d0bff700 1 -- 172.21.15.16:0/3230569661 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1cc0b1670 con 0x7ff1cc159ec0 2023-06-08T04:02:54.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.640+0000 7ff1c2ffd700 1 -- 172.21.15.16:0/3230569661 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1cc0b1670 con 0x7ff1cc159ec0 2023-06-08T04:02:54.644 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:02:54.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.642+0000 7ff1d0bff700 1 -- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff1ac06ace0 msgr2=0x7ff1ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.642+0000 7ff1d0bff700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff1ac06ace0 0x7ff1ac06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc15cfb0 tx=0x7ff1bc008040 comp rx=0 tx=0).stop 2023-06-08T04:02:54.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.642+0000 7ff1d0bff700 1 -- 172.21.15.16:0/3230569661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1cc159ec0 msgr2=0x7ff1cc0ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.642+0000 7ff1d0bff700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1cc159ec0 0x7ff1cc0ca1a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc06c4e0 tx=0x7ff1c400a550 comp rx=0 tx=0).stop 2023-06-08T04:02:54.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.642+0000 7ff1d0bff700 1 -- 172.21.15.16:0/3230569661 shutdown_connections 2023-06-08T04:02:54.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.642+0000 7ff1d0bff700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff1ac06ace0 0x7ff1ac06d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.642+0000 7ff1d0bff700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1cc159ec0 0x7ff1cc0ca1a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.642+0000 7ff1d0bff700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1b8004850 0x7ff1cc159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.642+0000 7ff1d0bff700 1 --2- 172.21.15.16:0/3230569661 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1cc159990 0x7ff1cc0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.643+0000 7ff1d0bff700 1 -- 172.21.15.16:0/3230569661 >> 172.21.15.16:0/3230569661 conn(0x7ff1cc0cf610 msgr2=0x7ff1cc0b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:54.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.643+0000 7ff1d0bff700 1 -- 172.21.15.16:0/3230569661 shutdown_connections 2023-06-08T04:02:54.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.643+0000 7ff1d0bff700 1 -- 172.21.15.16:0/3230569661 wait complete. 2023-06-08T04:02:54.664 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:02:54.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.865+0000 7f10b75ff700 1 Processor -- start 2023-06-08T04:02:54.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.865+0000 7f10b75ff700 1 -- start start 2023-06-08T04:02:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b75ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f10b00b83f0 0x7f10b0160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b75ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f10b00b4d20 0x7f10b00d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b75ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b00d0800 con 0x7f10b00ced40 2023-06-08T04:02:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b75ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b00cd1e0 con 0x7f10b00b4d20 2023-06-08T04:02:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b75ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b00cd4c0 con 0x7f10b00b83f0 2023-06-08T04:02:54.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b5b9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f10b00b4d20 0x7f10b00d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b5b9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f10b00b4d20 0x7f10b00d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39842/0 (socket says 172.21.15.16:39842) 2023-06-08T04:02:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b5b9c700 1 -- 172.21.15.16:0/2394451542 learned_addr learned my addr 172.21.15.16:0/2394451542 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:54.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b539b700 1 --2- 172.21.15.16:0/2394451542 >> v2:172.21.15.169:3300/0 conn(0x7f10b00b83f0 0x7f10b0160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b5b9c700 1 -- 172.21.15.16:0/2394451542 >> v2:172.21.15.169:3300/0 conn(0x7f10b00b83f0 msgr2=0x7f10b0160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:54.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b5b9c700 1 --2- 172.21.15.16:0/2394451542 >> v2:172.21.15.169:3300/0 conn(0x7f10b00b83f0 0x7f10b0160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b5b9c700 1 -- 172.21.15.16:0/2394451542 >> v1:172.21.15.169:6789/0 conn(0x7f10b00ced40 legacy=0x7f10b00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.867+0000 7f10b5b9c700 1 -- 172.21.15.16:0/2394451542 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b00d0aa0 con 0x7f10b00b4d20 2023-06-08T04:02:54.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.868+0000 7f10b5b9c700 1 --2- 172.21.15.16:0/2394451542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10b00b4d20 0x7f10b00d0fc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f10b006ca80 tx=0x7f10a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673872ba390809e3 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:54.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.868+0000 7f10a7fff700 1 -- 172.21.15.16:0/2394451542 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a800e070 con 0x7f10b00b4d20 2023-06-08T04:02:54.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.868+0000 7f10a7fff700 1 -- 172.21.15.16:0/2394451542 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a800b910 con 0x7f10b00b4d20 2023-06-08T04:02:54.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.868+0000 7f10a7fff700 1 -- 172.21.15.16:0/2394451542 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a800bcc0 con 0x7f10b00b4d20 2023-06-08T04:02:54.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.868+0000 7f10b75ff700 1 -- 172.21.15.16:0/2394451542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10b00b4d20 msgr2=0x7f10b00d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.868+0000 7f10b75ff700 1 --2- 172.21.15.16:0/2394451542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10b00b4d20 0x7f10b00d0fc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f10b006ca80 tx=0x7f10a800b330 comp rx=0 tx=0).stop 2023-06-08T04:02:54.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.869+0000 7f10b75ff700 1 -- 172.21.15.16:0/2394451542 shutdown_connections 2023-06-08T04:02:54.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.869+0000 7f10b75ff700 1 --2- 172.21.15.16:0/2394451542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10b00b4d20 0x7f10b00d0fc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.869+0000 7f10b75ff700 1 --2- 172.21.15.16:0/2394451542 >> v2:172.21.15.169:3300/0 conn(0x7f10b00b83f0 0x7f10b0160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.869+0000 7f10b75ff700 1 -- 172.21.15.16:0/2394451542 >> 172.21.15.16:0/2394451542 conn(0x7f10b00cf610 msgr2=0x7f10b00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:54.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.869+0000 7f10b75ff700 1 -- 172.21.15.16:0/2394451542 shutdown_connections 2023-06-08T04:02:54.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.869+0000 7f10b75ff700 1 -- 172.21.15.16:0/2394451542 wait complete. 2023-06-08T04:02:54.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.870+0000 7f10b75ff700 1 Processor -- start 2023-06-08T04:02:54.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.871+0000 7f10b75ff700 1 -- start start 2023-06-08T04:02:54.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b75ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10b00b4d20 0x7f10b00c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b75ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10b00b83f0 0x7f10b01541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b75ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10b00ced40 0x7f10b015f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b75ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00c6aa0 con 0x7f10b00b83f0 2023-06-08T04:02:54.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b75ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00c6d80 con 0x7f10b00ced40 2023-06-08T04:02:54.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b75ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00c7060 con 0x7f10b00b4d20 2023-06-08T04:02:54.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b4b9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10b00b83f0 0x7f10b01541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b4b9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10b00b83f0 0x7f10b01541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39848/0 (socket says 172.21.15.16:39848) 2023-06-08T04:02:54.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b4b9a700 1 -- 172.21.15.16:0/3353608377 learned_addr learned my addr 172.21.15.16:0/3353608377 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:54.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b539b700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10b00b4d20 0x7f10b00c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b5b9c700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10b00ced40 0x7f10b015f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b4b9a700 1 -- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10b00b4d20 msgr2=0x7f10b00c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b4b9a700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10b00b4d20 0x7f10b00c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b4b9a700 1 -- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10b00ced40 msgr2=0x7f10b015f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:54.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b4b9a700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10b00ced40 0x7f10b015f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:54.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.872+0000 7f10b4b9a700 1 -- 172.21.15.16:0/3353608377 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a8009b30 con 0x7f10b00b83f0 2023-06-08T04:02:54.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.873+0000 7f10b4b9a700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10b00b83f0 0x7f10b01541b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c450 tx=0x7f10a000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:54.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.873+0000 7f10a5ffb700 1 -- 172.21.15.16:0/3353608377 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00052d0 con 0x7f10b00b83f0 2023-06-08T04:02:54.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.873+0000 7f10a5ffb700 1 -- 172.21.15.16:0/3353608377 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a0005430 con 0x7f10b00b83f0 2023-06-08T04:02:54.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.873+0000 7f10a5ffb700 1 -- 172.21.15.16:0/3353608377 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00038c0 con 0x7f10b00b83f0 2023-06-08T04:02:54.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.873+0000 7f10b75ff700 1 -- 172.21.15.16:0/3353608377 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b00c7340 con 0x7f10b00b83f0 2023-06-08T04:02:54.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.873+0000 7f10b75ff700 1 -- 172.21.15.16:0/3353608377 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b00c8080 con 0x7f10b00b83f0 2023-06-08T04:02:54.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.874+0000 7f10b75ff700 1 -- 172.21.15.16:0/3353608377 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b00740e0 con 0x7f10b00b83f0 2023-06-08T04:02:54.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.875+0000 7f10a5ffb700 1 -- 172.21.15.16:0/3353608377 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10a0003a20 con 0x7f10b00b83f0 2023-06-08T04:02:54.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.876+0000 7f10a5ffb700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f109406ace0 0x7f109406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:54.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.876+0000 7f10a5ffb700 1 -- 172.21.15.16:0/3353608377 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f10a0088870 con 0x7f10b00b83f0 2023-06-08T04:02:54.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.876+0000 7f10b539b700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f109406ace0 0x7f109406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:54.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.877+0000 7f10b539b700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f109406ace0 0x7f109406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009b70 tx=0x7f10ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:54.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:54.880+0000 7f10a5ffb700 1 -- 172.21.15.16:0/3353608377 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f10a00538d0 con 0x7f10b00b83f0 2023-06-08T04:02:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.088+0000 7f10b75ff700 1 -- 172.21.15.16:0/3353608377 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10b00c7860 con 0x7f10b00b83f0 2023-06-08T04:02:55.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.088+0000 7f10a5ffb700 1 -- 172.21.15.16:0/3353608377 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10b00c7860 con 0x7f10b00b83f0 2023-06-08T04:02:55.093 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:02:55.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 -- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f109406ace0 msgr2=0x7f109406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f109406ace0 0x7f109406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009b70 tx=0x7f10ac008040 comp rx=0 tx=0).stop 2023-06-08T04:02:55.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 -- 172.21.15.16:0/3353608377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10b00b83f0 msgr2=0x7f10b01541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10b00b83f0 0x7f10b01541b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c450 tx=0x7f10a000c810 comp rx=0 tx=0).stop 2023-06-08T04:02:55.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 -- 172.21.15.16:0/3353608377 shutdown_connections 2023-06-08T04:02:55.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f109406ace0 0x7f109406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10b00ced40 0x7f10b015f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10b00b4d20 0x7f10b00c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 --2- 172.21.15.16:0/3353608377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10b00b83f0 0x7f10b01541b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 -- 172.21.15.16:0/3353608377 >> 172.21.15.16:0/3353608377 conn(0x7f10b00cf610 msgr2=0x7f10b00b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 -- 172.21.15.16:0/3353608377 shutdown_connections 2023-06-08T04:02:55.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.091+0000 7f10b75ff700 1 -- 172.21.15.16:0/3353608377 wait complete. 2023-06-08T04:02:55.113 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:02:55.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.312+0000 7f7a63dff700 1 Processor -- start 2023-06-08T04:02:55.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.312+0000 7f7a63dff700 1 -- start start 2023-06-08T04:02:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.313+0000 7f7a63dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a5c160a60 0x7f7a5c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.313+0000 7f7a63dff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c0d0800 con 0x7f7a5c0b83f0 2023-06-08T04:02:55.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.313+0000 7f7a63dff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c0cd1e0 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.313+0000 7f7a63dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c160ed0 con 0x7f7a5c160a60 2023-06-08T04:02:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.314+0000 7f7a61b9b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7a5c0b83f0 0x7f7a5c0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53534/0 (socket says 172.21.15.16:53534) 2023-06-08T04:02:55.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.314+0000 7f7a61b9b700 1 -- 172.21.15.16:0/3312965465 learned_addr learned my addr 172.21.15.16:0/3312965465 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:55.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.314+0000 7f7a6139a700 1 --2- 172.21.15.16:0/3312965465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a5c160a60 0x7f7a5c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:55.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.314+0000 7f7a60b99700 1 -- 172.21.15.16:0/3312965465 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223460185 0 0) 0x7f7a5c0d0800 con 0x7f7a5c0b83f0 2023-06-08T04:02:55.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.314+0000 7f7a60b99700 1 -- 172.21.15.16:0/3312965465 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a480035b0 con 0x7f7a5c0b83f0 2023-06-08T04:02:55.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.314+0000 7f7a60b99700 1 -- 172.21.15.16:0/3312965465 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509570632 0 0) 0x7f7a5c0cd1e0 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.314+0000 7f7a60b99700 1 -- 172.21.15.16:0/3312965465 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a5c0d0800 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.314+0000 7f7a6139a700 1 -- 172.21.15.16:0/3312965465 >> v1:172.21.15.169:6789/0 conn(0x7f7a5c0b4b50 legacy=0x7f7a5c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.314+0000 7f7a6139a700 1 -- 172.21.15.16:0/3312965465 >> v1:172.21.15.16:6789/0 conn(0x7f7a5c0b83f0 legacy=0x7f7a5c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.314+0000 7f7a6139a700 1 -- 172.21.15.16:0/3312965465 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0cd4c0 con 0x7f7a5c160a60 2023-06-08T04:02:55.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.315+0000 7f7a6139a700 1 --2- 172.21.15.16:0/3312965465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a5c160a60 0x7f7a5c0b4610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009870 tx=0x7f7a4c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8be4ada4f4f7fbbc server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:55.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.315+0000 7f7a60b99700 1 -- 172.21.15.16:0/3312965465 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c011830 con 0x7f7a5c160a60 2023-06-08T04:02:55.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.315+0000 7f7a60b99700 1 -- 172.21.15.16:0/3312965465 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c011990 con 0x7f7a5c160a60 2023-06-08T04:02:55.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.315+0000 7f7a60b99700 1 -- 172.21.15.16:0/3312965465 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c011d00 con 0x7f7a5c160a60 2023-06-08T04:02:55.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.316+0000 7f7a63dff700 1 -- 172.21.15.16:0/3312965465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a5c160a60 msgr2=0x7f7a5c0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.316+0000 7f7a63dff700 1 --2- 172.21.15.16:0/3312965465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a5c160a60 0x7f7a5c0b4610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009870 tx=0x7f7a4c009b80 comp rx=0 tx=0).stop 2023-06-08T04:02:55.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.316+0000 7f7a63dff700 1 -- 172.21.15.16:0/3312965465 shutdown_connections 2023-06-08T04:02:55.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.316+0000 7f7a63dff700 1 --2- 172.21.15.16:0/3312965465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a5c160a60 0x7f7a5c0b4610 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.316+0000 7f7a63dff700 1 -- 172.21.15.16:0/3312965465 >> 172.21.15.16:0/3312965465 conn(0x7f7a5c0cf610 msgr2=0x7f7a5c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:55.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.316+0000 7f7a63dff700 1 -- 172.21.15.16:0/3312965465 shutdown_connections 2023-06-08T04:02:55.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.316+0000 7f7a63dff700 1 -- 172.21.15.16:0/3312965465 wait complete. 2023-06-08T04:02:55.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.317+0000 7f7a63dff700 1 Processor -- start 2023-06-08T04:02:55.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.318+0000 7f7a63dff700 1 -- start start 2023-06-08T04:02:55.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a63dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a5c0b4b50 0x7f7a5c150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:55.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a63dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a5c0b83f0 0x7f7a5c159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:55.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a63dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a5c160a60 0x7f7a5c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:55.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a63dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c159510 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a63dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0ca4b0 con 0x7f7a5c0b83f0 2023-06-08T04:02:55.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a63dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c1597b0 con 0x7f7a5c160a60 2023-06-08T04:02:55.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a61b9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a5c0b4b50 0x7f7a5c150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:55.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a61b9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a5c0b4b50 0x7f7a5c150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39858/0 (socket says 172.21.15.16:39858) 2023-06-08T04:02:55.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a61b9b700 1 -- 172.21.15.16:0/2819873288 learned_addr learned my addr 172.21.15.16:0/2819873288 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:55.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a61b9b700 1 -- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a5c160a60 msgr2=0x7f7a5c0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a61b9b700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a5c160a60 0x7f7a5c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a61b9b700 1 -- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a5c0b83f0 msgr2=0x7f7a5c159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a61b9b700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a5c0b83f0 0x7f7a5c159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.319+0000 7f7a61b9b700 1 -- 172.21.15.16:0/2819873288 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0094a0 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.320+0000 7f7a61b9b700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a5c0b4b50 0x7f7a5c150e50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800c700 tx=0x7f7a5800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:55.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.320+0000 7f7a527fc700 1 -- 172.21.15.16:0/2819873288 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a58005d70 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.320+0000 7f7a527fc700 1 -- 172.21.15.16:0/2819873288 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a580070d0 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.320+0000 7f7a63dff700 1 -- 172.21.15.16:0/2819873288 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c159a90 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.320+0000 7f7a527fc700 1 -- 172.21.15.16:0/2819873288 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a58007480 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.320+0000 7f7a63dff700 1 -- 172.21.15.16:0/2819873288 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c0ca1a0 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.321+0000 7f7a63dff700 1 -- 172.21.15.16:0/2819873288 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c159360 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.322+0000 7f7a527fc700 1 -- 172.21.15.16:0/2819873288 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a580075e0 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.323+0000 7f7a527fc700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a4006ace0 0x7f7a4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:55.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.323+0000 7f7a527fc700 1 -- 172.21.15.16:0/2819873288 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7a58088bc0 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.323+0000 7f7a6139a700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a4006ace0 0x7f7a4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:55.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.324+0000 7f7a6139a700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a4006ace0 0x7f7a4006d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c1585d0 tx=0x7f7a4c010000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:55.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.327+0000 7f7a527fc700 1 -- 172.21.15.16:0/2819873288 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a58053ba0 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.532+0000 7f7a63dff700 1 -- 172.21.15.16:0/2819873288 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a5c0740e0 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.532+0000 7f7a527fc700 1 -- 172.21.15.16:0/2819873288 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a580571c0 con 0x7f7a5c0b4b50 2023-06-08T04:02:55.537 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:02:55.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 -- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a4006ace0 msgr2=0x7f7a4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a4006ace0 0x7f7a4006d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c1585d0 tx=0x7f7a4c010000 comp rx=0 tx=0).stop 2023-06-08T04:02:55.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 -- 172.21.15.16:0/2819873288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a5c0b4b50 msgr2=0x7f7a5c150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a5c0b4b50 0x7f7a5c150e50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800c700 tx=0x7f7a5800cac0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 -- 172.21.15.16:0/2819873288 shutdown_connections 2023-06-08T04:02:55.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f7a4006ace0 0x7f7a4006d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.539 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a5c160a60 0x7f7a5c0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a5c0b4b50 0x7f7a5c150e50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 --2- 172.21.15.16:0/2819873288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a5c0b83f0 0x7f7a5c159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 -- 172.21.15.16:0/2819873288 >> 172.21.15.16:0/2819873288 conn(0x7f7a5c0cf610 msgr2=0x7f7a5c0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:55.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 -- 172.21.15.16:0/2819873288 shutdown_connections 2023-06-08T04:02:55.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.535+0000 7f7a63dff700 1 -- 172.21.15.16:0/2819873288 wait complete. 2023-06-08T04:02:55.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T04:02:55.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.753+0000 7f66365ff700 1 Processor -- start 2023-06-08T04:02:55.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.753+0000 7f66365ff700 1 -- start start 2023-06-08T04:02:55.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.754+0000 7f66365ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f663015d790 0x7f66300d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.754+0000 7f66365ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6630156c30 0x7f66300d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.754+0000 7f66365ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66300cf050 con 0x7f6630156860 2023-06-08T04:02:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.754+0000 7f66365ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66300cf2f0 con 0x7f6630156c30 2023-06-08T04:02:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.754+0000 7f66365ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66300cf5d0 con 0x7f663015d790 2023-06-08T04:02:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.754+0000 7f662ffff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6630156860 0x7f66300cd230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53540/0 (socket says 172.21.15.16:53540) 2023-06-08T04:02:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.754+0000 7f662ffff700 1 -- 172.21.15.16:0/3236956580 learned_addr learned my addr 172.21.15.16:0/3236956580 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.755+0000 7f662f7fe700 1 --2- 172.21.15.16:0/3236956580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f663015d790 0x7f66300d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.755+0000 7f6634b9c700 1 --2- 172.21.15.16:0/3236956580 >> v2:172.21.15.169:3300/0 conn(0x7f6630156c30 0x7f66300d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.755+0000 7f662effd700 1 -- 172.21.15.16:0/3236956580 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288077617 0 0) 0x7f66300cf050 con 0x7f6630156860 2023-06-08T04:02:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.755+0000 7f662effd700 1 -- 172.21.15.16:0/3236956580 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66180035b0 con 0x7f6630156860 2023-06-08T04:02:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.755+0000 7f662f7fe700 1 -- 172.21.15.16:0/3236956580 >> v2:172.21.15.169:3300/0 conn(0x7f6630156c30 msgr2=0x7f66300d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.755+0000 7f662f7fe700 1 --2- 172.21.15.16:0/3236956580 >> v2:172.21.15.169:3300/0 conn(0x7f6630156c30 0x7f66300d2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.755+0000 7f662f7fe700 1 -- 172.21.15.16:0/3236956580 >> v1:172.21.15.16:6789/0 conn(0x7f6630156860 legacy=0x7f66300cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.755+0000 7f662f7fe700 1 -- 172.21.15.16:0/3236956580 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66300cf8b0 con 0x7f663015d790 2023-06-08T04:02:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.755+0000 7f662f7fe700 1 --2- 172.21.15.16:0/3236956580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f663015d790 0x7f66300d00b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6624009840 tx=0x7f6624009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=116c4025ee1e5082 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.756+0000 7f662effd700 1 -- 172.21.15.16:0/3236956580 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624011830 con 0x7f663015d790 2023-06-08T04:02:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.756+0000 7f662effd700 1 -- 172.21.15.16:0/3236956580 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6624011990 con 0x7f663015d790 2023-06-08T04:02:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.756+0000 7f662effd700 1 -- 172.21.15.16:0/3236956580 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624011d00 con 0x7f663015d790 2023-06-08T04:02:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.756+0000 7f66365ff700 1 -- 172.21.15.16:0/3236956580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f663015d790 msgr2=0x7f66300d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.756+0000 7f66365ff700 1 --2- 172.21.15.16:0/3236956580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f663015d790 0x7f66300d00b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6624009840 tx=0x7f6624009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.757+0000 7f66365ff700 1 -- 172.21.15.16:0/3236956580 shutdown_connections 2023-06-08T04:02:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.757+0000 7f66365ff700 1 --2- 172.21.15.16:0/3236956580 >> v2:172.21.15.169:3300/0 conn(0x7f6630156c30 0x7f66300d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.757+0000 7f66365ff700 1 --2- 172.21.15.16:0/3236956580 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f663015d790 0x7f66300d00b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.757+0000 7f66365ff700 1 -- 172.21.15.16:0/3236956580 >> 172.21.15.16:0/3236956580 conn(0x7f663006b350 msgr2=0x7f663006b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:55.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.757+0000 7f66365ff700 1 -- 172.21.15.16:0/3236956580 shutdown_connections 2023-06-08T04:02:55.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.757+0000 7f66365ff700 1 -- 172.21.15.16:0/3236956580 wait complete. 2023-06-08T04:02:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.758+0000 7f66365ff700 1 Processor -- start 2023-06-08T04:02:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.758+0000 7f66365ff700 1 -- start start 2023-06-08T04:02:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.759+0000 7f66365ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6630156860 0x7f66301f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.759+0000 7f66365ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6630156c30 0x7f66301f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.759+0000 7f66365ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f663015d790 0x7f663015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.759+0000 7f66365ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663015be80 con 0x7f6630156860 2023-06-08T04:02:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.759+0000 7f66365ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663015b270 con 0x7f663015d790 2023-06-08T04:02:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.759+0000 7f66365ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663015b550 con 0x7f6630156c30 2023-06-08T04:02:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.760+0000 7f662ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6630156860 0x7f66301f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.760+0000 7f662ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6630156860 0x7f66301f5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39870/0 (socket says 172.21.15.16:39870) 2023-06-08T04:02:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.760+0000 7f662ffff700 1 -- 172.21.15.16:0/634402929 learned_addr learned my addr 172.21.15.16:0/634402929 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.760+0000 7f662f7fe700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6630156c30 0x7f66301f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.760+0000 7f6634b9c700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f663015d790 0x7f663015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.760+0000 7f662ffff700 1 -- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6630156c30 msgr2=0x7f66301f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.760+0000 7f662ffff700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6630156c30 0x7f66301f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.760+0000 7f662ffff700 1 -- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f663015d790 msgr2=0x7f663015aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.760+0000 7f662ffff700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f663015d790 0x7f663015aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.760+0000 7f662ffff700 1 -- 172.21.15.16:0/634402929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66240094a0 con 0x7f6630156860 2023-06-08T04:02:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.760+0000 7f662ffff700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6630156860 0x7f66301f5c30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f662000c420 tx=0x7f662000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.761+0000 7f662cff9700 1 -- 172.21.15.16:0/634402929 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620005d70 con 0x7f6630156860 2023-06-08T04:02:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.761+0000 7f662cff9700 1 -- 172.21.15.16:0/634402929 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66200070d0 con 0x7f6630156860 2023-06-08T04:02:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.761+0000 7f662cff9700 1 -- 172.21.15.16:0/634402929 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620007440 con 0x7f6630156860 2023-06-08T04:02:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.761+0000 7f66365ff700 1 -- 172.21.15.16:0/634402929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663015b830 con 0x7f6630156860 2023-06-08T04:02:55.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.761+0000 7f66365ff700 1 -- 172.21.15.16:0/634402929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66301f1980 con 0x7f6630156860 2023-06-08T04:02:55.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.762+0000 7f66365ff700 1 -- 172.21.15.16:0/634402929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66300cd900 con 0x7f6630156860 2023-06-08T04:02:55.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.763+0000 7f662cff9700 1 -- 172.21.15.16:0/634402929 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f66200075a0 con 0x7f6630156860 2023-06-08T04:02:55.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.764+0000 7f662cff9700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f661c06ace0 0x7f661c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:55.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.764+0000 7f662cff9700 1 -- 172.21.15.16:0/634402929 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6620088810 con 0x7f6630156860 2023-06-08T04:02:55.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.764+0000 7f662f7fe700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f661c06ace0 0x7f661c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:55.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.765+0000 7f662f7fe700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f661c06ace0 0x7f661c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6624009fd0 tx=0x7f6624008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:55.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:55.768+0000 7f662cff9700 1 -- 172.21.15.16:0/634402929 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6620053890 con 0x7f6630156860 2023-06-08T04:02:56.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.024+0000 7f66365ff700 1 -- 172.21.15.16:0/634402929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66300740e0 con 0x7f6630156860 2023-06-08T04:02:56.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.025+0000 7f662cff9700 1 -- 172.21.15.16:0/634402929 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f6620056eb0 con 0x7f6630156860 2023-06-08T04:02:56.029 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:56.029 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3633702519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3633702519},{"type":"v1","addr":"172.21.15.16:6834","nonce":3633702519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/711045362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":711045362},{"type":"v1","addr":"172.21.15.169:6837","nonce":711045362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1926912680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1926912680},{"type":"v1","addr":"172.21.15.16:6835","nonce":1926912680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T04:01:57.284697+0000","modified":"2023-06-08T04:02:00.771168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6836/1286012043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1286012043},{"type":"v1","addr":"172.21.15.169:6836","nonce":1286012043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T04:02:56.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 -- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f661c06ace0 msgr2=0x7f661c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f661c06ace0 0x7f661c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6624009fd0 tx=0x7f6624008030 comp rx=0 tx=0).stop 2023-06-08T04:02:56.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 -- 172.21.15.16:0/634402929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6630156860 msgr2=0x7f66301f5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6630156860 0x7f66301f5c30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f662000c420 tx=0x7f662000c730 comp rx=0 tx=0).stop 2023-06-08T04:02:56.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 -- 172.21.15.16:0/634402929 shutdown_connections 2023-06-08T04:02:56.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f661c06ace0 0x7f661c06d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f663015d790 0x7f663015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6630156860 0x7f66301f5c30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 --2- 172.21.15.16:0/634402929 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6630156c30 0x7f66301f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 -- 172.21.15.16:0/634402929 >> 172.21.15.16:0/634402929 conn(0x7f663006b350 msgr2=0x7f66300b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:56.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 -- 172.21.15.16:0/634402929 shutdown_connections 2023-06-08T04:02:56.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.027+0000 7f66365ff700 1 -- 172.21.15.16:0/634402929 wait complete. 2023-06-08T04:02:56.033 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-06-08T04:02:56.049 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:56.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.245+0000 7f0a887ff700 1 Processor -- start 2023-06-08T04:02:56.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.246+0000 7f0a887ff700 1 -- start start 2023-06-08T04:02:56.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.247+0000 7f0a887ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a800b4d20 0x7f0a80167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:56.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.248+0000 7f0a887ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a800d0800 con 0x7f0a800b83f0 2023-06-08T04:02:56.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.248+0000 7f0a887ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a800cd1e0 con 0x7f0a80160a60 2023-06-08T04:02:56.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.248+0000 7f0a887ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a80160ed0 con 0x7f0a800b4d20 2023-06-08T04:02:56.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.248+0000 7f0a8659b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0a800b83f0 0x7f0a800ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53554/0 (socket says 172.21.15.16:53554) 2023-06-08T04:02:56.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.248+0000 7f0a8659b700 1 -- 172.21.15.16:0/1252784667 learned_addr learned my addr 172.21.15.16:0/1252784667 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:56.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.248+0000 7f0a86d9c700 1 --2- 172.21.15.16:0/1252784667 >> v2:172.21.15.16:3300/0 conn(0x7f0a800b4d20 0x7f0a80167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:56.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.248+0000 7f0a85599700 1 -- 172.21.15.16:0/1252784667 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85726570 0 0) 0x7f0a800d0800 con 0x7f0a800b83f0 2023-06-08T04:02:56.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.248+0000 7f0a86d9c700 1 -- 172.21.15.16:0/1252784667 >> v1:172.21.15.169:6789/0 conn(0x7f0a80160a60 legacy=0x7f0a800b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:56.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.248+0000 7f0a86d9c700 1 -- 172.21.15.16:0/1252784667 >> v1:172.21.15.16:6789/0 conn(0x7f0a800b83f0 legacy=0x7f0a800ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.248+0000 7f0a86d9c700 1 -- 172.21.15.16:0/1252784667 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a800cd4c0 con 0x7f0a800b4d20 2023-06-08T04:02:56.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.249+0000 7f0a86d9c700 1 --2- 172.21.15.16:0/1252784667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a800b4d20 0x7f0a80167260 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009d90 tx=0x7f0a7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd26b4aebbc1d93 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:56.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.249+0000 7f0a85599700 1 -- 172.21.15.16:0/1252784667 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800e070 con 0x7f0a800b4d20 2023-06-08T04:02:56.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.249+0000 7f0a85599700 1 -- 172.21.15.16:0/1252784667 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7800bbd0 con 0x7f0a800b4d20 2023-06-08T04:02:56.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.249+0000 7f0a85599700 1 -- 172.21.15.16:0/1252784667 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78012430 con 0x7f0a800b4d20 2023-06-08T04:02:56.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.249+0000 7f0a887ff700 1 -- 172.21.15.16:0/1252784667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a800b4d20 msgr2=0x7f0a80167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.249+0000 7f0a887ff700 1 --2- 172.21.15.16:0/1252784667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a800b4d20 0x7f0a80167260 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009d90 tx=0x7f0a7800b330 comp rx=0 tx=0).stop 2023-06-08T04:02:56.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.249+0000 7f0a887ff700 1 -- 172.21.15.16:0/1252784667 shutdown_connections 2023-06-08T04:02:56.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.249+0000 7f0a887ff700 1 --2- 172.21.15.16:0/1252784667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a800b4d20 0x7f0a80167260 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.249+0000 7f0a887ff700 1 -- 172.21.15.16:0/1252784667 >> 172.21.15.16:0/1252784667 conn(0x7f0a800cf610 msgr2=0x7f0a800cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:56.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.249+0000 7f0a887ff700 1 -- 172.21.15.16:0/1252784667 shutdown_connections 2023-06-08T04:02:56.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.250+0000 7f0a887ff700 1 -- 172.21.15.16:0/1252784667 wait complete. 2023-06-08T04:02:56.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.251+0000 7f0a887ff700 1 Processor -- start 2023-06-08T04:02:56.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.251+0000 7f0a887ff700 1 -- start start 2023-06-08T04:02:56.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.252+0000 7f0a887ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a800b4d20 0x7f0a80159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:56.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.252+0000 7f0a887ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a800b83f0 0x7f0a800ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:56.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.252+0000 7f0a887ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a80160a60 0x7f0a800cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:56.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.252+0000 7f0a887ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a800ca020 con 0x7f0a800b4d20 2023-06-08T04:02:56.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.252+0000 7f0a887ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8015f350 con 0x7f0a800b83f0 2023-06-08T04:02:56.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.252+0000 7f0a887ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8015e460 con 0x7f0a80160a60 2023-06-08T04:02:56.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a8659b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a800b4d20 0x7f0a80159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:56.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a8659b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a800b4d20 0x7f0a80159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39892/0 (socket says 172.21.15.16:39892) 2023-06-08T04:02:56.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a8659b700 1 -- 172.21.15.16:0/796840779 learned_addr learned my addr 172.21.15.16:0/796840779 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:56.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a86d9c700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a80160a60 0x7f0a800cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:56.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a85d9a700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a800b83f0 0x7f0a800ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:56.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a8659b700 1 -- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a80160a60 msgr2=0x7f0a800cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a8659b700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a80160a60 0x7f0a800cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a8659b700 1 -- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a800b83f0 msgr2=0x7f0a800ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a8659b700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a800b83f0 0x7f0a800ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a8659b700 1 -- 172.21.15.16:0/796840779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78009a70 con 0x7f0a800b4d20 2023-06-08T04:02:56.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a8659b700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a800b4d20 0x7f0a80159f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c520 tx=0x7f0a7c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:56.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.253+0000 7f0a76ffd700 1 -- 172.21.15.16:0/796840779 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c004c80 con 0x7f0a800b4d20 2023-06-08T04:02:56.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.254+0000 7f0a76ffd700 1 -- 172.21.15.16:0/796840779 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c004e00 con 0x7f0a800b4d20 2023-06-08T04:02:56.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.254+0000 7f0a887ff700 1 -- 172.21.15.16:0/796840779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8015e740 con 0x7f0a800b4d20 2023-06-08T04:02:56.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.254+0000 7f0a76ffd700 1 -- 172.21.15.16:0/796840779 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c007310 con 0x7f0a800b4d20 2023-06-08T04:02:56.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.254+0000 7f0a887ff700 1 -- 172.21.15.16:0/796840779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8015ed00 con 0x7f0a800b4d20 2023-06-08T04:02:56.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.255+0000 7f0a887ff700 1 -- 172.21.15.16:0/796840779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a800740e0 con 0x7f0a800b4d20 2023-06-08T04:02:56.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.256+0000 7f0a76ffd700 1 -- 172.21.15.16:0/796840779 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a7c007470 con 0x7f0a800b4d20 2023-06-08T04:02:56.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.257+0000 7f0a76ffd700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0a6406ace0 0x7f0a6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:56.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.257+0000 7f0a76ffd700 1 -- 172.21.15.16:0/796840779 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0a7c089150 con 0x7f0a800b4d20 2023-06-08T04:02:56.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.257+0000 7f0a85d9a700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0a6406ace0 0x7f0a6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:56.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.258+0000 7f0a85d9a700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0a6406ace0 0x7f0a6406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a800b1390 tx=0x7f0a70009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:56.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.261+0000 7f0a76ffd700 1 -- 172.21.15.16:0/796840779 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a7c054120 con 0x7f0a800b4d20 2023-06-08T04:02:56.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.468+0000 7f0a887ff700 1 -- 172.21.15.16:0/796840779 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a8015c450 con 0x7f0a800b4d20 2023-06-08T04:02:56.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.469+0000 7f0a76ffd700 1 -- 172.21.15.16:0/796840779 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18293 (secure 0 0 0) 0x7f0a7c057740 con 0x7f0a800b4d20 2023-06-08T04:02:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:56.473 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:02:45.925594+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.26","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:56.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.471+0000 7f0a887ff700 1 -- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0a6406ace0 msgr2=0x7f0a6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.471+0000 7f0a887ff700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0a6406ace0 0x7f0a6406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a800b1390 tx=0x7f0a70009040 comp rx=0 tx=0).stop 2023-06-08T04:02:56.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.471+0000 7f0a887ff700 1 -- 172.21.15.16:0/796840779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a800b4d20 msgr2=0x7f0a80159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.471+0000 7f0a887ff700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a800b4d20 0x7f0a80159f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00c520 tx=0x7f0a7c00c830 comp rx=0 tx=0).stop 2023-06-08T04:02:56.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.471+0000 7f0a887ff700 1 -- 172.21.15.16:0/796840779 shutdown_connections 2023-06-08T04:02:56.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.471+0000 7f0a887ff700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0a6406ace0 0x7f0a6406d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.472+0000 7f0a887ff700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a80160a60 0x7f0a800cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.472+0000 7f0a887ff700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a800b4d20 0x7f0a80159f70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.472+0000 7f0a887ff700 1 --2- 172.21.15.16:0/796840779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a800b83f0 0x7f0a800ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.472+0000 7f0a887ff700 1 -- 172.21.15.16:0/796840779 >> 172.21.15.16:0/796840779 conn(0x7f0a800cf610 msgr2=0x7f0a8006b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:56.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.472+0000 7f0a887ff700 1 -- 172.21.15.16:0/796840779 shutdown_connections 2023-06-08T04:02:56.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.472+0000 7f0a887ff700 1 -- 172.21.15.16:0/796840779 wait complete. 2023-06-08T04:02:56.494 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-08T04:02:56.494 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T04:02:56.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.691+0000 7f447f3ff700 1 Processor -- start 2023-06-08T04:02:56.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.691+0000 7f447f3ff700 1 -- start start 2023-06-08T04:02:56.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.692+0000 7f447f3ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4478160a60 0x7f44780b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:56.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.692+0000 7f447f3ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44780d0800 con 0x7f44780b4b50 2023-06-08T04:02:56.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.692+0000 7f447f3ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44780cd1e0 con 0x7f44780b83f0 2023-06-08T04:02:56.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.692+0000 7f447f3ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4478160ed0 con 0x7f4478160a60 2023-06-08T04:02:56.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.693+0000 7f447c99a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4478160a60 0x7f44780b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:56.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.693+0000 7f447d99c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f44780b4b50 0x7f44780d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53564/0 (socket says 172.21.15.16:53564) 2023-06-08T04:02:56.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.693+0000 7f447d99c700 1 -- 172.21.15.16:0/3428457501 learned_addr learned my addr 172.21.15.16:0/3428457501 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:56.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.693+0000 7f447c99a700 1 -- 172.21.15.16:0/3428457501 >> v1:172.21.15.169:6789/0 conn(0x7f44780b83f0 legacy=0x7f44780ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.693+0000 7f447c99a700 1 -- 172.21.15.16:0/3428457501 >> v1:172.21.15.16:6789/0 conn(0x7f44780b4b50 legacy=0x7f44780d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.693+0000 7f447c99a700 1 -- 172.21.15.16:0/3428457501 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780cd4c0 con 0x7f4478160a60 2023-06-08T04:02:56.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.693+0000 7f447c99a700 1 --2- 172.21.15.16:0/3428457501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4478160a60 0x7f44780b4610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4468009840 tx=0x7f4468009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b308d696c660117c server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:56.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.694+0000 7f446ffff700 1 -- 172.21.15.16:0/3428457501 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468011830 con 0x7f4478160a60 2023-06-08T04:02:56.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.694+0000 7f446ffff700 1 -- 172.21.15.16:0/3428457501 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4468011990 con 0x7f4478160a60 2023-06-08T04:02:56.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.694+0000 7f446ffff700 1 -- 172.21.15.16:0/3428457501 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468011d20 con 0x7f4478160a60 2023-06-08T04:02:56.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.694+0000 7f447f3ff700 1 -- 172.21.15.16:0/3428457501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4478160a60 msgr2=0x7f44780b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.694+0000 7f447f3ff700 1 --2- 172.21.15.16:0/3428457501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4478160a60 0x7f44780b4610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4468009840 tx=0x7f4468009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:56.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.694+0000 7f447f3ff700 1 -- 172.21.15.16:0/3428457501 shutdown_connections 2023-06-08T04:02:56.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.694+0000 7f447f3ff700 1 --2- 172.21.15.16:0/3428457501 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4478160a60 0x7f44780b4610 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.694+0000 7f447f3ff700 1 -- 172.21.15.16:0/3428457501 >> 172.21.15.16:0/3428457501 conn(0x7f44780cf610 msgr2=0x7f44780cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:56.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.694+0000 7f447f3ff700 1 -- 172.21.15.16:0/3428457501 shutdown_connections 2023-06-08T04:02:56.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.694+0000 7f447f3ff700 1 -- 172.21.15.16:0/3428457501 wait complete. 2023-06-08T04:02:56.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.696+0000 7f447f3ff700 1 Processor -- start 2023-06-08T04:02:56.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.696+0000 7f447f3ff700 1 -- start start 2023-06-08T04:02:56.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.697+0000 7f447f3ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44780b4b50 0x7f44780b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:56.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.697+0000 7f447f3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44780b83f0 0x7f447815af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:56.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.697+0000 7f447f3ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4478160a60 0x7f447815e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:56.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.697+0000 7f447f3ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447815ed80 con 0x7f4478160a60 2023-06-08T04:02:56.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.697+0000 7f447f3ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447815f060 con 0x7f44780b4b50 2023-06-08T04:02:56.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.697+0000 7f447f3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44780b25c0 con 0x7f44780b83f0 2023-06-08T04:02:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.697+0000 7f447d99c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4478160a60 0x7f447815e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f447d99c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4478160a60 0x7f447815e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39916/0 (socket says 172.21.15.16:39916) 2023-06-08T04:02:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f447d99c700 1 -- 172.21.15.16:0/3452766284 learned_addr learned my addr 172.21.15.16:0/3452766284 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f447d19b700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44780b4b50 0x7f44780b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f447c99a700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44780b83f0 0x7f447815af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f447d99c700 1 -- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44780b83f0 msgr2=0x7f447815af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f447d99c700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44780b83f0 0x7f447815af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f447d99c700 1 -- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44780b4b50 msgr2=0x7f44780b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f447d99c700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44780b4b50 0x7f44780b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f447d99c700 1 -- 172.21.15.16:0/3452766284 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44680094a0 con 0x7f4478160a60 2023-06-08T04:02:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f447d99c700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4478160a60 0x7f447815e330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f447000ca80 tx=0x7f447000cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f446dffb700 1 -- 172.21.15.16:0/3452766284 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000a9e0 con 0x7f4478160a60 2023-06-08T04:02:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f446dffb700 1 -- 172.21.15.16:0/3452766284 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447000ab40 con 0x7f4478160a60 2023-06-08T04:02:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.698+0000 7f446dffb700 1 -- 172.21.15.16:0/3452766284 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470012400 con 0x7f4478160a60 2023-06-08T04:02:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.699+0000 7f447f3ff700 1 -- 172.21.15.16:0/3452766284 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44780b28a0 con 0x7f4478160a60 2023-06-08T04:02:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.699+0000 7f447f3ff700 1 -- 172.21.15.16:0/3452766284 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44780c8df0 con 0x7f4478160a60 2023-06-08T04:02:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.700+0000 7f447f3ff700 1 -- 172.21.15.16:0/3452766284 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44780740e0 con 0x7f4478160a60 2023-06-08T04:02:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.701+0000 7f446dffb700 1 -- 172.21.15.16:0/3452766284 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f447001b3b0 con 0x7f4478160a60 2023-06-08T04:02:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.702+0000 7f446dffb700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f445c06ace0 0x7f445c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.702+0000 7f446dffb700 1 -- 172.21.15.16:0/3452766284 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4470088f10 con 0x7f4478160a60 2023-06-08T04:02:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.702+0000 7f447d19b700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f445c06ace0 0x7f445c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:56.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.703+0000 7f447d19b700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f445c06ace0 0x7f445c06d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4474007fd0 tx=0x7f4474009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.707+0000 7f446dffb700 1 -- 172.21.15.16:0/3452766284 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4470054010 con 0x7f4478160a60 2023-06-08T04:02:56.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.960+0000 7f447f3ff700 1 -- 172.21.15.16:0/3452766284 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f447815eec0 con 0x7f4478160a60 2023-06-08T04:02:56.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.960+0000 7f446dffb700 1 -- 172.21.15.16:0/3452766284 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f447815eec0 con 0x7f4478160a60 2023-06-08T04:02:56.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:56.964 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3633702519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3633702519},{"type":"v1","addr":"172.21.15.16:6834","nonce":3633702519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/711045362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":711045362},{"type":"v1","addr":"172.21.15.169:6837","nonce":711045362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1926912680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1926912680},{"type":"v1","addr":"172.21.15.16:6835","nonce":1926912680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T04:01:57.284697+0000","modified":"2023-06-08T04:02:00.771168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6836/1286012043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1286012043},{"type":"v1","addr":"172.21.15.169:6836","nonce":1286012043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T04:02:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 -- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f445c06ace0 msgr2=0x7f445c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f445c06ace0 0x7f445c06d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4474007fd0 tx=0x7f4474009040 comp rx=0 tx=0).stop 2023-06-08T04:02:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 -- 172.21.15.16:0/3452766284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4478160a60 msgr2=0x7f447815e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4478160a60 0x7f447815e330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f447000ca80 tx=0x7f447000cd90 comp rx=0 tx=0).stop 2023-06-08T04:02:56.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 -- 172.21.15.16:0/3452766284 shutdown_connections 2023-06-08T04:02:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f445c06ace0 0x7f445c06d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4478160a60 0x7f447815e330 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f44780b4b50 0x7f44780b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 --2- 172.21.15.16:0/3452766284 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44780b83f0 0x7f447815af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 -- 172.21.15.16:0/3452766284 >> 172.21.15.16:0/3452766284 conn(0x7f44780cf610 msgr2=0x7f44780b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 -- 172.21.15.16:0/3452766284 shutdown_connections 2023-06-08T04:02:56.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:56.963+0000 7f447f3ff700 1 -- 172.21.15.16:0/3452766284 wait complete. 2023-06-08T04:02:56.969 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-06-08T04:02:56.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T04:02:57.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.182+0000 7f4d459ff700 1 Processor -- start 2023-06-08T04:02:57.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.182+0000 7f4d459ff700 1 -- start start 2023-06-08T04:02:57.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.183+0000 7f4d459ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d40160a60 0x7f4d400b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d459ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d400b4b50 0x7f4d400d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d459ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d400d0800 con 0x7f4d400b83f0 2023-06-08T04:02:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d459ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d40160ed0 con 0x7f4d400b4b50 2023-06-08T04:02:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d459ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d400b4fd0 con 0x7f4d40160a60 2023-06-08T04:02:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d3f7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d400b4b50 0x7f4d400d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d3f7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d400b4b50 0x7f4d400d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39924/0 (socket says 172.21.15.16:39924) 2023-06-08T04:02:57.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d3f7fe700 1 -- 172.21.15.16:0/1252582293 learned_addr learned my addr 172.21.15.16:0/1252582293 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d37fff700 1 --2- 172.21.15.16:0/1252582293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d40160a60 0x7f4d400b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d3f7fe700 1 -- 172.21.15.16:0/1252582293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d40160a60 msgr2=0x7f4d400b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d3f7fe700 1 --2- 172.21.15.16:0/1252582293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d40160a60 0x7f4d400b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d3f7fe700 1 -- 172.21.15.16:0/1252582293 >> v1:172.21.15.169:6789/0 conn(0x7f4d400b83f0 legacy=0x7f4d400ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d3f7fe700 1 -- 172.21.15.16:0/1252582293 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400cd1e0 con 0x7f4d400b4b50 2023-06-08T04:02:57.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.184+0000 7f4d37fff700 1 --2- 172.21.15.16:0/1252582293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d40160a60 0x7f4d400b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:02:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.185+0000 7f4d3f7fe700 1 --2- 172.21.15.16:0/1252582293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d400b4b50 0x7f4d400d0fc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009e50 tx=0x7f4d3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203f1a519cb8c6a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.185+0000 7f4d3e7fc700 1 -- 172.21.15.16:0/1252582293 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3800e070 con 0x7f4d400b4b50 2023-06-08T04:02:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.185+0000 7f4d3e7fc700 1 -- 172.21.15.16:0/1252582293 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d38003a20 con 0x7f4d400b4b50 2023-06-08T04:02:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.185+0000 7f4d3e7fc700 1 -- 172.21.15.16:0/1252582293 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38003dd0 con 0x7f4d400b4b50 2023-06-08T04:02:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.185+0000 7f4d459ff700 1 -- 172.21.15.16:0/1252582293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d400b4b50 msgr2=0x7f4d400d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.185+0000 7f4d459ff700 1 --2- 172.21.15.16:0/1252582293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d400b4b50 0x7f4d400d0fc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009e50 tx=0x7f4d3800b330 comp rx=0 tx=0).stop 2023-06-08T04:02:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.185+0000 7f4d459ff700 1 -- 172.21.15.16:0/1252582293 shutdown_connections 2023-06-08T04:02:57.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.185+0000 7f4d459ff700 1 --2- 172.21.15.16:0/1252582293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d400b4b50 0x7f4d400d0fc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.185+0000 7f4d459ff700 1 --2- 172.21.15.16:0/1252582293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d40160a60 0x7f4d400b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.185+0000 7f4d459ff700 1 -- 172.21.15.16:0/1252582293 >> 172.21.15.16:0/1252582293 conn(0x7f4d400cf610 msgr2=0x7f4d400cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:57.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.186+0000 7f4d459ff700 1 -- 172.21.15.16:0/1252582293 shutdown_connections 2023-06-08T04:02:57.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.186+0000 7f4d459ff700 1 -- 172.21.15.16:0/1252582293 wait complete. 2023-06-08T04:02:57.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.188+0000 7f4d459ff700 1 Processor -- start 2023-06-08T04:02:57.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.188+0000 7f4d459ff700 1 -- start start 2023-06-08T04:02:57.194 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.189+0000 7f4d459ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d400b4b50 0x7f4d400cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.194 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.189+0000 7f4d459ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d400b83f0 0x7f4d401f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.194 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.189+0000 7f4d459ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d40160a60 0x7f4d400c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.194 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.189+0000 7f4d459ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d401f3420 con 0x7f4d400b4b50 2023-06-08T04:02:57.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.189+0000 7f4d459ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d401f2720 con 0x7f4d400b83f0 2023-06-08T04:02:57.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.189+0000 7f4d459ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d401f2a00 con 0x7f4d40160a60 2023-06-08T04:02:57.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d3effd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d400b4b50 0x7f4d400cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d3effd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d400b4b50 0x7f4d400cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39940/0 (socket says 172.21.15.16:39940) 2023-06-08T04:02:57.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d3effd700 1 -- 172.21.15.16:0/1693980758 learned_addr learned my addr 172.21.15.16:0/1693980758 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:57.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d37fff700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d400b83f0 0x7f4d401f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d3f7fe700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d40160a60 0x7f4d400c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d3effd700 1 -- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d40160a60 msgr2=0x7f4d400c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:57.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d3effd700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d40160a60 0x7f4d400c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d3effd700 1 -- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d400b83f0 msgr2=0x7f4d401f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:57.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d3effd700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d400b83f0 0x7f4d401f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d3effd700 1 -- 172.21.15.16:0/1693980758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d38009b30 con 0x7f4d400b4b50 2023-06-08T04:02:57.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d37fff700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d400b83f0 0x7f4d401f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:57.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.190+0000 7f4d3effd700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d400b4b50 0x7f4d400cc750 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000c4d0 tx=0x7f4d3000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:57.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.191+0000 7f4d3cff9700 1 -- 172.21.15.16:0/1693980758 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30011790 con 0x7f4d400b4b50 2023-06-08T04:02:57.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.191+0000 7f4d3cff9700 1 -- 172.21.15.16:0/1693980758 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d300118f0 con 0x7f4d400b4b50 2023-06-08T04:02:57.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.191+0000 7f4d3cff9700 1 -- 172.21.15.16:0/1693980758 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30011ca0 con 0x7f4d400b4b50 2023-06-08T04:02:57.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.191+0000 7f4d459ff700 1 -- 172.21.15.16:0/1693980758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d401f2ce0 con 0x7f4d400b4b50 2023-06-08T04:02:57.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.191+0000 7f4d459ff700 1 -- 172.21.15.16:0/1693980758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d401f23c0 con 0x7f4d400b4b50 2023-06-08T04:02:57.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.192+0000 7f4d459ff700 1 -- 172.21.15.16:0/1693980758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d401f3690 con 0x7f4d400b4b50 2023-06-08T04:02:57.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.193+0000 7f4d3cff9700 1 -- 172.21.15.16:0/1693980758 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d3001c460 con 0x7f4d400b4b50 2023-06-08T04:02:57.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.194+0000 7f4d3cff9700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d2006ace0 0x7f4d2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.194+0000 7f4d3cff9700 1 -- 172.21.15.16:0/1693980758 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4d30089320 con 0x7f4d400b4b50 2023-06-08T04:02:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.194+0000 7f4d37fff700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d2006ace0 0x7f4d2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.195+0000 7f4d37fff700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d2006ace0 0x7f4d2006d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4d401f53d0 tx=0x7f4d28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:57.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.198+0000 7f4d3cff9700 1 -- 172.21.15.16:0/1693980758 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4d300542f0 con 0x7f4d400b4b50 2023-06-08T04:02:57.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.451+0000 7f4d459ff700 1 -- 172.21.15.16:0/1693980758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d400740e0 con 0x7f4d400b4b50 2023-06-08T04:02:57.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.452+0000 7f4d3cff9700 1 -- 172.21.15.16:0/1693980758 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f4d30057910 con 0x7f4d400b4b50 2023-06-08T04:02:57.456 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:57.456 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3633702519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3633702519},{"type":"v1","addr":"172.21.15.16:6834","nonce":3633702519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/711045362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":711045362},{"type":"v1","addr":"172.21.15.169:6837","nonce":711045362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1926912680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1926912680},{"type":"v1","addr":"172.21.15.16:6835","nonce":1926912680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T04:01:57.284697+0000","modified":"2023-06-08T04:02:00.771168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6836/1286012043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1286012043},{"type":"v1","addr":"172.21.15.169:6836","nonce":1286012043}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-08T04:02:57.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 -- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d2006ace0 msgr2=0x7f4d2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:57.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d2006ace0 0x7f4d2006d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4d401f53d0 tx=0x7f4d28008040 comp rx=0 tx=0).stop 2023-06-08T04:02:57.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 -- 172.21.15.16:0/1693980758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d400b4b50 msgr2=0x7f4d400cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:57.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d400b4b50 0x7f4d400cc750 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000c4d0 tx=0x7f4d3000c7e0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 -- 172.21.15.16:0/1693980758 shutdown_connections 2023-06-08T04:02:57.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f4d2006ace0 0x7f4d2006d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d40160a60 0x7f4d400c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d400b4b50 0x7f4d400cc750 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 --2- 172.21.15.16:0/1693980758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d400b83f0 0x7f4d401f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 -- 172.21.15.16:0/1693980758 >> 172.21.15.16:0/1693980758 conn(0x7f4d400cf610 msgr2=0x7f4d400b4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:57.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 -- 172.21.15.16:0/1693980758 shutdown_connections 2023-06-08T04:02:57.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.454+0000 7f4d459ff700 1 -- 172.21.15.16:0/1693980758 wait complete. 2023-06-08T04:02:57.460 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-06-08T04:02:57.476 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:02:57.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.672+0000 7fb2d6dff700 1 Processor -- start 2023-06-08T04:02:57.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.673+0000 7fb2d6dff700 1 -- start start 2023-06-08T04:02:57.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.674+0000 7fb2d6dff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb2d0160a60 0x7fb2d00b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.674+0000 7fb2d6dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 0x7fb2d00d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.674+0000 7fb2d6dff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d00d0800 con 0x7fb2d00b83f0 2023-06-08T04:02:57.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.674+0000 7fb2d6dff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d0160ed0 con 0x7fb2d0160a60 2023-06-08T04:02:57.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.674+0000 7fb2d6dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d00b4fd0 con 0x7fb2d00b4b50 2023-06-08T04:02:57.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.674+0000 7fb2cffff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb2d0160a60 0x7fb2d00b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.674+0000 7fb2d4b9b700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fb2d00b83f0 0x7fb2d00ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:54286/0 (socket says 172.21.15.16:54286) 2023-06-08T04:02:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.674+0000 7fb2d4b9b700 1 -- 172.21.15.16:0/2695161260 learned_addr learned my addr 172.21.15.16:0/2695161260 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.674+0000 7fb2d539c700 1 --2- 172.21.15.16:0/2695161260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 0x7fb2d00d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.675+0000 7fb2cf7fe700 1 -- 172.21.15.16:0/2695161260 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505025139 0 0) 0x7fb2d00d0800 con 0x7fb2d00b83f0 2023-06-08T04:02:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.675+0000 7fb2cf7fe700 1 -- 172.21.15.16:0/2695161260 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c00035b0 con 0x7fb2d00b83f0 2023-06-08T04:02:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.675+0000 7fb2cffff700 1 -- 172.21.15.16:0/2695161260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 msgr2=0x7fb2d00d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:57.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.675+0000 7fb2cffff700 1 --2- 172.21.15.16:0/2695161260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 0x7fb2d00d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.675+0000 7fb2cffff700 1 -- 172.21.15.16:0/2695161260 >> v1:172.21.15.169:6789/0 conn(0x7fb2d00b83f0 legacy=0x7fb2d00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:57.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.675+0000 7fb2cffff700 1 -- 172.21.15.16:0/2695161260 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d00cd1e0 con 0x7fb2d0160a60 2023-06-08T04:02:57.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.675+0000 7fb2d539c700 1 --2- 172.21.15.16:0/2695161260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 0x7fb2d00d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:02:57.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.675+0000 7fb2cffff700 1 --2- 172.21.15.16:0/2695161260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2d0160a60 0x7fb2d00b4610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009840 tx=0x7fb2bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee6f96380625233 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:57.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.676+0000 7fb2cf7fe700 1 -- 172.21.15.16:0/2695161260 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc011830 con 0x7fb2d0160a60 2023-06-08T04:02:57.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.676+0000 7fb2cf7fe700 1 -- 172.21.15.16:0/2695161260 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc011990 con 0x7fb2d0160a60 2023-06-08T04:02:57.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.676+0000 7fb2cf7fe700 1 -- 172.21.15.16:0/2695161260 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc011d20 con 0x7fb2d0160a60 2023-06-08T04:02:57.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.676+0000 7fb2d6dff700 1 -- 172.21.15.16:0/2695161260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2d0160a60 msgr2=0x7fb2d00b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:57.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.676+0000 7fb2d6dff700 1 --2- 172.21.15.16:0/2695161260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2d0160a60 0x7fb2d00b4610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009840 tx=0x7fb2bc009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:57.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.676+0000 7fb2d6dff700 1 -- 172.21.15.16:0/2695161260 shutdown_connections 2023-06-08T04:02:57.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.676+0000 7fb2d6dff700 1 --2- 172.21.15.16:0/2695161260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 0x7fb2d00d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.676+0000 7fb2d6dff700 1 --2- 172.21.15.16:0/2695161260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2d0160a60 0x7fb2d00b4610 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.676+0000 7fb2d6dff700 1 -- 172.21.15.16:0/2695161260 >> 172.21.15.16:0/2695161260 conn(0x7fb2d00cf610 msgr2=0x7fb2d00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:57.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.676+0000 7fb2d6dff700 1 -- 172.21.15.16:0/2695161260 shutdown_connections 2023-06-08T04:02:57.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.676+0000 7fb2d6dff700 1 -- 172.21.15.16:0/2695161260 wait complete. 2023-06-08T04:02:57.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.678+0000 7fb2d6dff700 1 Processor -- start 2023-06-08T04:02:57.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.678+0000 7fb2d6dff700 1 -- start start 2023-06-08T04:02:57.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.679+0000 7fb2d6dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 0x7fb2d00cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.679+0000 7fb2d6dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2d00b83f0 0x7fb2d014cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.679+0000 7fb2d6dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d0160a60 0x7fb2d01e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.679+0000 7fb2d6dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d00cc2e0 con 0x7fb2d0160a60 2023-06-08T04:02:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.679+0000 7fb2d6dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d014d480 con 0x7fb2d00b83f0 2023-06-08T04:02:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.679+0000 7fb2d6dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d00cb6d0 con 0x7fb2d00b4b50 2023-06-08T04:02:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2d539c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d0160a60 0x7fb2d01e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2d4b9b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 0x7fb2d00cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2cffff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2d00b83f0 0x7fb2d014cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2cffff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2d00b83f0 0x7fb2d014cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:50650/0 (socket says 172.21.15.16:50650) 2023-06-08T04:02:57.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2cffff700 1 -- 172.21.15.16:0/4119331434 learned_addr learned my addr 172.21.15.16:0/4119331434 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:57.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2d539c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d0160a60 0x7fb2d01e5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39942/0 (socket says 172.21.15.16:39942) 2023-06-08T04:02:57.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2d4b9b700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 0x7fb2d00cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:53698/0 (socket says 172.21.15.16:53698) 2023-06-08T04:02:57.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2d539c700 1 -- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 msgr2=0x7fb2d00cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:57.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2d539c700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 0x7fb2d00cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2d539c700 1 -- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2d00b83f0 msgr2=0x7fb2d014cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:57.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2d539c700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2d00b83f0 0x7fb2d014cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2d539c700 1 -- 172.21.15.16:0/4119331434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c8009a70 con 0x7fb2d0160a60 2023-06-08T04:02:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.680+0000 7fb2d539c700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d0160a60 0x7fb2d01e5d30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800efc0 tx=0x7fb2c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.681+0000 7fb2cd7fa700 1 -- 172.21.15.16:0/4119331434 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800ca90 con 0x7fb2d0160a60 2023-06-08T04:02:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.681+0000 7fb2cd7fa700 1 -- 172.21.15.16:0/4119331434 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c800f040 con 0x7fb2d0160a60 2023-06-08T04:02:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.681+0000 7fb2cd7fa700 1 -- 172.21.15.16:0/4119331434 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800ce30 con 0x7fb2d0160a60 2023-06-08T04:02:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.681+0000 7fb2d6dff700 1 -- 172.21.15.16:0/4119331434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc0094a0 con 0x7fb2d0160a60 2023-06-08T04:02:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.681+0000 7fb2d6dff700 1 -- 172.21.15.16:0/4119331434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d00cbc90 con 0x7fb2d0160a60 2023-06-08T04:02:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.682+0000 7fb2d6dff700 1 -- 172.21.15.16:0/4119331434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d00cc450 con 0x7fb2d0160a60 2023-06-08T04:02:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.683+0000 7fb2cd7fa700 1 -- 172.21.15.16:0/4119331434 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb2c8014480 con 0x7fb2d0160a60 2023-06-08T04:02:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.684+0000 7fb2cd7fa700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2b406ace0 0x7fb2b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.684+0000 7fb2cd7fa700 1 -- 172.21.15.16:0/4119331434 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb2c8089a50 con 0x7fb2d0160a60 2023-06-08T04:02:57.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.684+0000 7fb2d4b9b700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2b406ace0 0x7fb2b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:57.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.685+0000 7fb2d4b9b700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2b406ace0 0x7fb2b406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4007fd0 tx=0x7fb2c4007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.688+0000 7fb2cd7fa700 1 -- 172.21.15.16:0/4119331434 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb2c8054ac0 con 0x7fb2d0160a60 2023-06-08T04:02:57.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.893+0000 7fb2d6dff700 1 -- 172.21.15.16:0/4119331434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2d00740e0 con 0x7fb2d0160a60 2023-06-08T04:02:57.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.894+0000 7fb2cd7fa700 1 -- 172.21.15.16:0/4119331434 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18293 (secure 0 0 0) 0x7fb2c8009cc0 con 0x7fb2d0160a60 2023-06-08T04:02:57.898 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:02:57.898 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:02:45.925594+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:01:54.980592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-08T04:01:56.264608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.26","mappings":[{"from":1,"to":5}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:02:57.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.896+0000 7fb2d6dff700 1 -- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2b406ace0 msgr2=0x7fb2b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:57.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.896+0000 7fb2d6dff700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2b406ace0 0x7fb2b406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4007fd0 tx=0x7fb2c4007dc0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.896+0000 7fb2d6dff700 1 -- 172.21.15.16:0/4119331434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d0160a60 msgr2=0x7fb2d01e5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:57.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.896+0000 7fb2d6dff700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d0160a60 0x7fb2d01e5d30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800efc0 tx=0x7fb2c800c3a0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.897+0000 7fb2d6dff700 1 -- 172.21.15.16:0/4119331434 shutdown_connections 2023-06-08T04:02:57.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.897+0000 7fb2d6dff700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb2b406ace0 0x7fb2b406d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.897+0000 7fb2d6dff700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2d0160a60 0x7fb2d01e5d30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.897+0000 7fb2d6dff700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2d00b4b50 0x7fb2d00cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.897+0000 7fb2d6dff700 1 --2- 172.21.15.16:0/4119331434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2d00b83f0 0x7fb2d014cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:57.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.897+0000 7fb2d6dff700 1 -- 172.21.15.16:0/4119331434 >> 172.21.15.16:0/4119331434 conn(0x7fb2d00cf610 msgr2=0x7fb2d015c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:57.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.897+0000 7fb2d6dff700 1 -- 172.21.15.16:0/4119331434 shutdown_connections 2023-06-08T04:02:57.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:57.897+0000 7fb2d6dff700 1 -- 172.21.15.16:0/4119331434 wait complete. 2023-06-08T04:02:57.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-08T04:02:58.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.117+0000 7fc0861ff700 1 Processor -- start 2023-06-08T04:02:58.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.118+0000 7fc0861ff700 1 -- start start 2023-06-08T04:02:58.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.119+0000 7fc0861ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0800b4d20 0x7fc080167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:58.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.119+0000 7fc0861ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0800d0800 con 0x7fc080160a60 2023-06-08T04:02:58.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.119+0000 7fc0861ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0800cd1e0 con 0x7fc0800b83f0 2023-06-08T04:02:58.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.119+0000 7fc0861ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc080160ed0 con 0x7fc0800b4d20 2023-06-08T04:02:58.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.119+0000 7fc07effd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc080160a60 0x7fc0800b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53572/0 (socket says 172.21.15.16:53572) 2023-06-08T04:02:58.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.119+0000 7fc07effd700 1 -- 172.21.15.16:0/1841806269 learned_addr learned my addr 172.21.15.16:0/1841806269 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:58.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.119+0000 7fc07ffff700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0800b4d20 0x7fc080167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:58.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.119+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060117126 0 0) 0x7fc0800d0800 con 0x7fc080160a60 2023-06-08T04:02:58.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0680035b0 con 0x7fc080160a60 2023-06-08T04:02:58.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4118305405 0 0) 0x7fc0680035b0 con 0x7fc080160a60 2023-06-08T04:02:58.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0800b4d20 msgr2=0x7fc080167260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:58.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0800b4d20 0x7fc080167260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:58.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 >> v1:172.21.15.169:6789/0 conn(0x7fc0800b83f0 legacy=0x7fc0800ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:58.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0800cd4c0 con 0x7fc080160a60 2023-06-08T04:02:58.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7fc074001670 con 0x7fc080160a60 2023-06-08T04:02:58.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 >> v1:172.21.15.16:6789/0 conn(0x7fc080160a60 legacy=0x7fc0800b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:58.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0800b4d20 0x7fc068003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:58.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc068003f70 0x7fc068004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:58.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc068004d90 0x7fc068005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:58.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06800bb20 con 0x7fc068003f70 2023-06-08T04:02:58.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06800bc90 con 0x7fc068004d90 2023-06-08T04:02:58.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06800be50 con 0x7fc0800b4d20 2023-06-08T04:02:58.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07effd700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc068003f70 0x7fc068004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:58.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.120+0000 7fc07f7fe700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0800b4d20 0x7fc068003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:58.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.121+0000 7fc07ffff700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc068004d90 0x7fc068005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:58.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.121+0000 7fc07effd700 1 -- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0800b4d20 msgr2=0x7fc068003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:58.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.121+0000 7fc07effd700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc0800b4d20 0x7fc068003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:58.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.121+0000 7fc07effd700 1 -- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc068004d90 msgr2=0x7fc068005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:02:58.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.121+0000 7fc07effd700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc068004d90 0x7fc068005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:58.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.121+0000 7fc07effd700 1 -- 172.21.15.16:0/1841806269 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0680035b0 con 0x7fc068003f70 2023-06-08T04:02:58.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.121+0000 7fc07ffff700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc068004d90 0x7fc068005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:02:58.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.121+0000 7fc07effd700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc068003f70 0x7fc068004850 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc07400c1e0 tx=0x7fc068005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64827c6bd364a8ea server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:58.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.121+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074007b70 con 0x7fc068003f70 2023-06-08T04:02:58.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.121+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07400ccc0 con 0x7fc068003f70 2023-06-08T04:02:58.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.121+0000 7fc07e7fc700 1 -- 172.21.15.16:0/1841806269 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074005ba0 con 0x7fc068003f70 2023-06-08T04:02:58.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.122+0000 7fc0861ff700 1 -- 172.21.15.16:0/1841806269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc068003f70 msgr2=0x7fc068004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:58.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.122+0000 7fc0861ff700 1 --2- 172.21.15.16:0/1841806269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc068003f70 0x7fc068004850 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc07400c1e0 tx=0x7fc068005880 comp rx=0 tx=0).stop 2023-06-08T04:02:58.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.122+0000 7fc07ffff700 1 -- 172.21.15.16:0/1841806269 reap_dead start 2023-06-08T04:02:58.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.122+0000 7fc0861ff700 1 -- 172.21.15.16:0/1841806269 shutdown_connections 2023-06-08T04:02:58.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.122+0000 7fc0861ff700 1 -- 172.21.15.16:0/1841806269 >> 172.21.15.16:0/1841806269 conn(0x7fc0800cf610 msgr2=0x7fc0800cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:58.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.122+0000 7fc0861ff700 1 -- 172.21.15.16:0/1841806269 shutdown_connections 2023-06-08T04:02:58.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.122+0000 7fc0861ff700 1 -- 172.21.15.16:0/1841806269 wait complete. 2023-06-08T04:02:58.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.124+0000 7fc0861ff700 1 Processor -- start 2023-06-08T04:02:58.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.124+0000 7fc0861ff700 1 -- start start 2023-06-08T04:02:58.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc0861ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc068003f70 0x7fc08015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:58.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc0861ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0800ca530 0x7fc0800ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:58.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc0861ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc080159170 0x7fc0801595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:58.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc0861ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0801f2d40 con 0x7fc080159170 2023-06-08T04:02:58.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc0861ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc080159b10 con 0x7fc0800ca530 2023-06-08T04:02:58.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc0861ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0801f23a0 con 0x7fc068003f70 2023-06-08T04:02:58.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc07ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc080159170 0x7fc0801595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:58.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc07ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc080159170 0x7fc0801595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39958/0 (socket says 172.21.15.16:39958) 2023-06-08T04:02:58.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc07ffff700 1 -- 172.21.15.16:0/1664181955 learned_addr learned my addr 172.21.15.16:0/1664181955 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:58.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc07f7fe700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc068003f70 0x7fc08015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:58.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc07effd700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0800ca530 0x7fc0800ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:58.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc07ffff700 1 -- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc068003f70 msgr2=0x7fc08015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:58.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.125+0000 7fc07ffff700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc068003f70 0x7fc08015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:58.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.126+0000 7fc07ffff700 1 -- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0800ca530 msgr2=0x7fc0800ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:58.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.126+0000 7fc07ffff700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0800ca530 0x7fc0800ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:58.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.126+0000 7fc07ffff700 1 -- 172.21.15.16:0/1664181955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0801f2680 con 0x7fc080159170 2023-06-08T04:02:58.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.126+0000 7fc07ffff700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc080159170 0x7fc0801595d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc08008c030 tx=0x7fc0780104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:58.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.126+0000 7fc067fff700 1 -- 172.21.15.16:0/1664181955 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800e050 con 0x7fc080159170 2023-06-08T04:02:58.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.126+0000 7fc067fff700 1 -- 172.21.15.16:0/1664181955 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07800f040 con 0x7fc080159170 2023-06-08T04:02:58.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.126+0000 7fc067fff700 1 -- 172.21.15.16:0/1664181955 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078003a20 con 0x7fc080159170 2023-06-08T04:02:58.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.126+0000 7fc0861ff700 1 -- 172.21.15.16:0/1664181955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0801f2960 con 0x7fc080159170 2023-06-08T04:02:58.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.126+0000 7fc0861ff700 1 -- 172.21.15.16:0/1664181955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08015a440 con 0x7fc080159170 2023-06-08T04:02:58.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.127+0000 7fc0861ff700 1 -- 172.21.15.16:0/1664181955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0800740e0 con 0x7fc080159170 2023-06-08T04:02:58.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.128+0000 7fc067fff700 1 -- 172.21.15.16:0/1664181955 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc078003b80 con 0x7fc080159170 2023-06-08T04:02:58.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.129+0000 7fc067fff700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc06c06ace0 0x7fc06c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:58.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.129+0000 7fc067fff700 1 -- 172.21.15.16:0/1664181955 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc078089950 con 0x7fc080159170 2023-06-08T04:02:58.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.130+0000 7fc07f7fe700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc06c06ace0 0x7fc06c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:58.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.130+0000 7fc07f7fe700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc06c06ace0 0x7fc06c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc070007fd0 tx=0x7fc070009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:58.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.134+0000 7fc067fff700 1 -- 172.21.15.16:0/1664181955 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc0780549b0 con 0x7fc080159170 2023-06-08T04:02:58.194 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:02:58.200 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:02:58.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.400+0000 7fc0861ff700 1 -- 172.21.15.16:0/1664181955 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc0801f2e80 con 0x7fc080159170 2023-06-08T04:02:58.983 INFO:tasks.ceph.mon.a.smithi016.stderr:2023-06-08T04:02:58.979+0000 7f5b3bff9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-08T04:02:58.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.986+0000 7fc067fff700 1 -- 172.21.15.16:0/1664181955 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc0801f2e80 con 0x7fc080159170 2023-06-08T04:02:58.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 -- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc06c06ace0 msgr2=0x7fc06c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:58.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc06c06ace0 0x7fc06c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc070007fd0 tx=0x7fc070009040 comp rx=0 tx=0).stop 2023-06-08T04:02:58.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 -- 172.21.15.16:0/1664181955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc080159170 msgr2=0x7fc0801595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:58.993 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc080159170 0x7fc0801595d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc08008c030 tx=0x7fc0780104a0 comp rx=0 tx=0).stop 2023-06-08T04:02:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 -- 172.21.15.16:0/1664181955 shutdown_connections 2023-06-08T04:02:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc06c06ace0 0x7fc06c06d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc080159170 0x7fc0801595d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc068003f70 0x7fc08015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 --2- 172.21.15.16:0/1664181955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc0800ca530 0x7fc0800ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 -- 172.21.15.16:0/1664181955 >> 172.21.15.16:0/1664181955 conn(0x7fc0800cf610 msgr2=0x7fc08015a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:58.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 -- 172.21.15.16:0/1664181955 shutdown_connections 2023-06-08T04:02:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:58.989+0000 7fc0861ff700 1 -- 172.21.15.16:0/1664181955 wait complete. 2023-06-08T04:02:58.995 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-08T04:02:59.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-08T04:02:59.062 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2023-06-08T04:02:59.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.214+0000 7f71989ff700 1 Processor -- start 2023-06-08T04:02:59.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.214+0000 7f71989ff700 1 -- start start 2023-06-08T04:02:59.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.215+0000 7f71989ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7194159200 0x7f71940adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:59.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.215+0000 7f71989ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71940c9b60 con 0x7f7194070990 2023-06-08T04:02:59.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.215+0000 7f71989ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719406d660 con 0x7f719415d660 2023-06-08T04:02:59.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.215+0000 7f71989ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71941595d0 con 0x7f7194159200 2023-06-08T04:02:59.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.216+0000 7f7192d9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7194070990 0x7f71940c9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53576/0 (socket says 172.21.15.16:53576) 2023-06-08T04:02:59.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.216+0000 7f7192d9d700 1 -- 172.21.15.16:0/1104367512 learned_addr learned my addr 172.21.15.16:0/1104367512 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:02:59.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.216+0000 7f719259c700 1 --2- 172.21.15.16:0/1104367512 >> v2:172.21.15.169:3300/0 conn(0x7f7194159200 0x7f71940adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:59.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.216+0000 7f719159a700 1 -- 172.21.15.16:0/1104367512 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768827134 0 0) 0x7f71940c9b60 con 0x7f7194070990 2023-06-08T04:02:59.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.216+0000 7f719159a700 1 -- 172.21.15.16:0/1104367512 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f717c0057c0 con 0x7f7194070990 2023-06-08T04:02:59.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.216+0000 7f719259c700 1 -- 172.21.15.16:0/1104367512 >> v1:172.21.15.169:6789/0 conn(0x7f719415d660 legacy=0x7f7194070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:59.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.216+0000 7f719259c700 1 -- 172.21.15.16:0/1104367512 >> v1:172.21.15.16:6789/0 conn(0x7f7194070990 legacy=0x7f71940c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:59.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.216+0000 7f719259c700 1 -- 172.21.15.16:0/1104367512 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719406d940 con 0x7f7194159200 2023-06-08T04:02:59.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.216+0000 7f719259c700 1 --2- 172.21.15.16:0/1104367512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7194159200 0x7f71940adb60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7184009840 tx=0x7f7184009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aebd104cc2009c0a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:59.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.217+0000 7f719159a700 1 -- 172.21.15.16:0/1104367512 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184011830 con 0x7f7194159200 2023-06-08T04:02:59.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.217+0000 7f719159a700 1 -- 172.21.15.16:0/1104367512 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7184011990 con 0x7f7194159200 2023-06-08T04:02:59.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.217+0000 7f719159a700 1 -- 172.21.15.16:0/1104367512 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184011d00 con 0x7f7194159200 2023-06-08T04:02:59.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.217+0000 7f71989ff700 1 -- 172.21.15.16:0/1104367512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7194159200 msgr2=0x7f71940adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:59.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.217+0000 7f71989ff700 1 --2- 172.21.15.16:0/1104367512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7194159200 0x7f71940adb60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7184009840 tx=0x7f7184009b50 comp rx=0 tx=0).stop 2023-06-08T04:02:59.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.217+0000 7f71989ff700 1 -- 172.21.15.16:0/1104367512 shutdown_connections 2023-06-08T04:02:59.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.217+0000 7f71989ff700 1 --2- 172.21.15.16:0/1104367512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7194159200 0x7f71940adb60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:59.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.217+0000 7f71989ff700 1 -- 172.21.15.16:0/1104367512 >> 172.21.15.16:0/1104367512 conn(0x7f719406aa40 msgr2=0x7f71940b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:59.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.217+0000 7f71989ff700 1 -- 172.21.15.16:0/1104367512 shutdown_connections 2023-06-08T04:02:59.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.218+0000 7f71989ff700 1 -- 172.21.15.16:0/1104367512 wait complete. 2023-06-08T04:02:59.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.219+0000 7f71989ff700 1 Processor -- start 2023-06-08T04:02:59.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.219+0000 7f71989ff700 1 -- start start 2023-06-08T04:02:59.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.220+0000 7f71989ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7194070990 0x7f71940cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:59.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.220+0000 7f71989ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7194159200 0x7f719415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:59.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.220+0000 7f71989ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f719415d660 0x7f71940c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:59.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.220+0000 7f71989ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7194150d90 con 0x7f7194070990 2023-06-08T04:02:59.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.220+0000 7f71989ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719415a7d0 con 0x7f719415d660 2023-06-08T04:02:59.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.220+0000 7f71989ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71940cb620 con 0x7f7194159200 2023-06-08T04:02:59.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.220+0000 7f719259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7194070990 0x7f71940cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:59.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.221+0000 7f719259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7194070990 0x7f71940cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39972/0 (socket says 172.21.15.16:39972) 2023-06-08T04:02:59.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.221+0000 7f719259c700 1 -- 172.21.15.16:0/2084953021 learned_addr learned my addr 172.21.15.16:0/2084953021 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:02:59.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.221+0000 7f7191d9b700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7194159200 0x7f719415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:59.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.221+0000 7f7192d9d700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f719415d660 0x7f71940c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:59.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.221+0000 7f719259c700 1 -- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7194159200 msgr2=0x7f719415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:59.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.221+0000 7f719259c700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7194159200 0x7f719415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:59.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.221+0000 7f719259c700 1 -- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f719415d660 msgr2=0x7f71940c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:59.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.221+0000 7f719259c700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f719415d660 0x7f71940c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:59.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.221+0000 7f719259c700 1 -- 172.21.15.16:0/2084953021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71840094a0 con 0x7f7194070990 2023-06-08T04:02:59.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.221+0000 7f719259c700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7194070990 0x7f71940cb040 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7184000c00 tx=0x7f7184004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:59.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.222+0000 7f7182ffd700 1 -- 172.21.15.16:0/2084953021 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71840045d0 con 0x7f7194070990 2023-06-08T04:02:59.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.222+0000 7f7182ffd700 1 -- 172.21.15.16:0/2084953021 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718401f070 con 0x7f7194070990 2023-06-08T04:02:59.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.222+0000 7f71989ff700 1 -- 172.21.15.16:0/2084953021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7194150460 con 0x7f7194070990 2023-06-08T04:02:59.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.222+0000 7f7182ffd700 1 -- 172.21.15.16:0/2084953021 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71840038e0 con 0x7f7194070990 2023-06-08T04:02:59.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.222+0000 7f71989ff700 1 -- 172.21.15.16:0/2084953021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7194150a20 con 0x7f7194070990 2023-06-08T04:02:59.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.223+0000 7f71989ff700 1 -- 172.21.15.16:0/2084953021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71940740e0 con 0x7f7194070990 2023-06-08T04:02:59.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.224+0000 7f7182ffd700 1 -- 172.21.15.16:0/2084953021 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7184003a40 con 0x7f7194070990 2023-06-08T04:02:59.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.225+0000 7f7182ffd700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f717406ace0 0x7f717406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:02:59.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.225+0000 7f7182ffd700 1 -- 172.21.15.16:0/2084953021 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f7184021070 con 0x7f7194070990 2023-06-08T04:02:59.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.225+0000 7f7191d9b700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f717406ace0 0x7f717406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:02:59.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.225+0000 7f7191d9b700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f717406ace0 0x7f717406d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f719406fd30 tx=0x7f7188009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:02:59.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.229+0000 7f7182ffd700 1 -- 172.21.15.16:0/2084953021 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7184055cb0 con 0x7f7194070990 2023-06-08T04:02:59.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.480+0000 7f71989ff700 1 -- 172.21.15.16:0/2084953021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f71940ce460 con 0x7f7194070990 2023-06-08T04:02:59.992 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.988+0000 7f7182ffd700 1 -- 172.21.15.16:0/2084953021 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f71840592d0 con 0x7f7194070990 2023-06-08T04:02:59.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 -- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f717406ace0 msgr2=0x7f717406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:59.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f717406ace0 0x7f717406d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f719406fd30 tx=0x7f7188009040 comp rx=0 tx=0).stop 2023-06-08T04:02:59.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 -- 172.21.15.16:0/2084953021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7194070990 msgr2=0x7f71940cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:02:59.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7194070990 0x7f71940cb040 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7184000c00 tx=0x7f7184004750 comp rx=0 tx=0).stop 2023-06-08T04:02:59.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 -- 172.21.15.16:0/2084953021 shutdown_connections 2023-06-08T04:02:59.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f717406ace0 0x7f717406d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:59.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f719415d660 0x7f71940c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:59.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7194070990 0x7f71940cb040 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:59.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 --2- 172.21.15.16:0/2084953021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7194159200 0x7f719415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:02:59.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 -- 172.21.15.16:0/2084953021 >> 172.21.15.16:0/2084953021 conn(0x7f719406aa40 msgr2=0x7f71941539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:02:59.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 -- 172.21.15.16:0/2084953021 shutdown_connections 2023-06-08T04:02:59.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:02:59.991+0000 7f71989ff700 1 -- 172.21.15.16:0/2084953021 wait complete. 2023-06-08T04:03:00.014 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-08T04:03:00.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.217+0000 7fb9c6bff700 1 Processor -- start 2023-06-08T04:03:00.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.217+0000 7fb9c6bff700 1 -- start start 2023-06-08T04:03:00.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.218+0000 7fb9c6bff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9c015b250 0x7fb9c00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:00.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.218+0000 7fb9c6bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9c0161d10 0x7fb9c01640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:00.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.218+0000 7fb9c6bff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c0070c90 con 0x7fb9c015a770 2023-06-08T04:03:00.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.218+0000 7fb9c6bff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c00ce620 con 0x7fb9c015b250 2023-06-08T04:03:00.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.218+0000 7fb9c6bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00cbd30 con 0x7fb9c0161d10 2023-06-08T04:03:00.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.218+0000 7fb9bffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9c015b250 0x7fb9c00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:00.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.218+0000 7fb9bffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9c015b250 0x7fb9c00ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39982/0 (socket says 172.21.15.16:39982) 2023-06-08T04:03:00.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.218+0000 7fb9bffff700 1 -- 172.21.15.16:0/835513934 learned_addr learned my addr 172.21.15.16:0/835513934 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:00.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.218+0000 7fb9c499b700 1 --1- 172.21.15.16:0/835513934 >> v1:172.21.15.169:6789/0 conn(0x7fb9c015a770 0x7fb9c015ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:54306/0 (socket says 172.21.15.16:54306) 2023-06-08T04:03:00.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.218+0000 7fb9c519c700 1 --2- 172.21.15.16:0/835513934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9c0161d10 0x7fb9c01640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:00.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.219+0000 7fb9bffff700 1 -- 172.21.15.16:0/835513934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9c0161d10 msgr2=0x7fb9c01640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:00.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.219+0000 7fb9bffff700 1 --2- 172.21.15.16:0/835513934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9c0161d10 0x7fb9c01640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:00.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.219+0000 7fb9bffff700 1 -- 172.21.15.16:0/835513934 >> v1:172.21.15.169:6789/0 conn(0x7fb9c015a770 legacy=0x7fb9c015ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:00.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.219+0000 7fb9bffff700 1 -- 172.21.15.16:0/835513934 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c00c9110 con 0x7fb9c015b250 2023-06-08T04:03:00.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.219+0000 7fb9bffff700 1 --2- 172.21.15.16:0/835513934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9c015b250 0x7fb9c00ce0e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009920 tx=0x7fb9ac009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ce74caa971b907 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:00.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.219+0000 7fb9bf7fe700 1 -- 172.21.15.16:0/835513934 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac011830 con 0x7fb9c015b250 2023-06-08T04:03:00.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.219+0000 7fb9bf7fe700 1 -- 172.21.15.16:0/835513934 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac011990 con 0x7fb9c015b250 2023-06-08T04:03:00.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.219+0000 7fb9bf7fe700 1 -- 172.21.15.16:0/835513934 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac011d20 con 0x7fb9c015b250 2023-06-08T04:03:00.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.220+0000 7fb9c6bff700 1 -- 172.21.15.16:0/835513934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9c015b250 msgr2=0x7fb9c00ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:00.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.220+0000 7fb9c6bff700 1 --2- 172.21.15.16:0/835513934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9c015b250 0x7fb9c00ce0e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009920 tx=0x7fb9ac009c30 comp rx=0 tx=0).stop 2023-06-08T04:03:00.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.220+0000 7fb9c6bff700 1 -- 172.21.15.16:0/835513934 shutdown_connections 2023-06-08T04:03:00.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.220+0000 7fb9c6bff700 1 --2- 172.21.15.16:0/835513934 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9c0161d10 0x7fb9c01640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:00.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.220+0000 7fb9c6bff700 1 --2- 172.21.15.16:0/835513934 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9c015b250 0x7fb9c00ce0e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:00.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.220+0000 7fb9c6bff700 1 -- 172.21.15.16:0/835513934 >> 172.21.15.16:0/835513934 conn(0x7fb9c006aa40 msgr2=0x7fb9c00b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:00.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.220+0000 7fb9c6bff700 1 -- 172.21.15.16:0/835513934 shutdown_connections 2023-06-08T04:03:00.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.220+0000 7fb9c6bff700 1 -- 172.21.15.16:0/835513934 wait complete. 2023-06-08T04:03:00.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.222+0000 7fb9c6bff700 1 Processor -- start 2023-06-08T04:03:00.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.222+0000 7fb9c6bff700 1 -- start start 2023-06-08T04:03:00.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.223+0000 7fb9c6bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9c015a770 0x7fb9c00ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:00.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.223+0000 7fb9c6bff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9c015b250 0x7fb9c00af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:00.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.223+0000 7fb9c6bff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9c0161d10 0x7fb9c00c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:00.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.223+0000 7fb9c6bff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0150d10 con 0x7fb9c0161d10 2023-06-08T04:03:00.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.223+0000 7fb9c6bff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c0150ff0 con 0x7fb9c015b250 2023-06-08T04:03:00.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.223+0000 7fb9c6bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01512d0 con 0x7fb9c015a770 2023-06-08T04:03:00.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.223+0000 7fb9c519c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9c0161d10 0x7fb9c00c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:00.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.223+0000 7fb9c519c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9c0161d10 0x7fb9c00c5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39994/0 (socket says 172.21.15.16:39994) 2023-06-08T04:03:00.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.223+0000 7fb9c519c700 1 -- 172.21.15.16:0/1690711910 learned_addr learned my addr 172.21.15.16:0/1690711910 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:00.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.223+0000 7fb9c499b700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9c015a770 0x7fb9c00ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:00.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.223+0000 7fb9bffff700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9c015b250 0x7fb9c00af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:00.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9c519c700 1 -- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9c015a770 msgr2=0x7fb9c00ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:00.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9c519c700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9c015a770 0x7fb9c00ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:00.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9c519c700 1 -- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9c015b250 msgr2=0x7fb9c00af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:00.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9c519c700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9c015b250 0x7fb9c00af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:00.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9c519c700 1 -- 172.21.15.16:0/1690711910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac009550 con 0x7fb9c0161d10 2023-06-08T04:03:00.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9c499b700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9c015a770 0x7fb9c00ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:00.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9bffff700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9c015b250 0x7fb9c00af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:00.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9c519c700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9c0161d10 0x7fb9c00c5840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800efc0 tx=0x7fb9b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:00.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9bd7fa700 1 -- 172.21.15.16:0/1690711910 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b800cd40 con 0x7fb9c0161d10 2023-06-08T04:03:00.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9bd7fa700 1 -- 172.21.15.16:0/1690711910 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b800f040 con 0x7fb9c0161d10 2023-06-08T04:03:00.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9c6bff700 1 -- 172.21.15.16:0/1690711910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c01515b0 con 0x7fb9c0161d10 2023-06-08T04:03:00.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9bd7fa700 1 -- 172.21.15.16:0/1690711910 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80146c0 con 0x7fb9c0161d10 2023-06-08T04:03:00.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.224+0000 7fb9c6bff700 1 -- 172.21.15.16:0/1690711910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c00ae9f0 con 0x7fb9c0161d10 2023-06-08T04:03:00.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.225+0000 7fb9c6bff700 1 -- 172.21.15.16:0/1690711910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c00740e0 con 0x7fb9c0161d10 2023-06-08T04:03:00.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.226+0000 7fb9bd7fa700 1 -- 172.21.15.16:0/1690711910 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb9b8014820 con 0x7fb9c0161d10 2023-06-08T04:03:00.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.228+0000 7fb9bd7fa700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9a406ace0 0x7fb9a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:00.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.228+0000 7fb9bd7fa700 1 -- 172.21.15.16:0/1690711910 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fb9b8089fa0 con 0x7fb9c0161d10 2023-06-08T04:03:00.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.229+0000 7fb9c499b700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9a406ace0 0x7fb9a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:00.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.229+0000 7fb9c499b700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9a406ace0 0x7fb9a406d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4000f60 tx=0x7fb9b4007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:00.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.232+0000 7fb9bd7fa700 1 -- 172.21.15.16:0/1690711910 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb9b8058930 con 0x7fb9c0161d10 2023-06-08T04:03:00.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.438+0000 7fb9c6bff700 1 -- 172.21.15.16:0/1690711910 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9c00c9a90 con 0x7fb9c0161d10 2023-06-08T04:03:00.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.993+0000 7fb9bd7fa700 1 -- 172.21.15.16:0/1690711910 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb9b800cea0 con 0x7fb9c0161d10 2023-06-08T04:03:01.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.996+0000 7fb9c6bff700 1 -- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9a406ace0 msgr2=0x7fb9a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:01.000 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.996+0000 7fb9c6bff700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9a406ace0 0x7fb9a406d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4000f60 tx=0x7fb9b4007df0 comp rx=0 tx=0).stop 2023-06-08T04:03:01.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.996+0000 7fb9c6bff700 1 -- 172.21.15.16:0/1690711910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9c0161d10 msgr2=0x7fb9c00c5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:01.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.996+0000 7fb9c6bff700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9c0161d10 0x7fb9c00c5840 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800efc0 tx=0x7fb9b800c3a0 comp rx=0 tx=0).stop 2023-06-08T04:03:01.001 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.997+0000 7fb9c6bff700 1 -- 172.21.15.16:0/1690711910 shutdown_connections 2023-06-08T04:03:01.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.997+0000 7fb9c6bff700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb9a406ace0 0x7fb9a406d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:01.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.997+0000 7fb9c6bff700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9c0161d10 0x7fb9c00c5840 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:01.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.997+0000 7fb9c6bff700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9c015a770 0x7fb9c00ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:01.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.997+0000 7fb9c6bff700 1 --2- 172.21.15.16:0/1690711910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9c015b250 0x7fb9c00af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:01.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.997+0000 7fb9c6bff700 1 -- 172.21.15.16:0/1690711910 >> 172.21.15.16:0/1690711910 conn(0x7fb9c006aa40 msgr2=0x7fb9c00cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:01.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.997+0000 7fb9c6bff700 1 -- 172.21.15.16:0/1690711910 shutdown_connections 2023-06-08T04:03:01.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:00.997+0000 7fb9c6bff700 1 -- 172.21.15.16:0/1690711910 wait complete. 2023-06-08T04:03:01.003 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2023-06-08T04:03:01.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-08T04:03:01.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.229+0000 7f1a085ff700 1 Processor -- start 2023-06-08T04:03:01.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.229+0000 7f1a085ff700 1 -- start start 2023-06-08T04:03:01.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.230+0000 7f1a085ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a00160a60 0x7f1a000b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:01.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.230+0000 7f1a085ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1a000b4b50 0x7f1a000d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:01.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.230+0000 7f1a085ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a000d0800 con 0x7f1a000b83f0 2023-06-08T04:03:01.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.230+0000 7f1a085ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a00160ed0 con 0x7f1a000b4b50 2023-06-08T04:03:01.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.230+0000 7f1a085ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000b4fd0 con 0x7f1a00160a60 2023-06-08T04:03:01.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.230+0000 7f1a0639b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1a000b83f0 0x7f1a000ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53580/0 (socket says 172.21.15.16:53580) 2023-06-08T04:03:01.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.230+0000 7f1a0639b700 1 -- 172.21.15.16:0/1456583773 learned_addr learned my addr 172.21.15.16:0/1456583773 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:01.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.230+0000 7f1a05b9a700 1 --2- 172.21.15.16:0/1456583773 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a00160a60 0x7f1a000b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:01.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.230+0000 7f1a06b9c700 1 --2- 172.21.15.16:0/1456583773 >> v2:172.21.15.169:3300/0 conn(0x7f1a000b4b50 0x7f1a000d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:01.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.231+0000 7f1a05399700 1 -- 172.21.15.16:0/1456583773 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439174235 0 0) 0x7f1a000d0800 con 0x7f1a000b83f0 2023-06-08T04:03:01.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.231+0000 7f1a05399700 1 -- 172.21.15.16:0/1456583773 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19ec0035b0 con 0x7f1a000b83f0 2023-06-08T04:03:01.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.231+0000 7f1a05b9a700 1 -- 172.21.15.16:0/1456583773 >> v2:172.21.15.169:3300/0 conn(0x7f1a000b4b50 msgr2=0x7f1a000d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:01.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.231+0000 7f1a05b9a700 1 --2- 172.21.15.16:0/1456583773 >> v2:172.21.15.169:3300/0 conn(0x7f1a000b4b50 0x7f1a000d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:01.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.231+0000 7f1a05399700 1 -- 172.21.15.16:0/1456583773 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3027271810 0 0) 0x7f19ec0035b0 con 0x7f1a000b83f0 2023-06-08T04:03:01.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.231+0000 7f1a05b9a700 1 -- 172.21.15.16:0/1456583773 >> v1:172.21.15.16:6789/0 conn(0x7f1a000b83f0 legacy=0x7f1a000ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:01.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.231+0000 7f1a05b9a700 1 -- 172.21.15.16:0/1456583773 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a000cd1e0 con 0x7f1a00160a60 2023-06-08T04:03:01.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.231+0000 7f1a06b9c700 1 --2- 172.21.15.16:0/1456583773 >> v2:172.21.15.169:3300/0 conn(0x7f1a000b4b50 0x7f1a000d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:03:01.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.231+0000 7f1a05b9a700 1 --2- 172.21.15.16:0/1456583773 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a00160a60 0x7f1a000b4610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009840 tx=0x7f19f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b55092efa47dcee7 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:01.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.232+0000 7f1a05399700 1 -- 172.21.15.16:0/1456583773 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc001670 con 0x7f1a00160a60 2023-06-08T04:03:01.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.232+0000 7f1a05399700 1 -- 172.21.15.16:0/1456583773 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f0004030 con 0x7f1a00160a60 2023-06-08T04:03:01.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.232+0000 7f1a05399700 1 -- 172.21.15.16:0/1456583773 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00043c0 con 0x7f1a00160a60 2023-06-08T04:03:01.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.232+0000 7f1a085ff700 1 -- 172.21.15.16:0/1456583773 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a00160a60 msgr2=0x7f1a000b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:01.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.232+0000 7f1a085ff700 1 --2- 172.21.15.16:0/1456583773 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a00160a60 0x7f1a000b4610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009840 tx=0x7f19f0009b50 comp rx=0 tx=0).stop 2023-06-08T04:03:01.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.232+0000 7f1a085ff700 1 -- 172.21.15.16:0/1456583773 shutdown_connections 2023-06-08T04:03:01.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.232+0000 7f1a085ff700 1 --2- 172.21.15.16:0/1456583773 >> v2:172.21.15.169:3300/0 conn(0x7f1a000b4b50 0x7f1a000d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:01.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.232+0000 7f1a085ff700 1 --2- 172.21.15.16:0/1456583773 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a00160a60 0x7f1a000b4610 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:01.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.232+0000 7f1a085ff700 1 -- 172.21.15.16:0/1456583773 >> 172.21.15.16:0/1456583773 conn(0x7f1a000cf610 msgr2=0x7f1a000cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:01.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.232+0000 7f1a085ff700 1 -- 172.21.15.16:0/1456583773 shutdown_connections 2023-06-08T04:03:01.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.232+0000 7f1a085ff700 1 -- 172.21.15.16:0/1456583773 wait complete. 2023-06-08T04:03:01.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.234+0000 7f1a085ff700 1 Processor -- start 2023-06-08T04:03:01.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.234+0000 7f1a085ff700 1 -- start start 2023-06-08T04:03:01.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.235+0000 7f1a085ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a000b4b50 0x7f1a00153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:01.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.235+0000 7f1a085ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a000b83f0 0x7f1a0015e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:01.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.235+0000 7f1a085ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a00160a60 0x7f1a00159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:01.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.235+0000 7f1a085ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c9d00 con 0x7f1a00160a60 2023-06-08T04:03:01.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.235+0000 7f1a085ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c9fe0 con 0x7f1a000b4b50 2023-06-08T04:03:01.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.235+0000 7f1a085ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000ca2c0 con 0x7f1a000b83f0 2023-06-08T04:03:01.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.235+0000 7f1a06b9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a00160a60 0x7f1a00159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:01.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f1a06b9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a00160a60 0x7f1a00159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39998/0 (socket says 172.21.15.16:39998) 2023-06-08T04:03:01.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f1a06b9c700 1 -- 172.21.15.16:0/3319298731 learned_addr learned my addr 172.21.15.16:0/3319298731 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:01.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f1a0639b700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a000b4b50 0x7f1a00153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:01.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f1a05b9a700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a000b83f0 0x7f1a0015e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:01.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f1a06b9c700 1 -- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a000b83f0 msgr2=0x7f1a0015e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:01.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f1a06b9c700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a000b83f0 0x7f1a0015e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:01.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f1a06b9c700 1 -- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a000b4b50 msgr2=0x7f1a00153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:01.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f1a06b9c700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a000b4b50 0x7f1a00153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:01.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f1a06b9c700 1 -- 172.21.15.16:0/3319298731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f8009a70 con 0x7f1a00160a60 2023-06-08T04:03:01.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f1a06b9c700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a00160a60 0x7f1a00159280 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f19f800efc0 tx=0x7f19f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:01.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f19f6ffd700 1 -- 172.21.15.16:0/3319298731 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f800ca90 con 0x7f1a00160a60 2023-06-08T04:03:01.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f19f6ffd700 1 -- 172.21.15.16:0/3319298731 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f800f040 con 0x7f1a00160a60 2023-06-08T04:03:01.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f19f6ffd700 1 -- 172.21.15.16:0/3319298731 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f800ce10 con 0x7f1a00160a60 2023-06-08T04:03:01.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.236+0000 7f1a085ff700 1 -- 172.21.15.16:0/3319298731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f00094a0 con 0x7f1a00160a60 2023-06-08T04:03:01.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.237+0000 7f1a085ff700 1 -- 172.21.15.16:0/3319298731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a000ca880 con 0x7f1a00160a60 2023-06-08T04:03:01.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.238+0000 7f1a085ff700 1 -- 172.21.15.16:0/3319298731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a000740e0 con 0x7f1a00160a60 2023-06-08T04:03:01.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.239+0000 7f19f6ffd700 1 -- 172.21.15.16:0/3319298731 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19f8014480 con 0x7f1a00160a60 2023-06-08T04:03:01.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.240+0000 7f19f6ffd700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f19e406ad10 0x7f19e406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:01.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.240+0000 7f19f6ffd700 1 -- 172.21.15.16:0/3319298731 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f19f8089ab0 con 0x7f1a00160a60 2023-06-08T04:03:01.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.241+0000 7f1a0639b700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f19e406ad10 0x7f19e406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:01.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.241+0000 7f1a0639b700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f19e406ad10 0x7f19e406d1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19fc001eb0 tx=0x7f19fc001730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:01.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.245+0000 7f19f6ffd700 1 -- 172.21.15.16:0/3319298731 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f19f8058670 con 0x7f1a00160a60 2023-06-08T04:03:01.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.456+0000 7f1a085ff700 1 -- 172.21.15.16:0/3319298731 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a000cfcc0 con 0x7f1a00160a60 2023-06-08T04:03:01.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.994+0000 7f19f6ffd700 1 -- 172.21.15.16:0/3319298731 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f19f8009d70 con 0x7f1a00160a60 2023-06-08T04:03:02.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.998+0000 7f1a085ff700 1 -- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f19e406ad10 msgr2=0x7f19e406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:02.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.998+0000 7f1a085ff700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f19e406ad10 0x7f19e406d1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19fc001eb0 tx=0x7f19fc001730 comp rx=0 tx=0).stop 2023-06-08T04:03:02.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.998+0000 7f1a085ff700 1 -- 172.21.15.16:0/3319298731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a00160a60 msgr2=0x7f1a00159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:02.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.998+0000 7f1a085ff700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a00160a60 0x7f1a00159280 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f19f800efc0 tx=0x7f19f800c3a0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.998+0000 7f1a085ff700 1 -- 172.21.15.16:0/3319298731 shutdown_connections 2023-06-08T04:03:02.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.998+0000 7f1a085ff700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f19e406ad10 0x7f19e406d1c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.998+0000 7f1a085ff700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a00160a60 0x7f1a00159280 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.998+0000 7f1a085ff700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a000b4b50 0x7f1a00153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.998+0000 7f1a085ff700 1 --2- 172.21.15.16:0/3319298731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1a000b83f0 0x7f1a0015e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.998+0000 7f1a085ff700 1 -- 172.21.15.16:0/3319298731 >> 172.21.15.16:0/3319298731 conn(0x7f1a000cf610 msgr2=0x7f1a000b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:02.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.999+0000 7f1a085ff700 1 -- 172.21.15.16:0/3319298731 shutdown_connections 2023-06-08T04:03:02.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:01.999+0000 7f1a085ff700 1 -- 172.21.15.16:0/3319298731 wait complete. 2023-06-08T04:03:02.005 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2023-06-08T04:03:02.026 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-08T04:03:02.026 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-08T04:03:02.026 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-08T04:03:02.026 INFO:teuthology.orchestra.run:waiting for 300 2023-06-08T04:03:02.027 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-08T04:03:02.027 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-08T04:03:02.027 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-08T04:03:02.028 INFO:teuthology.orchestra.run:waiting for 300 2023-06-08T04:03:02.028 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-08T04:03:02.028 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-08T04:03:02.028 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-08T04:03:02.028 INFO:teuthology.orchestra.run:waiting for 300 2023-06-08T04:03:02.029 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-08T04:03:02.029 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-08T04:03:02.029 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-08T04:03:02.029 INFO:teuthology.orchestra.run:waiting for 300 2023-06-08T04:03:02.045 INFO:tasks.ceph.mds.a:Stopped 2023-06-08T04:03:02.045 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-08T04:03:02.046 INFO:tasks.ceph.mds.c:Stopped 2023-06-08T04:03:02.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-08T04:03:02.047 INFO:tasks.ceph.mds.b:Stopped 2023-06-08T04:03:02.048 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-08T04:03:02.048 INFO:tasks.ceph.mds.d:Stopped 2023-06-08T04:03:02.048 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-08T04:03:02.090 INFO:tasks.ceph.mds.a:Started 2023-06-08T04:03:02.090 DEBUG:teuthology.parallel:result is None 2023-06-08T04:03:02.092 INFO:tasks.ceph.mds.b:Started 2023-06-08T04:03:02.093 DEBUG:teuthology.parallel:result is None 2023-06-08T04:03:02.093 INFO:tasks.ceph.mds.c:Started 2023-06-08T04:03:02.094 DEBUG:teuthology.parallel:result is None 2023-06-08T04:03:02.095 INFO:tasks.ceph.mds.d:Started 2023-06-08T04:03:02.095 DEBUG:teuthology.parallel:result is None 2023-06-08T04:03:02.095 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-08T04:03:02.248 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2023-06-08T04:03:02.249 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2023-06-08T04:03:02.256 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2023-06-08T04:03:02.257 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2023-06-08T04:03:02.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.320+0000 7f450e1ff700 1 Processor -- start 2023-06-08T04:03:02.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.320+0000 7f450e1ff700 1 -- start start 2023-06-08T04:03:02.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.321+0000 7f450e1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f450815a770 0x7f45080ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:02.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.321+0000 7f450e1ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f450815ab40 0x7f450815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:02.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.321+0000 7f450e1ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f45080cad20 0x7f45080cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:02.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.321+0000 7f450e1ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45080ce620 con 0x7f45080cad20 2023-06-08T04:03:02.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.321+0000 7f450e1ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4508070c90 con 0x7f450815ab40 2023-06-08T04:03:02.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.321+0000 7f450e1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45080c9110 con 0x7f450815a770 2023-06-08T04:03:02.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.322+0000 7f4507fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f45080cad20 0x7f45080cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:02.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.322+0000 7f4507fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f45080cad20 0x7f45080cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53478/0 (socket says 172.21.15.16:53478) 2023-06-08T04:03:02.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.322+0000 7f4507fff700 1 -- 172.21.15.16:0/1607024186 learned_addr learned my addr 172.21.15.16:0/1607024186 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:02.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.322+0000 7f4506ffd700 1 --2- 172.21.15.16:0/1607024186 >> v2:172.21.15.169:3300/0 conn(0x7f450815ab40 0x7f450815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:02.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.322+0000 7f45077fe700 1 --2- 172.21.15.16:0/1607024186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f450815a770 0x7f45080ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:02.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.322+0000 7f4507fff700 1 -- 172.21.15.16:0/1607024186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f450815a770 msgr2=0x7f45080ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:02.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.322+0000 7f4507fff700 1 --2- 172.21.15.16:0/1607024186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f450815a770 0x7f45080ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.322+0000 7f4507fff700 1 -- 172.21.15.16:0/1607024186 >> v2:172.21.15.169:3300/0 conn(0x7f450815ab40 msgr2=0x7f450815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:02.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.322+0000 7f4507fff700 1 --2- 172.21.15.16:0/1607024186 >> v2:172.21.15.169:3300/0 conn(0x7f450815ab40 0x7f450815afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.322+0000 7f4507fff700 1 -- 172.21.15.16:0/1607024186 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508070ee0 con 0x7f45080cad20 2023-06-08T04:03:02.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.322+0000 7f4507fff700 1 --2- 172.21.15.16:0/1607024186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45080cad20 0x7f45080cb160 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4508066990 tx=0x7f450000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344479ed26303e6b server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:02.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f45067fc700 1 -- 172.21.15.16:0/1607024186 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450000e070 con 0x7f45080cad20 2023-06-08T04:03:02.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f45067fc700 1 -- 172.21.15.16:0/1607024186 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450000b910 con 0x7f45080cad20 2023-06-08T04:03:02.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f45067fc700 1 -- 172.21.15.16:0/1607024186 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450000bcc0 con 0x7f45080cad20 2023-06-08T04:03:02.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f450e1ff700 1 -- 172.21.15.16:0/1607024186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45080cad20 msgr2=0x7f45080cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:02.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f450e1ff700 1 --2- 172.21.15.16:0/1607024186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45080cad20 0x7f45080cb160 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4508066990 tx=0x7f450000b330 comp rx=0 tx=0).stop 2023-06-08T04:03:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f450e1ff700 1 -- 172.21.15.16:0/1607024186 shutdown_connections 2023-06-08T04:03:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f450e1ff700 1 --2- 172.21.15.16:0/1607024186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45080cad20 0x7f45080cb160 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f450e1ff700 1 --2- 172.21.15.16:0/1607024186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f450815a770 0x7f45080ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f450e1ff700 1 --2- 172.21.15.16:0/1607024186 >> v2:172.21.15.169:3300/0 conn(0x7f450815ab40 0x7f450815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f450e1ff700 1 -- 172.21.15.16:0/1607024186 >> 172.21.15.16:0/1607024186 conn(0x7f450806aa40 msgr2=0x7f45080b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f450e1ff700 1 -- 172.21.15.16:0/1607024186 shutdown_connections 2023-06-08T04:03:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.323+0000 7f450e1ff700 1 -- 172.21.15.16:0/1607024186 wait complete. 2023-06-08T04:03:02.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.326+0000 7f450e1ff700 1 Processor -- start 2023-06-08T04:03:02.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.326+0000 7f450e1ff700 1 -- start start 2023-06-08T04:03:02.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.327+0000 7f450e1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45080cad20 0x7f45080c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:02.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.327+0000 7f450e1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f450815a770 0x7f45081591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:02.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.327+0000 7f450e1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f450815ab40 0x7f45081596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:02.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.327+0000 7f450e1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080c2c10 con 0x7f45080cad20 2023-06-08T04:03:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.327+0000 7f450e1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080b3e00 con 0x7f450815a770 2023-06-08T04:03:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.327+0000 7f450e1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45080b40e0 con 0x7f450815ab40 2023-06-08T04:03:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.327+0000 7f45077fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45080cad20 0x7f45080c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.327+0000 7f45077fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45080cad20 0x7f45080c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53488/0 (socket says 172.21.15.16:53488) 2023-06-08T04:03:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.327+0000 7f45077fe700 1 -- 172.21.15.16:0/3325386487 learned_addr learned my addr 172.21.15.16:0/3325386487 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f4506ffd700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f450815a770 0x7f45081591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f4507fff700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f450815ab40 0x7f45081596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:02.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f45077fe700 1 -- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f450815ab40 msgr2=0x7f45081596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f45077fe700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f450815ab40 0x7f45081596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f45077fe700 1 -- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f450815a770 msgr2=0x7f45081591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f45077fe700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f450815a770 0x7f45081591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f45077fe700 1 -- 172.21.15.16:0/3325386487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4500009b30 con 0x7f45080cad20 2023-06-08T04:03:02.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f45077fe700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45080cad20 0x7f45080c4a50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e930 tx=0x7f44f800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:02.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f44effff700 1 -- 172.21.15.16:0/3325386487 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8013680 con 0x7f45080cad20 2023-06-08T04:03:02.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f44effff700 1 -- 172.21.15.16:0/3325386487 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f80137e0 con 0x7f45080cad20 2023-06-08T04:03:02.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f44effff700 1 -- 172.21.15.16:0/3325386487 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8013b70 con 0x7f45080cad20 2023-06-08T04:03:02.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.328+0000 7f450e1ff700 1 -- 172.21.15.16:0/3325386487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45080b43c0 con 0x7f45080cad20 2023-06-08T04:03:02.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.329+0000 7f450e1ff700 1 -- 172.21.15.16:0/3325386487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45080c4f90 con 0x7f45080cad20 2023-06-08T04:03:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.330+0000 7f450e1ff700 1 -- 172.21.15.16:0/3325386487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45080ca790 con 0x7f45080cad20 2023-06-08T04:03:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.331+0000 7f44effff700 1 -- 172.21.15.16:0/3325386487 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f44f8013cd0 con 0x7f45080cad20 2023-06-08T04:03:02.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.332+0000 7f44effff700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f44f406ace0 0x7f44f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.332+0000 7f44effff700 1 -- 172.21.15.16:0/3325386487 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f44f80890b0 con 0x7f45080cad20 2023-06-08T04:03:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.332+0000 7f4506ffd700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f44f406ace0 0x7f44f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:02.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.333+0000 7f4506ffd700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f44f406ace0 0x7f44f406d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4508159e30 tx=0x7f44fc009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:02.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.336+0000 7f44effff700 1 -- 172.21.15.16:0/3325386487 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f44f8054470 con 0x7f45080cad20 2023-06-08T04:03:02.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:02.564+0000 7f450e1ff700 1 -- 172.21.15.16:0/3325386487 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f45080740e0 con 0x7f45080cad20 2023-06-08T04:03:03.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.284+0000 7f44effff700 1 -- 172.21.15.16:0/3325386487 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f44f8057a90 con 0x7f45080cad20 2023-06-08T04:03:03.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 -- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f44f406ace0 msgr2=0x7f44f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:03.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f44f406ace0 0x7f44f406d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4508159e30 tx=0x7f44fc009210 comp rx=0 tx=0).stop 2023-06-08T04:03:03.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 -- 172.21.15.16:0/3325386487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45080cad20 msgr2=0x7f45080c4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:03.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45080cad20 0x7f45080c4a50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e930 tx=0x7f44f800ec40 comp rx=0 tx=0).stop 2023-06-08T04:03:03.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 -- 172.21.15.16:0/3325386487 shutdown_connections 2023-06-08T04:03:03.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f44f406ace0 0x7f44f406d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f450815ab40 0x7f45081596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45080cad20 0x7f45080c4a50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 --2- 172.21.15.16:0/3325386487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f450815a770 0x7f45081591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 -- 172.21.15.16:0/3325386487 >> 172.21.15.16:0/3325386487 conn(0x7f450806aa40 msgr2=0x7f450815cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:03.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 -- 172.21.15.16:0/3325386487 shutdown_connections 2023-06-08T04:03:03.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.287+0000 7f450e1ff700 1 -- 172.21.15.16:0/3325386487 wait complete. 2023-06-08T04:03:03.294 INFO:teuthology.orchestra.run.smithi016.stderr: removed all blocklist entries 2023-06-08T04:03:03.311 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-08T04:03:03.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.511+0000 7f67193ff700 1 Processor -- start 2023-06-08T04:03:03.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.511+0000 7f67193ff700 1 -- start start 2023-06-08T04:03:03.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.512+0000 7f67193ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6714160a60 0x7f67140b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:03.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.512+0000 7f67193ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67140b4b50 0x7f67140d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:03.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.512+0000 7f67193ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67140d0800 con 0x7f67140b83f0 2023-06-08T04:03:03.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.512+0000 7f67193ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6714160ed0 con 0x7f6714160a60 2023-06-08T04:03:03.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.512+0000 7f67193ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67140b4fd0 con 0x7f67140b4b50 2023-06-08T04:03:03.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.513+0000 7f67127fc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6714160a60 0x7f67140b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:03.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.513+0000 7f6712ffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f67140b83f0 0x7f67140ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60090/0 (socket says 172.21.15.16:60090) 2023-06-08T04:03:03.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.513+0000 7f6712ffd700 1 -- 172.21.15.16:0/4104575068 learned_addr learned my addr 172.21.15.16:0/4104575068 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:03.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.513+0000 7f67137fe700 1 --2- 172.21.15.16:0/4104575068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67140b4b50 0x7f67140d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:03.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.513+0000 7f67127fc700 1 -- 172.21.15.16:0/4104575068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67140b4b50 msgr2=0x7f67140d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:03.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.513+0000 7f67127fc700 1 --2- 172.21.15.16:0/4104575068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67140b4b50 0x7f67140d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.513+0000 7f67127fc700 1 -- 172.21.15.16:0/4104575068 >> v1:172.21.15.16:6789/0 conn(0x7f67140b83f0 legacy=0x7f67140ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:03.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.513+0000 7f67127fc700 1 -- 172.21.15.16:0/4104575068 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67140cd1e0 con 0x7f6714160a60 2023-06-08T04:03:03.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.513+0000 7f67137fe700 1 --2- 172.21.15.16:0/4104575068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67140b4b50 0x7f67140d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:03:03.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.513+0000 7f6711ffb700 1 -- 172.21.15.16:0/4104575068 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493047932 0 0) 0x7f67140d0800 con 0x7f67140b83f0 2023-06-08T04:03:03.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.513+0000 7f67127fc700 1 --2- 172.21.15.16:0/4104575068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6714160a60 0x7f67140b4610 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6708009840 tx=0x7f6708009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8832869ab97e4f68 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:03.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.514+0000 7f6711ffb700 1 -- 172.21.15.16:0/4104575068 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708011830 con 0x7f6714160a60 2023-06-08T04:03:03.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.514+0000 7f6711ffb700 1 -- 172.21.15.16:0/4104575068 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6708011990 con 0x7f6714160a60 2023-06-08T04:03:03.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.514+0000 7f6711ffb700 1 -- 172.21.15.16:0/4104575068 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708011d20 con 0x7f6714160a60 2023-06-08T04:03:03.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.514+0000 7f67193ff700 1 -- 172.21.15.16:0/4104575068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6714160a60 msgr2=0x7f67140b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:03.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.514+0000 7f67193ff700 1 --2- 172.21.15.16:0/4104575068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6714160a60 0x7f67140b4610 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6708009840 tx=0x7f6708009b50 comp rx=0 tx=0).stop 2023-06-08T04:03:03.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.514+0000 7f67193ff700 1 -- 172.21.15.16:0/4104575068 shutdown_connections 2023-06-08T04:03:03.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.514+0000 7f67193ff700 1 --2- 172.21.15.16:0/4104575068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67140b4b50 0x7f67140d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.514+0000 7f67193ff700 1 --2- 172.21.15.16:0/4104575068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6714160a60 0x7f67140b4610 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.514+0000 7f67193ff700 1 -- 172.21.15.16:0/4104575068 >> 172.21.15.16:0/4104575068 conn(0x7f67140cf610 msgr2=0x7f67140cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:03.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.514+0000 7f67193ff700 1 -- 172.21.15.16:0/4104575068 shutdown_connections 2023-06-08T04:03:03.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.515+0000 7f67193ff700 1 -- 172.21.15.16:0/4104575068 wait complete. 2023-06-08T04:03:03.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.516+0000 7f67193ff700 1 Processor -- start 2023-06-08T04:03:03.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.516+0000 7f67193ff700 1 -- start start 2023-06-08T04:03:03.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.517+0000 7f67193ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67140b4b50 0x7f67141591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:03.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.517+0000 7f67193ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67140b83f0 0x7f671415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:03.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.517+0000 7f67193ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6714160a60 0x7f6714149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:03.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.517+0000 7f67193ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671415f750 con 0x7f67140b4b50 2023-06-08T04:03:03.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.517+0000 7f67193ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671415f2c0 con 0x7f67140b83f0 2023-06-08T04:03:03.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.517+0000 7f67193ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671415e6b0 con 0x7f6714160a60 2023-06-08T04:03:03.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f6712ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67140b4b50 0x7f67141591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:03.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f6712ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67140b4b50 0x7f67141591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53502/0 (socket says 172.21.15.16:53502) 2023-06-08T04:03:03.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f6712ffd700 1 -- 172.21.15.16:0/1374722961 learned_addr learned my addr 172.21.15.16:0/1374722961 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:03.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f67137fe700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6714160a60 0x7f6714149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:03.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f67127fc700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67140b83f0 0x7f671415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:03.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f6712ffd700 1 -- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6714160a60 msgr2=0x7f6714149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:03.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f6712ffd700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6714160a60 0x7f6714149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f6712ffd700 1 -- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67140b83f0 msgr2=0x7f671415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:03.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f6712ffd700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67140b83f0 0x7f671415dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f6712ffd700 1 -- 172.21.15.16:0/1374722961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67080094a0 con 0x7f67140b4b50 2023-06-08T04:03:03.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f67137fe700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6714160a60 0x7f6714149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:03.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f6712ffd700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67140b4b50 0x7f67141591c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f67040011e0 tx=0x7f670400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:03.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.518+0000 7f66fb7fe700 1 -- 172.21.15.16:0/1374722961 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704004c80 con 0x7f67140b4b50 2023-06-08T04:03:03.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.519+0000 7f66fb7fe700 1 -- 172.21.15.16:0/1374722961 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6704004e00 con 0x7f67140b4b50 2023-06-08T04:03:03.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.519+0000 7f66fb7fe700 1 -- 172.21.15.16:0/1374722961 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704007310 con 0x7f67140b4b50 2023-06-08T04:03:03.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.519+0000 7f67193ff700 1 -- 172.21.15.16:0/1374722961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671415e990 con 0x7f67140b4b50 2023-06-08T04:03:03.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.519+0000 7f67193ff700 1 -- 172.21.15.16:0/1374722961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671415ef50 con 0x7f67140b4b50 2023-06-08T04:03:03.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.520+0000 7f67193ff700 1 -- 172.21.15.16:0/1374722961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67140740e0 con 0x7f67140b4b50 2023-06-08T04:03:03.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.521+0000 7f66fb7fe700 1 -- 172.21.15.16:0/1374722961 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6704007470 con 0x7f67140b4b50 2023-06-08T04:03:03.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.522+0000 7f66fb7fe700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f670006ace0 0x7f670006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:03.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.522+0000 7f66fb7fe700 1 -- 172.21.15.16:0/1374722961 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6704088f00 con 0x7f67140b4b50 2023-06-08T04:03:03.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.522+0000 7f67127fc700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f670006ace0 0x7f670006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:03.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.523+0000 7f67127fc700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f670006ace0 0x7f670006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f67080090b0 tx=0x7f670801c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:03.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.526+0000 7f66fb7fe700 1 -- 172.21.15.16:0/1374722961 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6704054300 con 0x7f67140b4b50 2023-06-08T04:03:03.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.812+0000 7f67193ff700 1 -- 172.21.15.16:0/1374722961 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f671415c4a0 con 0x7f67140b4b50 2023-06-08T04:03:03.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.813+0000 7f66fb7fe700 1 -- 172.21.15.16:0/1374722961 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f6704057920 con 0x7f67140b4b50 2023-06-08T04:03:03.817 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:03.817 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-06-08T04:03:03.818 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_dump": [ 2023-06-08T04:03:03.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.818 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.a", 2023-06-08T04:03:03.818 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQB9UoFk35x4FRAADM+9NAHlIWB6yC8xc2MufA==", 2023-06-08T04:03:03.818 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.818 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-06-08T04:03:03.818 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2023-06-08T04:03:03.819 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2023-06-08T04:03:03.819 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.819 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.819 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.b", 2023-06-08T04:03:03.819 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQB9UoFka5EMLRAAis+gRoT5X158f9dzcJ2n+Q==", 2023-06-08T04:03:03.820 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.820 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-06-08T04:03:03.820 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2023-06-08T04:03:03.820 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2023-06-08T04:03:03.820 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.821 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.c", 2023-06-08T04:03:03.821 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQB9UoFkMT5FIRAAmK/HZz71T1PyRVHxIJE0uA==", 2023-06-08T04:03:03.821 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.821 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-06-08T04:03:03.821 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2023-06-08T04:03:03.821 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2023-06-08T04:03:03.821 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.822 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.822 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.d", 2023-06-08T04:03:03.822 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQB9UoFkcOd9ORAABquSPz25IwncZWTuoHFEXw==", 2023-06-08T04:03:03.822 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.822 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-06-08T04:03:03.822 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2023-06-08T04:03:03.823 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2023-06-08T04:03:03.823 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.823 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.0", 2023-06-08T04:03:03.823 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCAUoFk85JUBBAAjT5ZwyE5pVcWq1NsJ4CTBg==", 2023-06-08T04:03:03.824 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.824 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-06-08T04:03:03.824 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-06-08T04:03:03.824 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.824 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.824 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.1", 2023-06-08T04:03:03.825 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCDUoFkLb1CCBAAMsI8UtsSaoHk6Epg7pxVyg==", 2023-06-08T04:03:03.825 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.825 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-06-08T04:03:03.825 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-06-08T04:03:03.825 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.825 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.826 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.2", 2023-06-08T04:03:03.826 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCGUoFk7BHDCxAACkZ3mKgDf8/NXjtQ+C1bOw==", 2023-06-08T04:03:03.826 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.826 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-06-08T04:03:03.826 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-06-08T04:03:03.826 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.826 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.827 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.3", 2023-06-08T04:03:03.827 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCJUoFknGW+DxAAAmly8wC6ktsCfU4On25oXA==", 2023-06-08T04:03:03.827 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.827 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-06-08T04:03:03.827 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-06-08T04:03:03.827 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.828 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.4", 2023-06-08T04:03:03.828 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCPUoFkDjhCJxAAag2QnOpmumBfwNqWkICQbA==", 2023-06-08T04:03:03.828 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.828 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-06-08T04:03:03.829 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-06-08T04:03:03.829 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.829 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.829 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.5", 2023-06-08T04:03:03.829 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCSUoFkhs4BKxAAY5yxYPQFhhFpv6PD1TgKsQ==", 2023-06-08T04:03:03.829 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.830 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-06-08T04:03:03.830 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-06-08T04:03:03.830 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.830 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.830 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.6", 2023-06-08T04:03:03.830 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCVUoFko6KKLhAA5e2w6DXK2lv9Ro5mZI/K/A==", 2023-06-08T04:03:03.831 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.831 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-06-08T04:03:03.831 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-06-08T04:03:03.831 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.831 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.7", 2023-06-08T04:03:03.832 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCYUoFkvWoUMhAA2t5ZZbwfreUvDUAD6bmSvQ==", 2023-06-08T04:03:03.832 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.832 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-06-08T04:03:03.832 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-06-08T04:03:03.832 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.832 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.833 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.0", 2023-06-08T04:03:03.833 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQB+UoFkoqYXCBAAaLt8J54zlTht4qHSpScWBA==", 2023-06-08T04:03:03.833 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.833 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-06-08T04:03:03.833 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2023-06-08T04:03:03.833 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2023-06-08T04:03:03.833 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2023-06-08T04:03:03.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.834 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.1", 2023-06-08T04:03:03.834 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQB+UoFkou81FxAA0R9U4YtDkeyOC5svIlMpiA==", 2023-06-08T04:03:03.834 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.834 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-06-08T04:03:03.834 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2023-06-08T04:03:03.835 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2023-06-08T04:03:03.835 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2023-06-08T04:03:03.835 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.835 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.2", 2023-06-08T04:03:03.835 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQB+UoFkNOanDxAA6H6DKiFvdXfY0ffLCqdG0w==", 2023-06-08T04:03:03.835 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.836 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-06-08T04:03:03.836 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2023-06-08T04:03:03.836 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2023-06-08T04:03:03.836 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2023-06-08T04:03:03.836 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.837 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.3", 2023-06-08T04:03:03.837 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQB+UoFky7SvHhAAL7xdohdCN5+GZnfedDkRrg==", 2023-06-08T04:03:03.837 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.837 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-06-08T04:03:03.837 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2023-06-08T04:03:03.837 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2023-06-08T04:03:03.837 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2023-06-08T04:03:03.838 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.838 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.admin", 2023-06-08T04:03:03.838 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ==", 2023-06-08T04:03:03.838 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.838 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2023-06-08T04:03:03.838 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2023-06-08T04:03:03.839 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2023-06-08T04:03:03.839 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.839 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.839 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-mds", 2023-06-08T04:03:03.839 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCgUoFkFHPNMRAApo+Ppdt3xAduk9pznkDiPw==", 2023-06-08T04:03:03.839 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.840 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-mds" 2023-06-08T04:03:03.840 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.840 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-mgr", 2023-06-08T04:03:03.840 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCgUoFkcH7NMRAAwdfLPr98CYK9EUVxW9+g2w==", 2023-06-08T04:03:03.840 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.841 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-08T04:03:03.841 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.841 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-osd", 2023-06-08T04:03:03.841 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCgUoFk/obNMRAACx4RdSC08swbM8pa3jBrKg==", 2023-06-08T04:03:03.841 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.841 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-osd" 2023-06-08T04:03:03.842 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.842 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rbd", 2023-06-08T04:03:03.842 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCgUoFkhI/NMRAAo92dZg670PIxkYwQW0q55w==", 2023-06-08T04:03:03.842 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.842 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-08T04:03:03.842 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.843 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-08T04:03:03.843 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCgUoFk95fNMRAAn5sFvQKcL9EmNvVijqzisw==", 2023-06-08T04:03:03.843 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.843 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-08T04:03:03.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.844 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rgw", 2023-06-08T04:03:03.844 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCgUoFk0qDNMRAAIhZLZ+ZBI5iWgvgoj1+kPw==", 2023-06-08T04:03:03.844 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.844 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-08T04:03:03.844 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.845 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mgr.x", 2023-06-08T04:03:03.845 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQB9UoFkhdWxDRAACS83UVzst6A1mML+eax1ZQ==", 2023-06-08T04:03:03.845 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.845 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2023-06-08T04:03:03.845 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile mgr", 2023-06-08T04:03:03.845 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:03.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:03.846 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mgr.y", 2023-06-08T04:03:03.846 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQB9UoFkucAwBRAA2dmEcdR4fMYm2R1mSLYNOA==", 2023-06-08T04:03:03.846 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-06-08T04:03:03.846 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2023-06-08T04:03:03.846 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile mgr", 2023-06-08T04:03:03.847 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-06-08T04:03:03.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:03.847 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2023-06-08T04:03:03.847 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-06-08T04:03:03.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.815+0000 7f67193ff700 1 -- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f670006ace0 msgr2=0x7f670006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:03.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.815+0000 7f67193ff700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f670006ace0 0x7f670006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f67080090b0 tx=0x7f670801c040 comp rx=0 tx=0).stop 2023-06-08T04:03:03.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.815+0000 7f67193ff700 1 -- 172.21.15.16:0/1374722961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67140b4b50 msgr2=0x7f67141591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:03.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.815+0000 7f67193ff700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67140b4b50 0x7f67141591c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f67040011e0 tx=0x7f670400cae0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.815+0000 7f67193ff700 1 -- 172.21.15.16:0/1374722961 shutdown_connections 2023-06-08T04:03:03.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.815+0000 7f67193ff700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f670006ace0 0x7f670006d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.815+0000 7f67193ff700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6714160a60 0x7f6714149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.815+0000 7f67193ff700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67140b4b50 0x7f67141591c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.815+0000 7f67193ff700 1 --2- 172.21.15.16:0/1374722961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67140b83f0 0x7f671415dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:03.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.815+0000 7f67193ff700 1 -- 172.21.15.16:0/1374722961 >> 172.21.15.16:0/1374722961 conn(0x7f67140cf610 msgr2=0x7f67140b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:03.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.816+0000 7f67193ff700 1 -- 172.21.15.16:0/1374722961 shutdown_connections 2023-06-08T04:03:03.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:03.816+0000 7f67193ff700 1 -- 172.21.15.16:0/1374722961 wait complete. 2023-06-08T04:03:03.850 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-08T04:03:04.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.049+0000 7f04eb9ff700 1 Processor -- start 2023-06-08T04:03:04.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.050+0000 7f04eb9ff700 1 -- start start 2023-06-08T04:03:04.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.051+0000 7f04eb9ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04e40b83f0 0x7f04e4160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:04.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.051+0000 7f04eb9ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f04e40ced40 0x7f04e40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:04.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.051+0000 7f04eb9ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e40d0800 con 0x7f04e40b4b50 2023-06-08T04:03:04.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.051+0000 7f04eb9ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e40b4fd0 con 0x7f04e40ced40 2023-06-08T04:03:04.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.051+0000 7f04eb9ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e40cd1e0 con 0x7f04e40b83f0 2023-06-08T04:03:04.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.051+0000 7f04e8f9a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f04e40ced40 0x7f04e40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:04.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.051+0000 7f04e979b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04e40b83f0 0x7f04e4160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:04.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.051+0000 7f04e9f9c700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f04e40b4b50 0x7f04e406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:56204/0 (socket says 172.21.15.16:56204) 2023-06-08T04:03:04.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.051+0000 7f04e9f9c700 1 -- 172.21.15.16:0/3732488891 learned_addr learned my addr 172.21.15.16:0/3732488891 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:04.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.052+0000 7f04dbfff700 1 -- 172.21.15.16:0/3732488891 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268284923 0 0) 0x7f04e40d0800 con 0x7f04e40b4b50 2023-06-08T04:03:04.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.052+0000 7f04dbfff700 1 -- 172.21.15.16:0/3732488891 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d00035b0 con 0x7f04e40b4b50 2023-06-08T04:03:04.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.052+0000 7f04e8f9a700 1 -- 172.21.15.16:0/3732488891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04e40b83f0 msgr2=0x7f04e4160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:04.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.052+0000 7f04e8f9a700 1 --2- 172.21.15.16:0/3732488891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04e40b83f0 0x7f04e4160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.052+0000 7f04e8f9a700 1 -- 172.21.15.16:0/3732488891 >> v1:172.21.15.169:6789/0 conn(0x7f04e40b4b50 legacy=0x7f04e406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.052+0000 7f04e8f9a700 1 -- 172.21.15.16:0/3732488891 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e40cd4c0 con 0x7f04e40ced40 2023-06-08T04:03:04.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.052+0000 7f04e979b700 1 --2- 172.21.15.16:0/3732488891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04e40b83f0 0x7f04e4160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:03:04.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.052+0000 7f04e8f9a700 1 --2- 172.21.15.16:0/3732488891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04e40ced40 0x7f04e40b4610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009840 tx=0x7f04d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7613894e20ea1a5 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:04.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.053+0000 7f04dbfff700 1 -- 172.21.15.16:0/3732488891 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4011830 con 0x7f04e40ced40 2023-06-08T04:03:04.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.053+0000 7f04dbfff700 1 -- 172.21.15.16:0/3732488891 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d4011990 con 0x7f04e40ced40 2023-06-08T04:03:04.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.053+0000 7f04dbfff700 1 -- 172.21.15.16:0/3732488891 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4011d20 con 0x7f04e40ced40 2023-06-08T04:03:04.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.053+0000 7f04eb9ff700 1 -- 172.21.15.16:0/3732488891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04e40ced40 msgr2=0x7f04e40b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.053+0000 7f04eb9ff700 1 --2- 172.21.15.16:0/3732488891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04e40ced40 0x7f04e40b4610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009840 tx=0x7f04d4009b50 comp rx=0 tx=0).stop 2023-06-08T04:03:04.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.053+0000 7f04eb9ff700 1 -- 172.21.15.16:0/3732488891 shutdown_connections 2023-06-08T04:03:04.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.053+0000 7f04eb9ff700 1 --2- 172.21.15.16:0/3732488891 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04e40b83f0 0x7f04e4160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.053+0000 7f04eb9ff700 1 --2- 172.21.15.16:0/3732488891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04e40ced40 0x7f04e40b4610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.053+0000 7f04eb9ff700 1 -- 172.21.15.16:0/3732488891 >> 172.21.15.16:0/3732488891 conn(0x7f04e40cf610 msgr2=0x7f04e40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:04.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.053+0000 7f04eb9ff700 1 -- 172.21.15.16:0/3732488891 shutdown_connections 2023-06-08T04:03:04.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.053+0000 7f04eb9ff700 1 -- 172.21.15.16:0/3732488891 wait complete. 2023-06-08T04:03:04.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.055+0000 7f04eb9ff700 1 Processor -- start 2023-06-08T04:03:04.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.055+0000 7f04eb9ff700 1 -- start start 2023-06-08T04:03:04.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.056+0000 7f04eb9ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04e40b4b50 0x7f04e40c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:04.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.056+0000 7f04eb9ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04e40b83f0 0x7f04e4148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:04.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.056+0000 7f04eb9ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04e40ced40 0x7f04e4148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:04.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.056+0000 7f04eb9ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e4146780 con 0x7f04e40b4b50 2023-06-08T04:03:04.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.056+0000 7f04eb9ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e41e5fb0 con 0x7f04e40b83f0 2023-06-08T04:03:04.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.056+0000 7f04eb9ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e4149360 con 0x7f04e40ced40 2023-06-08T04:03:04.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.056+0000 7f04e979b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04e40b4b50 0x7f04e40c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:04.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.056+0000 7f04e979b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04e40b4b50 0x7f04e40c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53512/0 (socket says 172.21.15.16:53512) 2023-06-08T04:03:04.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.056+0000 7f04e979b700 1 -- 172.21.15.16:0/2444207144 learned_addr learned my addr 172.21.15.16:0/2444207144 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:04.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04e8f9a700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04e40b83f0 0x7f04e4148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:04.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04e979b700 1 -- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04e40ced40 msgr2=0x7f04e4148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04e979b700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04e40ced40 0x7f04e4148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04e979b700 1 -- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04e40b83f0 msgr2=0x7f04e4148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04e979b700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04e40b83f0 0x7f04e4148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04e979b700 1 -- 172.21.15.16:0/2444207144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e00094a0 con 0x7f04e40b4b50 2023-06-08T04:03:04.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04e979b700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04e40b4b50 0x7f04e40c8890 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f04e000ebe0 tx=0x7f04e0009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:04.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04d9ffb700 1 -- 172.21.15.16:0/2444207144 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000c910 con 0x7f04e40b4b50 2023-06-08T04:03:04.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04d9ffb700 1 -- 172.21.15.16:0/2444207144 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e000ca70 con 0x7f04e40b4b50 2023-06-08T04:03:04.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04eb9ff700 1 -- 172.21.15.16:0/2444207144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d40094a0 con 0x7f04e40b4b50 2023-06-08T04:03:04.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04d9ffb700 1 -- 172.21.15.16:0/2444207144 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000cde0 con 0x7f04e40b4b50 2023-06-08T04:03:04.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.057+0000 7f04eb9ff700 1 -- 172.21.15.16:0/2444207144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e4146a40 con 0x7f04e40b4b50 2023-06-08T04:03:04.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.058+0000 7f04eb9ff700 1 -- 172.21.15.16:0/2444207144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e40740e0 con 0x7f04e40b4b50 2023-06-08T04:03:04.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.059+0000 7f04d9ffb700 1 -- 172.21.15.16:0/2444207144 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f04e0013470 con 0x7f04e40b4b50 2023-06-08T04:03:04.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.060+0000 7f04d9ffb700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f04c806acb0 0x7f04c806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:04.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.061+0000 7f04d9ffb700 1 -- 172.21.15.16:0/2444207144 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f04e0089470 con 0x7f04e40b4b50 2023-06-08T04:03:04.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.061+0000 7f04e8f9a700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f04c806acb0 0x7f04c806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:04.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.062+0000 7f04e8f9a700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f04c806acb0 0x7f04c806d160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f04e415eb40 tx=0x7f04d4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:04.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.065+0000 7f04d9ffb700 1 -- 172.21.15.16:0/2444207144 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f04e00547d0 con 0x7f04e40b4b50 2023-06-08T04:03:04.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.363+0000 7f04eb9ff700 1 -- 172.21.15.16:0/2444207144 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f04e40b76b0 con 0x7f04e40b4b50 2023-06-08T04:03:04.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.368+0000 7f04d9ffb700 1 -- 172.21.15.16:0/2444207144 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f04e0057df0 con 0x7f04e40b4b50 2023-06-08T04:03:04.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 -- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f04c806acb0 msgr2=0x7f04c806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f04c806acb0 0x7f04c806d160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f04e415eb40 tx=0x7f04d4008030 comp rx=0 tx=0).stop 2023-06-08T04:03:04.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 -- 172.21.15.16:0/2444207144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04e40b4b50 msgr2=0x7f04e40c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04e40b4b50 0x7f04e40c8890 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f04e000ebe0 tx=0x7f04e0009ec0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 -- 172.21.15.16:0/2444207144 shutdown_connections 2023-06-08T04:03:04.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f04c806acb0 0x7f04c806d160 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04e40ced40 0x7f04e4148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04e40b4b50 0x7f04e40c8890 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 --2- 172.21.15.16:0/2444207144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f04e40b83f0 0x7f04e4148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 -- 172.21.15.16:0/2444207144 >> 172.21.15.16:0/2444207144 conn(0x7f04e40cf610 msgr2=0x7f04e40cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:04.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 -- 172.21.15.16:0/2444207144 shutdown_connections 2023-06-08T04:03:04.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.370+0000 7f04eb9ff700 1 -- 172.21.15.16:0/2444207144 wait complete. 2023-06-08T04:03:04.391 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-08T04:03:04.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.589+0000 7f06d39ff700 1 Processor -- start 2023-06-08T04:03:04.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.589+0000 7f06d39ff700 1 -- start start 2023-06-08T04:03:04.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.590+0000 7f06d39ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f06cc15a770 0x7f06cc0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:04.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.590+0000 7f06d39ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06cc070c90 con 0x7f06cc161d10 2023-06-08T04:03:04.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.590+0000 7f06d39ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06cc0c9110 con 0x7f06cc15ab40 2023-06-08T04:03:04.594 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.590+0000 7f06d39ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06cc0ce620 con 0x7f06cc15a770 2023-06-08T04:03:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.590+0000 7f06d179b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f06cc15a770 0x7f06cc0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.590+0000 7f06d179b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f06cc15a770 0x7f06cc0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53514/0 (socket says 172.21.15.16:53514) 2023-06-08T04:03:04.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.590+0000 7f06d179b700 1 -- 172.21.15.16:0/619324928 learned_addr learned my addr 172.21.15.16:0/619324928 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:04.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.590+0000 7f06d1f9c700 1 --1- 172.21.15.16:0/619324928 >> v1:172.21.15.16:6789/0 conn(0x7f06cc161d10 0x7f06cc1640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60106/0 (socket says 172.21.15.16:60106) 2023-06-08T04:03:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.591+0000 7f06d179b700 1 -- 172.21.15.16:0/619324928 >> v1:172.21.15.169:6789/0 conn(0x7f06cc15ab40 legacy=0x7f06cc15afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.591+0000 7f06d179b700 1 -- 172.21.15.16:0/619324928 >> v1:172.21.15.16:6789/0 conn(0x7f06cc161d10 legacy=0x7f06cc1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.591+0000 7f06d179b700 1 -- 172.21.15.16:0/619324928 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc070ee0 con 0x7f06cc15a770 2023-06-08T04:03:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.591+0000 7f06d179b700 1 --2- 172.21.15.16:0/619324928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc15a770 0x7f06cc0ce0e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f06c80098f0 tx=0x7f06c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5f72bdb74f2419 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:04.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.591+0000 7f06c3fff700 1 -- 172.21.15.16:0/619324928 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c800b8a0 con 0x7f06cc15a770 2023-06-08T04:03:04.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.591+0000 7f06c3fff700 1 -- 172.21.15.16:0/619324928 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c800ba00 con 0x7f06cc15a770 2023-06-08T04:03:04.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.591+0000 7f06c3fff700 1 -- 172.21.15.16:0/619324928 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c800bd90 con 0x7f06cc15a770 2023-06-08T04:03:04.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.592+0000 7f06d39ff700 1 -- 172.21.15.16:0/619324928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc15a770 msgr2=0x7f06cc0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.592+0000 7f06d39ff700 1 --2- 172.21.15.16:0/619324928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc15a770 0x7f06cc0ce0e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f06c80098f0 tx=0x7f06c8009c00 comp rx=0 tx=0).stop 2023-06-08T04:03:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.592+0000 7f06d39ff700 1 -- 172.21.15.16:0/619324928 shutdown_connections 2023-06-08T04:03:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.592+0000 7f06d39ff700 1 --2- 172.21.15.16:0/619324928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc15a770 0x7f06cc0ce0e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.592+0000 7f06d39ff700 1 -- 172.21.15.16:0/619324928 >> 172.21.15.16:0/619324928 conn(0x7f06cc06aa40 msgr2=0x7f06cc0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:04.600 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.592+0000 7f06d39ff700 1 -- 172.21.15.16:0/619324928 shutdown_connections 2023-06-08T04:03:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.592+0000 7f06d39ff700 1 -- 172.21.15.16:0/619324928 wait complete. 2023-06-08T04:03:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.594+0000 7f06d39ff700 1 Processor -- start 2023-06-08T04:03:04.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.594+0000 7f06d39ff700 1 -- start start 2023-06-08T04:03:04.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d39ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06cc15a770 0x7f06cc14e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:04.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d39ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc15ab40 0x7f06cc15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d39ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f06cc161d10 0x7f06cc15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d39ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc0b1770 con 0x7f06cc15ab40 2023-06-08T04:03:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d39ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc1f38a0 con 0x7f06cc15a770 2023-06-08T04:03:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d39ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc14f2c0 con 0x7f06cc161d10 2023-06-08T04:03:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d0f9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc15ab40 0x7f06cc15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d0f9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc15ab40 0x7f06cc15c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53526/0 (socket says 172.21.15.16:53526) 2023-06-08T04:03:04.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d0f9a700 1 -- 172.21.15.16:0/1338694575 learned_addr learned my addr 172.21.15.16:0/1338694575 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:04.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d179b700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06cc15a770 0x7f06cc14e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:04.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d1f9c700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f06cc161d10 0x7f06cc15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:04.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d0f9a700 1 -- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f06cc161d10 msgr2=0x7f06cc15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d0f9a700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f06cc161d10 0x7f06cc15ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d0f9a700 1 -- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06cc15a770 msgr2=0x7f06cc14e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.595+0000 7f06d0f9a700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06cc15a770 0x7f06cc14e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.596+0000 7f06d0f9a700 1 -- 172.21.15.16:0/1338694575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c8009550 con 0x7f06cc15ab40 2023-06-08T04:03:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.596+0000 7f06d0f9a700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc15ab40 0x7f06cc15c8e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00c4e0 tx=0x7f06bc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.596+0000 7f06c1ffb700 1 -- 172.21.15.16:0/1338694575 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc0052d0 con 0x7f06cc15ab40 2023-06-08T04:03:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.596+0000 7f06c1ffb700 1 -- 172.21.15.16:0/1338694575 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc005430 con 0x7f06cc15ab40 2023-06-08T04:03:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.596+0000 7f06d39ff700 1 -- 172.21.15.16:0/1338694575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc14efe0 con 0x7f06cc15ab40 2023-06-08T04:03:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.596+0000 7f06c1ffb700 1 -- 172.21.15.16:0/1338694575 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc0038c0 con 0x7f06cc15ab40 2023-06-08T04:03:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.596+0000 7f06d39ff700 1 -- 172.21.15.16:0/1338694575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc1f3530 con 0x7f06cc15ab40 2023-06-08T04:03:04.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.597+0000 7f06d39ff700 1 -- 172.21.15.16:0/1338694575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06cc0740e0 con 0x7f06cc15ab40 2023-06-08T04:03:04.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.598+0000 7f06c1ffb700 1 -- 172.21.15.16:0/1338694575 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06bc003a20 con 0x7f06cc15ab40 2023-06-08T04:03:04.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.599+0000 7f06c1ffb700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f06b006ace0 0x7f06b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:04.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.599+0000 7f06c1ffb700 1 -- 172.21.15.16:0/1338694575 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f06bc088530 con 0x7f06cc15ab40 2023-06-08T04:03:04.606 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.600+0000 7f06d179b700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f06b006ace0 0x7f06b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:04.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.600+0000 7f06d179b700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f06b006ace0 0x7f06b006d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06c8014040 tx=0x7f06c8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:04.607 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.603+0000 7f06c1ffb700 1 -- 172.21.15.16:0/1338694575 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f06bc053890 con 0x7f06cc15ab40 2023-06-08T04:03:04.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.888+0000 7f06d39ff700 1 -- 172.21.15.16:0/1338694575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f06cc14e3e0 con 0x7f06cc15ab40 2023-06-08T04:03:04.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.892+0000 7f06c1ffb700 1 -- 172.21.15.16:0/1338694575 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f06bc056eb0 con 0x7f06cc15ab40 2023-06-08T04:03:04.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 -- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f06b006ace0 msgr2=0x7f06b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f06b006ace0 0x7f06b006d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06c8014040 tx=0x7f06c8008030 comp rx=0 tx=0).stop 2023-06-08T04:03:04.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 -- 172.21.15.16:0/1338694575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc15ab40 msgr2=0x7f06cc15c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:04.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc15ab40 0x7f06cc15c8e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00c4e0 tx=0x7f06bc00c7f0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 -- 172.21.15.16:0/1338694575 shutdown_connections 2023-06-08T04:03:04.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f06b006ace0 0x7f06b006d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f06cc161d10 0x7f06cc15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06cc15a770 0x7f06cc14e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 --2- 172.21.15.16:0/1338694575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06cc15ab40 0x7f06cc15c8e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:04.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 -- 172.21.15.16:0/1338694575 >> 172.21.15.16:0/1338694575 conn(0x7f06cc06aa40 msgr2=0x7f06cc14feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:04.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 -- 172.21.15.16:0/1338694575 shutdown_connections 2023-06-08T04:03:04.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:04.894+0000 7f06d39ff700 1 -- 172.21.15.16:0/1338694575 wait complete. 2023-06-08T04:03:04.916 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-08T04:03:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.115+0000 7f952c9ff700 1 Processor -- start 2023-06-08T04:03:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.115+0000 7f952c9ff700 1 -- start start 2023-06-08T04:03:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.116+0000 7f952c9ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f95280b83f0 0x7f9528160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.116+0000 7f952c9ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f95280ced40 0x7f95280b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.116+0000 7f952c9ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95280d0800 con 0x7f95280b4b50 2023-06-08T04:03:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.116+0000 7f952c9ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95280b4fd0 con 0x7f95280ced40 2023-06-08T04:03:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.116+0000 7f952c9ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95280cd1e0 con 0x7f95280b83f0 2023-06-08T04:03:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.116+0000 7f9525d9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f95280ced40 0x7f95280b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.117+0000 7f9525d9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f95280ced40 0x7f95280b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53536/0 (socket says 172.21.15.16:53536) 2023-06-08T04:03:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.117+0000 7f9525d9b700 1 -- 172.21.15.16:0/927543248 learned_addr learned my addr 172.21.15.16:0/927543248 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:05.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.117+0000 7f952659c700 1 --2- 172.21.15.16:0/927543248 >> v2:172.21.15.169:3300/0 conn(0x7f95280b83f0 0x7f9528160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.117+0000 7f9525d9b700 1 -- 172.21.15.16:0/927543248 >> v2:172.21.15.169:3300/0 conn(0x7f95280b83f0 msgr2=0x7f9528160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.117+0000 7f9525d9b700 1 --2- 172.21.15.16:0/927543248 >> v2:172.21.15.169:3300/0 conn(0x7f95280b83f0 0x7f9528160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.117+0000 7f9525d9b700 1 -- 172.21.15.16:0/927543248 >> v1:172.21.15.169:6789/0 conn(0x7f95280b4b50 legacy=0x7f952806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.117+0000 7f9525d9b700 1 -- 172.21.15.16:0/927543248 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280cd4c0 con 0x7f95280ced40 2023-06-08T04:03:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.117+0000 7f952659c700 1 --2- 172.21.15.16:0/927543248 >> v2:172.21.15.169:3300/0 conn(0x7f95280b83f0 0x7f9528160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:03:05.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.117+0000 7f9525d9b700 1 --2- 172.21.15.16:0/927543248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95280ced40 0x7f95280b4610 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f952806ca80 tx=0x7f951c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa25ef53187162b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.117+0000 7f952559a700 1 -- 172.21.15.16:0/927543248 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c004230 con 0x7f95280ced40 2023-06-08T04:03:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.118+0000 7f952559a700 1 -- 172.21.15.16:0/927543248 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c004390 con 0x7f95280ced40 2023-06-08T04:03:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.118+0000 7f952559a700 1 -- 172.21.15.16:0/927543248 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0036a0 con 0x7f95280ced40 2023-06-08T04:03:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.118+0000 7f952c9ff700 1 -- 172.21.15.16:0/927543248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95280ced40 msgr2=0x7f95280b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.118+0000 7f952c9ff700 1 --2- 172.21.15.16:0/927543248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95280ced40 0x7f95280b4610 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f952806ca80 tx=0x7f951c009bd0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.118+0000 7f952c9ff700 1 -- 172.21.15.16:0/927543248 shutdown_connections 2023-06-08T04:03:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.118+0000 7f952c9ff700 1 --2- 172.21.15.16:0/927543248 >> v2:172.21.15.169:3300/0 conn(0x7f95280b83f0 0x7f9528160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.118+0000 7f952c9ff700 1 --2- 172.21.15.16:0/927543248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95280ced40 0x7f95280b4610 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.118+0000 7f952c9ff700 1 -- 172.21.15.16:0/927543248 >> 172.21.15.16:0/927543248 conn(0x7f95280cf610 msgr2=0x7f95280cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:05.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.118+0000 7f952c9ff700 1 -- 172.21.15.16:0/927543248 shutdown_connections 2023-06-08T04:03:05.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.118+0000 7f952c9ff700 1 -- 172.21.15.16:0/927543248 wait complete. 2023-06-08T04:03:05.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.120+0000 7f952c9ff700 1 Processor -- start 2023-06-08T04:03:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.120+0000 7f952c9ff700 1 -- start start 2023-06-08T04:03:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.121+0000 7f952c9ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95280b4b50 0x7f9528153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.121+0000 7f952c9ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95280b83f0 0x7f9528154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.121+0000 7f952c9ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95280ced40 0x7f95281579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.121+0000 7f952c9ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9528155330 con 0x7f95280b4b50 2023-06-08T04:03:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.121+0000 7f952c9ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95281e5e40 con 0x7f95280ced40 2023-06-08T04:03:05.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.121+0000 7f952c9ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95281e6120 con 0x7f95280b83f0 2023-06-08T04:03:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.121+0000 7f952659c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95280b4b50 0x7f9528153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.121+0000 7f952659c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95280b4b50 0x7f9528153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53550/0 (socket says 172.21.15.16:53550) 2023-06-08T04:03:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.121+0000 7f952659c700 1 -- 172.21.15.16:0/1048082927 learned_addr learned my addr 172.21.15.16:0/1048082927 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f9526d9d700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95280ced40 0x7f95281579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f952659c700 1 -- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95280b83f0 msgr2=0x7f9528154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f952659c700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95280b83f0 0x7f9528154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f952659c700 1 -- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95280ced40 msgr2=0x7f95281579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f952659c700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95280ced40 0x7f95281579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f952659c700 1 -- 172.21.15.16:0/1048082927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c009550 con 0x7f95280b4b50 2023-06-08T04:03:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f9526d9d700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95280ced40 0x7f95281579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:03:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f952659c700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95280b4b50 0x7f9528153fd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f951800c750 tx=0x7f951800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f9516ffd700 1 -- 172.21.15.16:0/1048082927 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518011800 con 0x7f95280b4b50 2023-06-08T04:03:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f9516ffd700 1 -- 172.21.15.16:0/1048082927 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518011960 con 0x7f95280b4b50 2023-06-08T04:03:05.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f952c9ff700 1 -- 172.21.15.16:0/1048082927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95281e6400 con 0x7f95280b4b50 2023-06-08T04:03:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.122+0000 7f9516ffd700 1 -- 172.21.15.16:0/1048082927 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518011cd0 con 0x7f95280b4b50 2023-06-08T04:03:05.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.123+0000 7f952c9ff700 1 -- 172.21.15.16:0/1048082927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95281e69c0 con 0x7f95280b4b50 2023-06-08T04:03:05.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.124+0000 7f952c9ff700 1 -- 172.21.15.16:0/1048082927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95280cf1b0 con 0x7f95280b4b50 2023-06-08T04:03:05.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.124+0000 7f9516ffd700 1 -- 172.21.15.16:0/1048082927 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9518021350 con 0x7f95280b4b50 2023-06-08T04:03:05.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.125+0000 7f9516ffd700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f950806ace0 0x7f950806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.125+0000 7f9516ffd700 1 -- 172.21.15.16:0/1048082927 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9518089090 con 0x7f95280b4b50 2023-06-08T04:03:05.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.126+0000 7f9525d9b700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f950806ace0 0x7f950806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:05.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.127+0000 7f9525d9b700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f950806ace0 0x7f950806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f952815e360 tx=0x7f951c010000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:05.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.130+0000 7f9516ffd700 1 -- 172.21.15.16:0/1048082927 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9518057fb0 con 0x7f95280b4b50 2023-06-08T04:03:05.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.418+0000 7f952c9ff700 1 -- 172.21.15.16:0/1048082927 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f95280740e0 con 0x7f95280b4b50 2023-06-08T04:03:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.422+0000 7f9516ffd700 1 -- 172.21.15.16:0/1048082927 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9518057b40 con 0x7f95280b4b50 2023-06-08T04:03:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 -- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f950806ace0 msgr2=0x7f950806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f950806ace0 0x7f950806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f952815e360 tx=0x7f951c010000 comp rx=0 tx=0).stop 2023-06-08T04:03:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 -- 172.21.15.16:0/1048082927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95280b4b50 msgr2=0x7f9528153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95280b4b50 0x7f9528153fd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f951800c750 tx=0x7f951800cb10 comp rx=0 tx=0).stop 2023-06-08T04:03:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 -- 172.21.15.16:0/1048082927 shutdown_connections 2023-06-08T04:03:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f950806ace0 0x7f950806d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95280ced40 0x7f95281579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95280b4b50 0x7f9528153fd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 --2- 172.21.15.16:0/1048082927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95280b83f0 0x7f9528154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 -- 172.21.15.16:0/1048082927 >> 172.21.15.16:0/1048082927 conn(0x7f95280cf610 msgr2=0x7f95280d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:05.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 -- 172.21.15.16:0/1048082927 shutdown_connections 2023-06-08T04:03:05.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.425+0000 7f952c9ff700 1 -- 172.21.15.16:0/1048082927 wait complete. 2023-06-08T04:03:05.446 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-08T04:03:05.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.643+0000 7f54849ff700 1 Processor -- start 2023-06-08T04:03:05.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.644+0000 7f54849ff700 1 -- start start 2023-06-08T04:03:05.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.645+0000 7f54849ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f54800b83f0 0x7f5480160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.645+0000 7f54849ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f54800b4d20 0x7f54800d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.645+0000 7f54849ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54800d0800 con 0x7f54800ced40 2023-06-08T04:03:05.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.645+0000 7f54849ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54800cd1e0 con 0x7f54800b4d20 2023-06-08T04:03:05.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.645+0000 7f54849ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54800cd4c0 con 0x7f54800b83f0 2023-06-08T04:03:05.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.645+0000 7f5477fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f54800ced40 0x7f54800b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60108/0 (socket says 172.21.15.16:60108) 2023-06-08T04:03:05.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.645+0000 7f5477fff700 1 -- 172.21.15.16:0/1706817443 learned_addr learned my addr 172.21.15.16:0/1706817443 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:05.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.645+0000 7f547ed9d700 1 --2- 172.21.15.16:0/1706817443 >> v2:172.21.15.16:3300/0 conn(0x7f54800b4d20 0x7f54800d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:05.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.645+0000 7f547e59c700 1 --2- 172.21.15.16:0/1706817443 >> v2:172.21.15.169:3300/0 conn(0x7f54800b83f0 0x7f5480160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:05.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.646+0000 7f547dd9b700 1 -- 172.21.15.16:0/1706817443 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277169016 0 0) 0x7f54800d0800 con 0x7f54800ced40 2023-06-08T04:03:05.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.646+0000 7f547dd9b700 1 -- 172.21.15.16:0/1706817443 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f546c0035b0 con 0x7f54800ced40 2023-06-08T04:03:05.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.646+0000 7f547ed9d700 1 -- 172.21.15.16:0/1706817443 >> v2:172.21.15.169:3300/0 conn(0x7f54800b83f0 msgr2=0x7f5480160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:05.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.646+0000 7f547ed9d700 1 --2- 172.21.15.16:0/1706817443 >> v2:172.21.15.169:3300/0 conn(0x7f54800b83f0 0x7f5480160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.646+0000 7f547ed9d700 1 -- 172.21.15.16:0/1706817443 >> v1:172.21.15.16:6789/0 conn(0x7f54800ced40 legacy=0x7f54800b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:05.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.646+0000 7f547ed9d700 1 -- 172.21.15.16:0/1706817443 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54800d0aa0 con 0x7f54800b4d20 2023-06-08T04:03:05.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.646+0000 7f547ed9d700 1 --2- 172.21.15.16:0/1706817443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54800b4d20 0x7f54800d0fc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f548006ca80 tx=0x7f547800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c27a8f30eebdfd5 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:05.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.646+0000 7f547dd9b700 1 -- 172.21.15.16:0/1706817443 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547800e070 con 0x7f54800b4d20 2023-06-08T04:03:05.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.646+0000 7f547dd9b700 1 -- 172.21.15.16:0/1706817443 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547800bb20 con 0x7f54800b4d20 2023-06-08T04:03:05.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.646+0000 7f547dd9b700 1 -- 172.21.15.16:0/1706817443 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478012430 con 0x7f54800b4d20 2023-06-08T04:03:05.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.647+0000 7f54849ff700 1 -- 172.21.15.16:0/1706817443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54800b4d20 msgr2=0x7f54800d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:05.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.647+0000 7f54849ff700 1 --2- 172.21.15.16:0/1706817443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54800b4d20 0x7f54800d0fc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f548006ca80 tx=0x7f547800b330 comp rx=0 tx=0).stop 2023-06-08T04:03:05.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.647+0000 7f54849ff700 1 -- 172.21.15.16:0/1706817443 shutdown_connections 2023-06-08T04:03:05.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.647+0000 7f54849ff700 1 --2- 172.21.15.16:0/1706817443 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54800b4d20 0x7f54800d0fc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.647+0000 7f54849ff700 1 --2- 172.21.15.16:0/1706817443 >> v2:172.21.15.169:3300/0 conn(0x7f54800b83f0 0x7f5480160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.647+0000 7f54849ff700 1 -- 172.21.15.16:0/1706817443 >> 172.21.15.16:0/1706817443 conn(0x7f54800cf610 msgr2=0x7f54800cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:05.653 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.647+0000 7f54849ff700 1 -- 172.21.15.16:0/1706817443 shutdown_connections 2023-06-08T04:03:05.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.647+0000 7f54849ff700 1 -- 172.21.15.16:0/1706817443 wait complete. 2023-06-08T04:03:05.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.649+0000 7f54849ff700 1 Processor -- start 2023-06-08T04:03:05.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.649+0000 7f54849ff700 1 -- start start 2023-06-08T04:03:05.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.650+0000 7f54849ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54800b4d20 0x7f548015f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.650+0000 7f54849ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54800b83f0 0x7f54800ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.650+0000 7f54849ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54800ced40 0x7f54800cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.650+0000 7f54849ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54801f2df0 con 0x7f54800b4d20 2023-06-08T04:03:05.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.650+0000 7f54849ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54801f3040 con 0x7f54800ced40 2023-06-08T04:03:05.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.650+0000 7f54849ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54801f3320 con 0x7f54800b83f0 2023-06-08T04:03:05.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.650+0000 7f547e59c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54800b4d20 0x7f548015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:05.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.650+0000 7f547e59c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54800b4d20 0x7f548015f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53564/0 (socket says 172.21.15.16:53564) 2023-06-08T04:03:05.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.650+0000 7f547e59c700 1 -- 172.21.15.16:0/2317365654 learned_addr learned my addr 172.21.15.16:0/2317365654 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:05.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f547e59c700 1 -- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54800b83f0 msgr2=0x7f54800ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:05.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f547e59c700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54800b83f0 0x7f54800ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f547ed9d700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54800ced40 0x7f54800cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:05.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f547e59c700 1 -- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54800ced40 msgr2=0x7f54800cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:05.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f547e59c700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54800ced40 0x7f54800cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f547e59c700 1 -- 172.21.15.16:0/2317365654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5478009a70 con 0x7f54800b4d20 2023-06-08T04:03:05.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f547ed9d700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54800ced40 0x7f54800cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:03:05.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f547e59c700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54800b4d20 0x7f548015f520 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f547000e9b0 tx=0x7f547000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:05.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f5476ffd700 1 -- 172.21.15.16:0/2317365654 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470009710 con 0x7f54800b4d20 2023-06-08T04:03:05.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f5476ffd700 1 -- 172.21.15.16:0/2317365654 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547000c850 con 0x7f54800b4d20 2023-06-08T04:03:05.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f54849ff700 1 -- 172.21.15.16:0/2317365654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54801f3600 con 0x7f54800b4d20 2023-06-08T04:03:05.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f5476ffd700 1 -- 172.21.15.16:0/2317365654 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000cbc0 con 0x7f54800b4d20 2023-06-08T04:03:05.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.651+0000 7f54849ff700 1 -- 172.21.15.16:0/2317365654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54800c9f00 con 0x7f54800b4d20 2023-06-08T04:03:05.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.652+0000 7f54849ff700 1 -- 172.21.15.16:0/2317365654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54800740e0 con 0x7f54800b4d20 2023-06-08T04:03:05.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.653+0000 7f5476ffd700 1 -- 172.21.15.16:0/2317365654 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f547000cd20 con 0x7f54800b4d20 2023-06-08T04:03:05.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.654+0000 7f5476ffd700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f546006ace0 0x7f546006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:05.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.654+0000 7f5476ffd700 1 -- 172.21.15.16:0/2317365654 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5470089250 con 0x7f54800b4d20 2023-06-08T04:03:05.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.655+0000 7f5477fff700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f546006ace0 0x7f546006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:05.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.656+0000 7f5477fff700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f546006ace0 0x7f546006d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f54800b17a0 tx=0x7f54680079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:05.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.659+0000 7f5476ffd700 1 -- 172.21.15.16:0/2317365654 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f54700580d0 con 0x7f54800b4d20 2023-06-08T04:03:05.946 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.942+0000 7f54849ff700 1 -- 172.21.15.16:0/2317365654 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f5480073490 con 0x7f54800b4d20 2023-06-08T04:03:05.950 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.946+0000 7f5476ffd700 1 -- 172.21.15.16:0/2317365654 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5470057c60 con 0x7f54800b4d20 2023-06-08T04:03:05.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 -- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f546006ace0 msgr2=0x7f546006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:05.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f546006ace0 0x7f546006d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f54800b17a0 tx=0x7f54680079c0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 -- 172.21.15.16:0/2317365654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54800b4d20 msgr2=0x7f548015f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:05.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54800b4d20 0x7f548015f520 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f547000e9b0 tx=0x7f547000ed70 comp rx=0 tx=0).stop 2023-06-08T04:03:05.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 -- 172.21.15.16:0/2317365654 shutdown_connections 2023-06-08T04:03:05.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f546006ace0 0x7f546006d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54800ced40 0x7f54800cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54800b4d20 0x7f548015f520 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 --2- 172.21.15.16:0/2317365654 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54800b83f0 0x7f54800ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:05.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 -- 172.21.15.16:0/2317365654 >> 172.21.15.16:0/2317365654 conn(0x7f54800cf610 msgr2=0x7f548006b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:05.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 -- 172.21.15.16:0/2317365654 shutdown_connections 2023-06-08T04:03:05.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:05.949+0000 7f54849ff700 1 -- 172.21.15.16:0/2317365654 wait complete. 2023-06-08T04:03:05.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-08T04:03:06.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.169+0000 7f0b055ff700 1 Processor -- start 2023-06-08T04:03:06.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.169+0000 7f0b055ff700 1 -- start start 2023-06-08T04:03:06.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.170+0000 7f0b055ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0b00160a60 0x7f0b000b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:06.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.170+0000 7f0b055ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b000d0800 con 0x7f0b000b83f0 2023-06-08T04:03:06.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.170+0000 7f0b055ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b000cd1e0 con 0x7f0b000b4b50 2023-06-08T04:03:06.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.170+0000 7f0b055ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b00160ed0 con 0x7f0b00160a60 2023-06-08T04:03:06.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.170+0000 7f0afeffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0b000b83f0 0x7f0b000ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60124/0 (socket says 172.21.15.16:60124) 2023-06-08T04:03:06.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.170+0000 7f0afeffd700 1 -- 172.21.15.16:0/1286221083 learned_addr learned my addr 172.21.15.16:0/1286221083 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:06.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.171+0000 7f0afe7fc700 1 --2- 172.21.15.16:0/1286221083 >> v2:172.21.15.169:3300/0 conn(0x7f0b00160a60 0x7f0b000b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:06.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.171+0000 7f0afdffb700 1 -- 172.21.15.16:0/1286221083 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111615157 0 0) 0x7f0b000d0800 con 0x7f0b000b83f0 2023-06-08T04:03:06.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.171+0000 7f0afdffb700 1 -- 172.21.15.16:0/1286221083 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae80035b0 con 0x7f0b000b83f0 2023-06-08T04:03:06.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.171+0000 7f0afe7fc700 1 -- 172.21.15.16:0/1286221083 >> v1:172.21.15.169:6789/0 conn(0x7f0b000b4b50 legacy=0x7f0b000d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:06.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.171+0000 7f0afe7fc700 1 -- 172.21.15.16:0/1286221083 >> v1:172.21.15.16:6789/0 conn(0x7f0b000b83f0 legacy=0x7f0b000ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:06.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.171+0000 7f0afdffb700 1 -- 172.21.15.16:0/1286221083 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 96601923 0 0) 0x7f0ae80035b0 con 0x7f0b000b83f0 2023-06-08T04:03:06.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.171+0000 7f0afe7fc700 1 -- 172.21.15.16:0/1286221083 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b000cd4c0 con 0x7f0b00160a60 2023-06-08T04:03:06.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.171+0000 7f0afe7fc700 1 --2- 172.21.15.16:0/1286221083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00160a60 0x7f0b000b4610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009840 tx=0x7f0af4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0a8f5f606b6bd82 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:06.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.172+0000 7f0afdffb700 1 -- 172.21.15.16:0/1286221083 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0001670 con 0x7f0b00160a60 2023-06-08T04:03:06.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.172+0000 7f0afdffb700 1 -- 172.21.15.16:0/1286221083 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af4004030 con 0x7f0b00160a60 2023-06-08T04:03:06.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.172+0000 7f0afdffb700 1 -- 172.21.15.16:0/1286221083 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40043c0 con 0x7f0b00160a60 2023-06-08T04:03:06.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.172+0000 7f0b055ff700 1 -- 172.21.15.16:0/1286221083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00160a60 msgr2=0x7f0b000b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:06.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.172+0000 7f0b055ff700 1 --2- 172.21.15.16:0/1286221083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00160a60 0x7f0b000b4610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009840 tx=0x7f0af4009b50 comp rx=0 tx=0).stop 2023-06-08T04:03:06.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.172+0000 7f0b055ff700 1 -- 172.21.15.16:0/1286221083 shutdown_connections 2023-06-08T04:03:06.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.172+0000 7f0b055ff700 1 --2- 172.21.15.16:0/1286221083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00160a60 0x7f0b000b4610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.172+0000 7f0b055ff700 1 -- 172.21.15.16:0/1286221083 >> 172.21.15.16:0/1286221083 conn(0x7f0b000cf610 msgr2=0x7f0b000cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:06.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.172+0000 7f0b055ff700 1 -- 172.21.15.16:0/1286221083 shutdown_connections 2023-06-08T04:03:06.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.172+0000 7f0b055ff700 1 -- 172.21.15.16:0/1286221083 wait complete. 2023-06-08T04:03:06.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.174+0000 7f0b055ff700 1 Processor -- start 2023-06-08T04:03:06.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.174+0000 7f0b055ff700 1 -- start start 2023-06-08T04:03:06.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.175+0000 7f0b055ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b000b4b50 0x7f0b0014ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:06.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.175+0000 7f0b055ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b000b83f0 0x7f0b0015e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:06.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.175+0000 7f0b055ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00160a60 0x7f0b0015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:06.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.175+0000 7f0b055ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000caa40 con 0x7f0b000b83f0 2023-06-08T04:03:06.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.175+0000 7f0b055ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000cad20 con 0x7f0b00160a60 2023-06-08T04:03:06.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.175+0000 7f0b055ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000cb000 con 0x7f0b000b4b50 2023-06-08T04:03:06.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0afe7fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b000b83f0 0x7f0b0015e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0afe7fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b000b83f0 0x7f0b0015e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53566/0 (socket says 172.21.15.16:53566) 2023-06-08T04:03:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0afe7fc700 1 -- 172.21.15.16:0/72610033 learned_addr learned my addr 172.21.15.16:0/72610033 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0aff7fe700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00160a60 0x7f0b0015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0afeffd700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b000b4b50 0x7f0b0014ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0afe7fc700 1 -- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b000b4b50 msgr2=0x7f0b0014ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0afe7fc700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b000b4b50 0x7f0b0014ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0afe7fc700 1 -- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00160a60 msgr2=0x7f0b0015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:06.183 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0afe7fc700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00160a60 0x7f0b0015eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.183 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0afe7fc700 1 -- 172.21.15.16:0/72610033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40094a0 con 0x7f0b000b83f0 2023-06-08T04:03:06.183 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0aff7fe700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00160a60 0x7f0b0015eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:06.183 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.176+0000 7f0afe7fc700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b000b83f0 0x7f0b0015e5b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009b90 tx=0x7f0af4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:06.183 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.177+0000 7f0ae77fe700 1 -- 172.21.15.16:0/72610033 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4011830 con 0x7f0b000b83f0 2023-06-08T04:03:06.183 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.177+0000 7f0ae77fe700 1 -- 172.21.15.16:0/72610033 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af401f070 con 0x7f0b000b83f0 2023-06-08T04:03:06.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.177+0000 7f0ae77fe700 1 -- 172.21.15.16:0/72610033 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4011bd0 con 0x7f0b000b83f0 2023-06-08T04:03:06.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.177+0000 7f0b055ff700 1 -- 172.21.15.16:0/72610033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b000cb2e0 con 0x7f0b000b83f0 2023-06-08T04:03:06.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.177+0000 7f0b055ff700 1 -- 172.21.15.16:0/72610033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b000cbae0 con 0x7f0b000b83f0 2023-06-08T04:03:06.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.178+0000 7f0b055ff700 1 -- 172.21.15.16:0/72610033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b000740e0 con 0x7f0b000b83f0 2023-06-08T04:03:06.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.179+0000 7f0ae77fe700 1 -- 172.21.15.16:0/72610033 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0af4011d30 con 0x7f0b000b83f0 2023-06-08T04:03:06.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.180+0000 7f0ae77fe700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0aec06ace0 0x7f0aec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:06.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.180+0000 7f0ae77fe700 1 -- 172.21.15.16:0/72610033 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0af4021070 con 0x7f0b000b83f0 2023-06-08T04:03:06.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.180+0000 7f0afeffd700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0aec06ace0 0x7f0aec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:06.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.181+0000 7f0afeffd700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0aec06ace0 0x7f0aec06d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0af0001eb0 tx=0x7f0af0001c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:06.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.184+0000 7f0ae77fe700 1 -- 172.21.15.16:0/72610033 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0af4055f50 con 0x7f0b000b83f0 2023-06-08T04:03:06.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.473+0000 7f0b055ff700 1 -- 172.21.15.16:0/72610033 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f0b000ccfc0 con 0x7f0b000b83f0 2023-06-08T04:03:06.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.477+0000 7f0ae77fe700 1 -- 172.21.15.16:0/72610033 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0af402b0a0 con 0x7f0b000b83f0 2023-06-08T04:03:06.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 -- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0aec06ace0 msgr2=0x7f0aec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:06.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0aec06ace0 0x7f0aec06d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0af0001eb0 tx=0x7f0af0001c60 comp rx=0 tx=0).stop 2023-06-08T04:03:06.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 -- 172.21.15.16:0/72610033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b000b83f0 msgr2=0x7f0b0015e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:06.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b000b83f0 0x7f0b0015e5b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009b90 tx=0x7f0af4004750 comp rx=0 tx=0).stop 2023-06-08T04:03:06.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 -- 172.21.15.16:0/72610033 shutdown_connections 2023-06-08T04:03:06.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0aec06ace0 0x7f0aec06d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b00160a60 0x7f0b0015eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b000b4b50 0x7f0b0014ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 --2- 172.21.15.16:0/72610033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b000b83f0 0x7f0b0015e5b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 -- 172.21.15.16:0/72610033 >> 172.21.15.16:0/72610033 conn(0x7f0b000cf610 msgr2=0x7f0b000cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:06.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 -- 172.21.15.16:0/72610033 shutdown_connections 2023-06-08T04:03:06.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.479+0000 7f0b055ff700 1 -- 172.21.15.16:0/72610033 wait complete. 2023-06-08T04:03:06.501 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-08T04:03:06.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.698+0000 7f82221ff700 1 Processor -- start 2023-06-08T04:03:06.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.699+0000 7f82221ff700 1 -- start start 2023-06-08T04:03:06.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.700+0000 7f82221ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f821c160a60 0x7f821c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:06.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.700+0000 7f82221ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f821c0b4b50 0x7f821c0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:06.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.700+0000 7f82221ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0d0800 con 0x7f821c0b83f0 2023-06-08T04:03:06.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.700+0000 7f82221ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c160ed0 con 0x7f821c160a60 2023-06-08T04:03:06.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.700+0000 7f82221ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0b4fd0 con 0x7f821c0b4b50 2023-06-08T04:03:06.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.700+0000 7f821b7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f821c0b83f0 0x7f821c0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60136/0 (socket says 172.21.15.16:60136) 2023-06-08T04:03:06.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.700+0000 7f821b7fe700 1 -- 172.21.15.16:0/3043620630 learned_addr learned my addr 172.21.15.16:0/3043620630 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:06.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.700+0000 7f821affd700 1 --2- 172.21.15.16:0/3043620630 >> v2:172.21.15.16:3300/0 conn(0x7f821c160a60 0x7f821c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:06.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.700+0000 7f821bfff700 1 --2- 172.21.15.16:0/3043620630 >> v2:172.21.15.169:3300/0 conn(0x7f821c0b4b50 0x7f821c0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:06.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.700+0000 7f821a7fc700 1 -- 172.21.15.16:0/3043620630 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703147447 0 0) 0x7f821c0d0800 con 0x7f821c0b83f0 2023-06-08T04:03:06.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.700+0000 7f821a7fc700 1 -- 172.21.15.16:0/3043620630 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82040035b0 con 0x7f821c0b83f0 2023-06-08T04:03:06.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.701+0000 7f821affd700 1 -- 172.21.15.16:0/3043620630 >> v2:172.21.15.169:3300/0 conn(0x7f821c0b4b50 msgr2=0x7f821c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:06.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.701+0000 7f821affd700 1 --2- 172.21.15.16:0/3043620630 >> v2:172.21.15.169:3300/0 conn(0x7f821c0b4b50 0x7f821c0d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.701+0000 7f821affd700 1 -- 172.21.15.16:0/3043620630 >> v1:172.21.15.16:6789/0 conn(0x7f821c0b83f0 legacy=0x7f821c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:06.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.701+0000 7f821affd700 1 -- 172.21.15.16:0/3043620630 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0cd1e0 con 0x7f821c160a60 2023-06-08T04:03:06.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.701+0000 7f821affd700 1 --2- 172.21.15.16:0/3043620630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f821c160a60 0x7f821c0b4610 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f821c0b2590 tx=0x7f8210009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e07ed0a1c99001f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:06.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.701+0000 7f821a7fc700 1 -- 172.21.15.16:0/3043620630 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210011830 con 0x7f821c160a60 2023-06-08T04:03:06.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.701+0000 7f821a7fc700 1 -- 172.21.15.16:0/3043620630 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8210011990 con 0x7f821c160a60 2023-06-08T04:03:06.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.701+0000 7f821a7fc700 1 -- 172.21.15.16:0/3043620630 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210011d20 con 0x7f821c160a60 2023-06-08T04:03:06.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.702+0000 7f82221ff700 1 -- 172.21.15.16:0/3043620630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f821c160a60 msgr2=0x7f821c0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:06.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.702+0000 7f82221ff700 1 --2- 172.21.15.16:0/3043620630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f821c160a60 0x7f821c0b4610 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f821c0b2590 tx=0x7f8210009b20 comp rx=0 tx=0).stop 2023-06-08T04:03:06.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.702+0000 7f82221ff700 1 -- 172.21.15.16:0/3043620630 shutdown_connections 2023-06-08T04:03:06.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.702+0000 7f82221ff700 1 --2- 172.21.15.16:0/3043620630 >> v2:172.21.15.169:3300/0 conn(0x7f821c0b4b50 0x7f821c0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.702+0000 7f82221ff700 1 --2- 172.21.15.16:0/3043620630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f821c160a60 0x7f821c0b4610 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.702+0000 7f82221ff700 1 -- 172.21.15.16:0/3043620630 >> 172.21.15.16:0/3043620630 conn(0x7f821c0cf610 msgr2=0x7f821c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:06.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.702+0000 7f82221ff700 1 -- 172.21.15.16:0/3043620630 shutdown_connections 2023-06-08T04:03:06.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.702+0000 7f82221ff700 1 -- 172.21.15.16:0/3043620630 wait complete. 2023-06-08T04:03:06.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.704+0000 7f82221ff700 1 Processor -- start 2023-06-08T04:03:06.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.704+0000 7f82221ff700 1 -- start start 2023-06-08T04:03:06.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f82221ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f821c0b4b50 0x7f821c0cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:06.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f82221ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f821c0b83f0 0x7f821c15f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:06.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f82221ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f821c160a60 0x7f821c0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:06.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f82221ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c15e0d0 con 0x7f821c0b83f0 2023-06-08T04:03:06.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f82221ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c15e3b0 con 0x7f821c0b4b50 2023-06-08T04:03:06.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f82221ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c15e690 con 0x7f821c160a60 2023-06-08T04:03:06.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f821affd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f821c0b83f0 0x7f821c15f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:06.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f821affd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f821c0b83f0 0x7f821c15f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53590/0 (socket says 172.21.15.16:53590) 2023-06-08T04:03:06.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f821affd700 1 -- 172.21.15.16:0/3133052958 learned_addr learned my addr 172.21.15.16:0/3133052958 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:06.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f821b7fe700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f821c0b4b50 0x7f821c0cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:06.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f821bfff700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f821c160a60 0x7f821c0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:06.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f821affd700 1 -- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f821c160a60 msgr2=0x7f821c0b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:06.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f821affd700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f821c160a60 0x7f821c0b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f821affd700 1 -- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f821c0b4b50 msgr2=0x7f821c0cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:06.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f821affd700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f821c0b4b50 0x7f821c0cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:06.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f821affd700 1 -- 172.21.15.16:0/3133052958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82100094a0 con 0x7f821c0b83f0 2023-06-08T04:03:06.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.705+0000 7f821bfff700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f821c160a60 0x7f821c0b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:06.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.706+0000 7f821affd700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f821c0b83f0 0x7f821c15f170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8210000c00 tx=0x7f8210004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:06.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.706+0000 7f8203fff700 1 -- 172.21.15.16:0/3133052958 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82100036a0 con 0x7f821c0b83f0 2023-06-08T04:03:06.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.706+0000 7f8203fff700 1 -- 172.21.15.16:0/3133052958 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821001e070 con 0x7f821c0b83f0 2023-06-08T04:03:06.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.706+0000 7f8203fff700 1 -- 172.21.15.16:0/3133052958 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210003a20 con 0x7f821c0b83f0 2023-06-08T04:03:06.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.706+0000 7f82221ff700 1 -- 172.21.15.16:0/3133052958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c15e970 con 0x7f821c0b83f0 2023-06-08T04:03:06.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.706+0000 7f82221ff700 1 -- 172.21.15.16:0/3133052958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c1544e0 con 0x7f821c0b83f0 2023-06-08T04:03:06.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.707+0000 7f82221ff700 1 -- 172.21.15.16:0/3133052958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c0b1880 con 0x7f821c0b83f0 2023-06-08T04:03:06.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.708+0000 7f8203fff700 1 -- 172.21.15.16:0/3133052958 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8210003b80 con 0x7f821c0b83f0 2023-06-08T04:03:06.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.709+0000 7f8203fff700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f820806ace0 0x7f820806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:06.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.709+0000 7f8203fff700 1 -- 172.21.15.16:0/3133052958 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8210089fe0 con 0x7f821c0b83f0 2023-06-08T04:03:06.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.710+0000 7f821b7fe700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f820806ace0 0x7f820806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:06.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.710+0000 7f821b7fe700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f820806ace0 0x7f820806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f820c007fd0 tx=0x7f820c007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:06.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.714+0000 7f8203fff700 1 -- 172.21.15.16:0/3133052958 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f82100553f0 con 0x7f821c0b83f0 2023-06-08T04:03:07.002 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:06.998+0000 7f82221ff700 1 -- 172.21.15.16:0/3133052958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f821c0740e0 con 0x7f821c0b83f0 2023-06-08T04:03:07.006 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.002+0000 7f8203fff700 1 -- 172.21.15.16:0/3133052958 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f82100150a0 con 0x7f821c0b83f0 2023-06-08T04:03:07.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 -- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f820806ace0 msgr2=0x7f820806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f820806ace0 0x7f820806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f820c007fd0 tx=0x7f820c007dc0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 -- 172.21.15.16:0/3133052958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f821c0b83f0 msgr2=0x7f821c15f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f821c0b83f0 0x7f821c15f170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8210000c00 tx=0x7f8210004750 comp rx=0 tx=0).stop 2023-06-08T04:03:07.008 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 -- 172.21.15.16:0/3133052958 shutdown_connections 2023-06-08T04:03:07.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f820806ace0 0x7f820806d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f821c160a60 0x7f821c0b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f821c0b4b50 0x7f821c0cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 --2- 172.21.15.16:0/3133052958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f821c0b83f0 0x7f821c15f170 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 -- 172.21.15.16:0/3133052958 >> 172.21.15.16:0/3133052958 conn(0x7f821c0cf610 msgr2=0x7f821c073280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:07.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 -- 172.21.15.16:0/3133052958 shutdown_connections 2023-06-08T04:03:07.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.004+0000 7f82221ff700 1 -- 172.21.15.16:0/3133052958 wait complete. 2023-06-08T04:03:07.025 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:03:07.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.222+0000 7f403bbff700 1 Processor -- start 2023-06-08T04:03:07.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.222+0000 7f403bbff700 1 -- start start 2023-06-08T04:03:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.223+0000 7f403bbff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340b83f0 0x7f4034160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.223+0000 7f403bbff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40340d0800 con 0x7f40340ced40 2023-06-08T04:03:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.223+0000 7f403bbff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40340cd1e0 con 0x7f40340b4d20 2023-06-08T04:03:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.223+0000 7f403bbff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40340cd4c0 con 0x7f40340b83f0 2023-06-08T04:03:07.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.224+0000 7f403919a700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f40340ced40 0x7f40340b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60148/0 (socket says 172.21.15.16:60148) 2023-06-08T04:03:07.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.224+0000 7f403919a700 1 -- 172.21.15.16:0/2479159904 learned_addr learned my addr 172.21.15.16:0/2479159904 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:07.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.224+0000 7f403999b700 1 --2- 172.21.15.16:0/2479159904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340b83f0 0x7f4034160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:07.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.224+0000 7f4038999700 1 -- 172.21.15.16:0/2479159904 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369524579 0 0) 0x7f40340d0800 con 0x7f40340ced40 2023-06-08T04:03:07.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.224+0000 7f4038999700 1 -- 172.21.15.16:0/2479159904 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40200035b0 con 0x7f40340ced40 2023-06-08T04:03:07.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.224+0000 7f4038999700 1 -- 172.21.15.16:0/2479159904 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225440884 0 0) 0x7f40340cd1e0 con 0x7f40340b4d20 2023-06-08T04:03:07.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.224+0000 7f4038999700 1 -- 172.21.15.16:0/2479159904 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40340d0800 con 0x7f40340b4d20 2023-06-08T04:03:07.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.224+0000 7f403999b700 1 -- 172.21.15.16:0/2479159904 >> v1:172.21.15.169:6789/0 conn(0x7f40340b4d20 legacy=0x7f40340d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.224+0000 7f403999b700 1 -- 172.21.15.16:0/2479159904 >> v1:172.21.15.16:6789/0 conn(0x7f40340ced40 legacy=0x7f40340b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.224+0000 7f4038999700 1 -- 172.21.15.16:0/2479159904 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3406981916 0 0) 0x7f40200035b0 con 0x7f40340ced40 2023-06-08T04:03:07.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.224+0000 7f403999b700 1 -- 172.21.15.16:0/2479159904 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340d0aa0 con 0x7f40340b83f0 2023-06-08T04:03:07.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.225+0000 7f403999b700 1 --2- 172.21.15.16:0/2479159904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340b83f0 0x7f4034160a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4030009870 tx=0x7f4030009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc44bf6899d4dda9 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:07.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.225+0000 7f4038999700 1 -- 172.21.15.16:0/2479159904 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024001670 con 0x7f40340b83f0 2023-06-08T04:03:07.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.225+0000 7f4038999700 1 -- 172.21.15.16:0/2479159904 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4030004030 con 0x7f40340b83f0 2023-06-08T04:03:07.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.225+0000 7f4038999700 1 -- 172.21.15.16:0/2479159904 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40300043c0 con 0x7f40340b83f0 2023-06-08T04:03:07.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.226+0000 7f403bbff700 1 -- 172.21.15.16:0/2479159904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340b83f0 msgr2=0x7f4034160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.226+0000 7f403bbff700 1 --2- 172.21.15.16:0/2479159904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340b83f0 0x7f4034160a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4030009870 tx=0x7f4030009b80 comp rx=0 tx=0).stop 2023-06-08T04:03:07.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.226+0000 7f403bbff700 1 -- 172.21.15.16:0/2479159904 shutdown_connections 2023-06-08T04:03:07.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.226+0000 7f403bbff700 1 --2- 172.21.15.16:0/2479159904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340b83f0 0x7f4034160a60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.226+0000 7f403bbff700 1 -- 172.21.15.16:0/2479159904 >> 172.21.15.16:0/2479159904 conn(0x7f40340cf610 msgr2=0x7f40340cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:07.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.226+0000 7f403bbff700 1 -- 172.21.15.16:0/2479159904 shutdown_connections 2023-06-08T04:03:07.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.226+0000 7f403bbff700 1 -- 172.21.15.16:0/2479159904 wait complete. 2023-06-08T04:03:07.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.228+0000 7f403bbff700 1 Processor -- start 2023-06-08T04:03:07.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.228+0000 7f403bbff700 1 -- start start 2023-06-08T04:03:07.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403bbff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40340b4d20 0x7f403415f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403bbff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40340b83f0 0x7f4034150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403bbff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340ced40 0x7f40340c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403bbff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4034150960 con 0x7f40340b4d20 2023-06-08T04:03:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403bbff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40341e6720 con 0x7f40340b83f0 2023-06-08T04:03:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403bbff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40341e6ce0 con 0x7f40340ced40 2023-06-08T04:03:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403999b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40340b4d20 0x7f403415f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:07.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403999b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40340b4d20 0x7f403415f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53598/0 (socket says 172.21.15.16:53598) 2023-06-08T04:03:07.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403999b700 1 -- 172.21.15.16:0/1076524353 learned_addr learned my addr 172.21.15.16:0/1076524353 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:07.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403919a700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40340b83f0 0x7f4034150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:07.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403a19c700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340ced40 0x7f40340c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:07.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403999b700 1 -- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340ced40 msgr2=0x7f40340c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403999b700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340ced40 0x7f40340c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403999b700 1 -- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40340b83f0 msgr2=0x7f4034150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403999b700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40340b83f0 0x7f4034150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403999b700 1 -- 172.21.15.16:0/1076524353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300094a0 con 0x7f40340b4d20 2023-06-08T04:03:07.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.229+0000 7f403a19c700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340ced40 0x7f40340c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:03:07.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.230+0000 7f403999b700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40340b4d20 0x7f403415f460 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f40300090b0 tx=0x7f4030004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:07.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.230+0000 7f402a7fc700 1 -- 172.21.15.16:0/1076524353 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030011630 con 0x7f40340b4d20 2023-06-08T04:03:07.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.230+0000 7f402a7fc700 1 -- 172.21.15.16:0/1076524353 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403001f070 con 0x7f40340b4d20 2023-06-08T04:03:07.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.230+0000 7f402a7fc700 1 -- 172.21.15.16:0/1076524353 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40300119f0 con 0x7f40340b4d20 2023-06-08T04:03:07.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.230+0000 7f403bbff700 1 -- 172.21.15.16:0/1076524353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403415e730 con 0x7f40340b4d20 2023-06-08T04:03:07.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.230+0000 7f403bbff700 1 -- 172.21.15.16:0/1076524353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40341e6970 con 0x7f40340b4d20 2023-06-08T04:03:07.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.231+0000 7f403bbff700 1 -- 172.21.15.16:0/1076524353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40341e6fc0 con 0x7f40340b4d20 2023-06-08T04:03:07.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.232+0000 7f402a7fc700 1 -- 172.21.15.16:0/1076524353 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4030011b50 con 0x7f40340b4d20 2023-06-08T04:03:07.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.233+0000 7f402a7fc700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f401806ace0 0x7f401806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:07.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.233+0000 7f402a7fc700 1 -- 172.21.15.16:0/1076524353 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4030021070 con 0x7f40340b4d20 2023-06-08T04:03:07.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.233+0000 7f403919a700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f401806ace0 0x7f401806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:07.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.234+0000 7f403919a700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f401806ace0 0x7f401806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4024007fd0 tx=0x7f4024007a00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:07.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.237+0000 7f402a7fc700 1 -- 172.21.15.16:0/1076524353 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4030055ee0 con 0x7f40340b4d20 2023-06-08T04:03:07.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.445+0000 7f403bbff700 1 -- 172.21.15.16:0/1076524353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40340cf170 con 0x7f40340b4d20 2023-06-08T04:03:07.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.446+0000 7f402a7fc700 1 -- 172.21.15.16:0/1076524353 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+14557 (secure 0 0 0) 0x7f403002b090 con 0x7f40340b4d20 2023-06-08T04:03:07.450 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:07.451 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:03:03.281614+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:03:07.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 -- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f401806ace0 msgr2=0x7f401806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f401806ace0 0x7f401806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4024007fd0 tx=0x7f4024007a00 comp rx=0 tx=0).stop 2023-06-08T04:03:07.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 -- 172.21.15.16:0/1076524353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40340b4d20 msgr2=0x7f403415f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40340b4d20 0x7f403415f460 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f40300090b0 tx=0x7f4030004750 comp rx=0 tx=0).stop 2023-06-08T04:03:07.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 -- 172.21.15.16:0/1076524353 shutdown_connections 2023-06-08T04:03:07.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f401806ace0 0x7f401806d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40340ced40 0x7f40340c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40340b4d20 0x7f403415f460 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 --2- 172.21.15.16:0/1076524353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40340b83f0 0x7f4034150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 -- 172.21.15.16:0/1076524353 >> 172.21.15.16:0/1076524353 conn(0x7f40340cf610 msgr2=0x7f40340b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:07.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 -- 172.21.15.16:0/1076524353 shutdown_connections 2023-06-08T04:03:07.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.449+0000 7f403bbff700 1 -- 172.21.15.16:0/1076524353 wait complete. 2023-06-08T04:03:07.471 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:03:07.472 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:03:07.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.671+0000 7fb9861ff700 1 Processor -- start 2023-06-08T04:03:07.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.671+0000 7fb9861ff700 1 -- start start 2023-06-08T04:03:07.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.672+0000 7fb9861ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9800b83f0 0x7fb980160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.672+0000 7fb9861ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb9800b4d20 0x7fb9800d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.672+0000 7fb9861ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9800d0800 con 0x7fb9800ced40 2023-06-08T04:03:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.672+0000 7fb9861ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9800cd1e0 con 0x7fb9800b4d20 2023-06-08T04:03:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.672+0000 7fb9861ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800cd4c0 con 0x7fb9800b83f0 2023-06-08T04:03:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.673+0000 7fb97effd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb9800ced40 0x7fb9800b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60158/0 (socket says 172.21.15.16:60158) 2023-06-08T04:03:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.673+0000 7fb97effd700 1 -- 172.21.15.16:0/3907873525 learned_addr learned my addr 172.21.15.16:0/3907873525 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:07.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.673+0000 7fb97ffff700 1 --2- 172.21.15.16:0/3907873525 >> v2:172.21.15.169:3300/0 conn(0x7fb9800b4d20 0x7fb9800d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:07.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.673+0000 7fb97f7fe700 1 --2- 172.21.15.16:0/3907873525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9800b83f0 0x7fb980160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.673+0000 7fb97e7fc700 1 -- 172.21.15.16:0/3907873525 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545516230 0 0) 0x7fb9800d0800 con 0x7fb9800ced40 2023-06-08T04:03:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.673+0000 7fb97e7fc700 1 -- 172.21.15.16:0/3907873525 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9680035b0 con 0x7fb9800ced40 2023-06-08T04:03:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.673+0000 7fb97ffff700 1 -- 172.21.15.16:0/3907873525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9800b83f0 msgr2=0x7fb980160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:07.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.673+0000 7fb97ffff700 1 --2- 172.21.15.16:0/3907873525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9800b83f0 0x7fb980160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.673+0000 7fb97ffff700 1 -- 172.21.15.16:0/3907873525 >> v1:172.21.15.16:6789/0 conn(0x7fb9800ced40 legacy=0x7fb9800b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.673+0000 7fb97ffff700 1 -- 172.21.15.16:0/3907873525 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9800d0aa0 con 0x7fb9800b4d20 2023-06-08T04:03:07.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.674+0000 7fb97ffff700 1 --2- 172.21.15.16:0/3907873525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9800b4d20 0x7fb9800d0fc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb978009d90 tx=0x7fb97800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ee8a5017bb0dee2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:07.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.674+0000 7fb97e7fc700 1 -- 172.21.15.16:0/3907873525 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97800e070 con 0x7fb9800b4d20 2023-06-08T04:03:07.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.674+0000 7fb97e7fc700 1 -- 172.21.15.16:0/3907873525 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97800bb20 con 0x7fb9800b4d20 2023-06-08T04:03:07.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.674+0000 7fb97e7fc700 1 -- 172.21.15.16:0/3907873525 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97800be90 con 0x7fb9800b4d20 2023-06-08T04:03:07.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.674+0000 7fb9861ff700 1 -- 172.21.15.16:0/3907873525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9800b4d20 msgr2=0x7fb9800d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.674+0000 7fb9861ff700 1 --2- 172.21.15.16:0/3907873525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9800b4d20 0x7fb9800d0fc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb978009d90 tx=0x7fb97800b330 comp rx=0 tx=0).stop 2023-06-08T04:03:07.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.675+0000 7fb9861ff700 1 -- 172.21.15.16:0/3907873525 shutdown_connections 2023-06-08T04:03:07.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.675+0000 7fb9861ff700 1 --2- 172.21.15.16:0/3907873525 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9800b4d20 0x7fb9800d0fc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.675+0000 7fb9861ff700 1 --2- 172.21.15.16:0/3907873525 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9800b83f0 0x7fb980160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.675+0000 7fb9861ff700 1 -- 172.21.15.16:0/3907873525 >> 172.21.15.16:0/3907873525 conn(0x7fb9800cf610 msgr2=0x7fb9800cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:07.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.675+0000 7fb9861ff700 1 -- 172.21.15.16:0/3907873525 shutdown_connections 2023-06-08T04:03:07.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.675+0000 7fb9861ff700 1 -- 172.21.15.16:0/3907873525 wait complete. 2023-06-08T04:03:07.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.676+0000 7fb9861ff700 1 Processor -- start 2023-06-08T04:03:07.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.677+0000 7fb9861ff700 1 -- start start 2023-06-08T04:03:07.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.677+0000 7fb9861ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9800b4d20 0x7fb98015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:07.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.677+0000 7fb9861ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9800b83f0 0x7fb980154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:07.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.677+0000 7fb9861ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9800ced40 0x7fb98015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:07.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb9861ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98015cf10 con 0x7fb9800ced40 2023-06-08T04:03:07.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb9861ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98015e1c0 con 0x7fb9800b4d20 2023-06-08T04:03:07.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb9861ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98015d120 con 0x7fb9800b83f0 2023-06-08T04:03:07.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9800ced40 0x7fb98015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:07.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9800ced40 0x7fb98015a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53610/0 (socket says 172.21.15.16:53610) 2023-06-08T04:03:07.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97ffff700 1 -- 172.21.15.16:0/3962097301 learned_addr learned my addr 172.21.15.16:0/3962097301 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:07.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97f7fe700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9800b4d20 0x7fb98015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:07.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97effd700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9800b83f0 0x7fb980154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:07.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97ffff700 1 -- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9800b83f0 msgr2=0x7fb980154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97ffff700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9800b83f0 0x7fb980154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97ffff700 1 -- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9800b4d20 msgr2=0x7fb98015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97ffff700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9800b4d20 0x7fb98015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97ffff700 1 -- 172.21.15.16:0/3962097301 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978009a70 con 0x7fb9800ced40 2023-06-08T04:03:07.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97f7fe700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9800b4d20 0x7fb98015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:03:07.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.678+0000 7fb97effd700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9800b83f0 0x7fb980154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:03:07.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.679+0000 7fb97ffff700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9800ced40 0x7fb98015a8c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb978014040 tx=0x7fb978004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:07.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.679+0000 7fb967fff700 1 -- 172.21.15.16:0/3962097301 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978004960 con 0x7fb9800ced40 2023-06-08T04:03:07.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.679+0000 7fb967fff700 1 -- 172.21.15.16:0/3962097301 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb978020070 con 0x7fb9800ced40 2023-06-08T04:03:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.679+0000 7fb967fff700 1 -- 172.21.15.16:0/3962097301 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9780276c0 con 0x7fb9800ced40 2023-06-08T04:03:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.679+0000 7fb9861ff700 1 -- 172.21.15.16:0/3962097301 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98015d400 con 0x7fb9800ced40 2023-06-08T04:03:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.679+0000 7fb9861ff700 1 -- 172.21.15.16:0/3962097301 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98015d9c0 con 0x7fb9800ced40 2023-06-08T04:03:07.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.680+0000 7fb9861ff700 1 -- 172.21.15.16:0/3962097301 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9800740e0 con 0x7fb9800ced40 2023-06-08T04:03:07.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.681+0000 7fb967fff700 1 -- 172.21.15.16:0/3962097301 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb978012430 con 0x7fb9800ced40 2023-06-08T04:03:07.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.682+0000 7fb967fff700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb96c06ace0 0x7fb96c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:07.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.682+0000 7fb967fff700 1 -- 172.21.15.16:0/3962097301 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb978022070 con 0x7fb9800ced40 2023-06-08T04:03:07.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.683+0000 7fb97f7fe700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb96c06ace0 0x7fb96c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:07.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.683+0000 7fb97f7fe700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb96c06ace0 0x7fb96c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb970009b60 tx=0x7fb970008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:07.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.687+0000 7fb967fff700 1 -- 172.21.15.16:0/3962097301 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb978056200 con 0x7fb9800ced40 2023-06-08T04:03:07.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.894+0000 7fb9861ff700 1 -- 172.21.15.16:0/3962097301 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb9800c9360 con 0x7fb9800ced40 2023-06-08T04:03:07.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.894+0000 7fb967fff700 1 -- 172.21.15.16:0/3962097301 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb97802c0a0 con 0x7fb9800ced40 2023-06-08T04:03:07.898 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:03:07.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 -- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb96c06ace0 msgr2=0x7fb96c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb96c06ace0 0x7fb96c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb970009b60 tx=0x7fb970008040 comp rx=0 tx=0).stop 2023-06-08T04:03:07.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 -- 172.21.15.16:0/3962097301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9800ced40 msgr2=0x7fb98015a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9800ced40 0x7fb98015a8c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb978014040 tx=0x7fb978004ad0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 -- 172.21.15.16:0/3962097301 shutdown_connections 2023-06-08T04:03:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb96c06ace0 0x7fb96c06d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9800ced40 0x7fb98015a8c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb9800b4d20 0x7fb98015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 --2- 172.21.15.16:0/3962097301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb9800b83f0 0x7fb980154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:07.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 -- 172.21.15.16:0/3962097301 >> 172.21.15.16:0/3962097301 conn(0x7fb9800cf610 msgr2=0x7fb9800b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:07.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 -- 172.21.15.16:0/3962097301 shutdown_connections 2023-06-08T04:03:07.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:07.896+0000 7fb9861ff700 1 -- 172.21.15.16:0/3962097301 wait complete. 2023-06-08T04:03:07.918 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:03:08.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.119+0000 7fe3011ff700 1 Processor -- start 2023-06-08T04:03:08.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.119+0000 7fe3011ff700 1 -- start start 2023-06-08T04:03:08.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe3011ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe2fc0b83f0 0x7fe2fc160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:08.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe3011ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe2fc0b4d20 0x7fe2fc0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:08.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe3011ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2fc0d0800 con 0x7fe2fc0ced40 2023-06-08T04:03:08.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe3011ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2fc0cd1e0 con 0x7fe2fc0b4d20 2023-06-08T04:03:08.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe3011ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2fc0cd4c0 con 0x7fe2fc0b83f0 2023-06-08T04:03:08.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe2fb59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe2fc0b4d20 0x7fe2fc0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:08.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe2fb59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe2fc0b4d20 0x7fe2fc0d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53626/0 (socket says 172.21.15.16:53626) 2023-06-08T04:03:08.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe2fb59e700 1 -- 172.21.15.16:0/1954158656 learned_addr learned my addr 172.21.15.16:0/1954158656 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:08.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe2fad9d700 1 --2- 172.21.15.16:0/1954158656 >> v2:172.21.15.169:3300/0 conn(0x7fe2fc0b83f0 0x7fe2fc160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:08.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe2fb59e700 1 -- 172.21.15.16:0/1954158656 >> v2:172.21.15.169:3300/0 conn(0x7fe2fc0b83f0 msgr2=0x7fe2fc160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:08.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe2fb59e700 1 --2- 172.21.15.16:0/1954158656 >> v2:172.21.15.169:3300/0 conn(0x7fe2fc0b83f0 0x7fe2fc160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe2fb59e700 1 -- 172.21.15.16:0/1954158656 >> v1:172.21.15.16:6789/0 conn(0x7fe2fc0ced40 legacy=0x7fe2fc0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe2fb59e700 1 -- 172.21.15.16:0/1954158656 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc0d0aa0 con 0x7fe2fc0b4d20 2023-06-08T04:03:08.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.121+0000 7fe2fa59c700 1 -- 172.21.15.16:0/1954158656 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384463036 0 0) 0x7fe2fc0d0800 con 0x7fe2fc0ced40 2023-06-08T04:03:08.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.122+0000 7fe2fb59e700 1 --2- 172.21.15.16:0/1954158656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2fc0b4d20 0x7fe2fc0d0fc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc06ca80 tx=0x7fe2f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246d910018df92aa server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:08.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.122+0000 7fe2fa59c700 1 -- 172.21.15.16:0/1954158656 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f400e070 con 0x7fe2fc0b4d20 2023-06-08T04:03:08.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.122+0000 7fe2fa59c700 1 -- 172.21.15.16:0/1954158656 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f400b9c0 con 0x7fe2fc0b4d20 2023-06-08T04:03:08.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.122+0000 7fe2fa59c700 1 -- 172.21.15.16:0/1954158656 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f400bd70 con 0x7fe2fc0b4d20 2023-06-08T04:03:08.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.122+0000 7fe3011ff700 1 -- 172.21.15.16:0/1954158656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2fc0b4d20 msgr2=0x7fe2fc0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.122+0000 7fe3011ff700 1 --2- 172.21.15.16:0/1954158656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2fc0b4d20 0x7fe2fc0d0fc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc06ca80 tx=0x7fe2f400b330 comp rx=0 tx=0).stop 2023-06-08T04:03:08.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.123+0000 7fe3011ff700 1 -- 172.21.15.16:0/1954158656 shutdown_connections 2023-06-08T04:03:08.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.123+0000 7fe3011ff700 1 --2- 172.21.15.16:0/1954158656 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2fc0b4d20 0x7fe2fc0d0fc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.123+0000 7fe3011ff700 1 --2- 172.21.15.16:0/1954158656 >> v2:172.21.15.169:3300/0 conn(0x7fe2fc0b83f0 0x7fe2fc160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.123+0000 7fe3011ff700 1 -- 172.21.15.16:0/1954158656 >> 172.21.15.16:0/1954158656 conn(0x7fe2fc0cf610 msgr2=0x7fe2fc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:08.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.123+0000 7fe3011ff700 1 -- 172.21.15.16:0/1954158656 shutdown_connections 2023-06-08T04:03:08.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.123+0000 7fe3011ff700 1 -- 172.21.15.16:0/1954158656 wait complete. 2023-06-08T04:03:08.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.124+0000 7fe3011ff700 1 Processor -- start 2023-06-08T04:03:08.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.124+0000 7fe3011ff700 1 -- start start 2023-06-08T04:03:08.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.125+0000 7fe3011ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2fc0b4d20 0x7fe2fc145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:08.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.125+0000 7fe3011ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2fc0b83f0 0x7fe2fc15e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:08.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.125+0000 7fe3011ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2fc0ced40 0x7fe2fc15e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:08.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.125+0000 7fe3011ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc1e62d0 con 0x7fe2fc0ced40 2023-06-08T04:03:08.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.125+0000 7fe3011ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc0c9c60 con 0x7fe2fc0b4d20 2023-06-08T04:03:08.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.125+0000 7fe3011ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc0c9f40 con 0x7fe2fc0b83f0 2023-06-08T04:03:08.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2fb59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2fc0ced40 0x7fe2fc15e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:08.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2fb59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2fc0ced40 0x7fe2fc15e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53632/0 (socket says 172.21.15.16:53632) 2023-06-08T04:03:08.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2fb59e700 1 -- 172.21.15.16:0/1187586952 learned_addr learned my addr 172.21.15.16:0/1187586952 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:08.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2fad9d700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2fc0b4d20 0x7fe2fc145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:08.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2f3fff700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2fc0b83f0 0x7fe2fc15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:08.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2fb59e700 1 -- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2fc0b83f0 msgr2=0x7fe2fc15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2fb59e700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2fc0b83f0 0x7fe2fc15e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2fb59e700 1 -- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2fc0b4d20 msgr2=0x7fe2fc145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2fb59e700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2fc0b4d20 0x7fe2fc145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2fb59e700 1 -- 172.21.15.16:0/1187586952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f4009b30 con 0x7fe2fc0ced40 2023-06-08T04:03:08.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2fad9d700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2fc0b4d20 0x7fe2fc145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:08.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.126+0000 7fe2fb59e700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2fc0ced40 0x7fe2fc15e9d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4012000 tx=0x7fe2f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:08.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.127+0000 7fe2f37fe700 1 -- 172.21.15.16:0/1187586952 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40099b0 con 0x7fe2fc0ced40 2023-06-08T04:03:08.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.127+0000 7fe2f37fe700 1 -- 172.21.15.16:0/1187586952 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40092e0 con 0x7fe2fc0ced40 2023-06-08T04:03:08.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.127+0000 7fe3011ff700 1 -- 172.21.15.16:0/1187586952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2fc1e5f60 con 0x7fe2fc0ced40 2023-06-08T04:03:08.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.127+0000 7fe2f37fe700 1 -- 172.21.15.16:0/1187586952 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f401c660 con 0x7fe2fc0ced40 2023-06-08T04:03:08.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.127+0000 7fe3011ff700 1 -- 172.21.15.16:0/1187586952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2fc146050 con 0x7fe2fc0ced40 2023-06-08T04:03:08.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.128+0000 7fe3011ff700 1 -- 172.21.15.16:0/1187586952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2fc1e6660 con 0x7fe2fc0ced40 2023-06-08T04:03:08.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.129+0000 7fe2f37fe700 1 -- 172.21.15.16:0/1187586952 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe2f401c7c0 con 0x7fe2fc0ced40 2023-06-08T04:03:08.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.130+0000 7fe2f37fe700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe2dc06ace0 0x7fe2dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:08.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.130+0000 7fe2f37fe700 1 -- 172.21.15.16:0/1187586952 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe2f408ab30 con 0x7fe2fc0ced40 2023-06-08T04:03:08.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.130+0000 7fe2fad9d700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe2dc06ace0 0x7fe2dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:08.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.131+0000 7fe2fad9d700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe2dc06ace0 0x7fe2dc06d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0099f0 tx=0x7fe2ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:08.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.134+0000 7fe2f37fe700 1 -- 172.21.15.16:0/1187586952 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe2f4055f20 con 0x7fe2fc0ced40 2023-06-08T04:03:08.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.338+0000 7fe3011ff700 1 -- 172.21.15.16:0/1187586952 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2fc1e6410 con 0x7fe2fc0ced40 2023-06-08T04:03:08.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.338+0000 7fe2f37fe700 1 -- 172.21.15.16:0/1187586952 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2fc1e6410 con 0x7fe2fc0ced40 2023-06-08T04:03:08.342 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:03:08.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 -- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe2dc06ace0 msgr2=0x7fe2dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe2dc06ace0 0x7fe2dc06d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0099f0 tx=0x7fe2ec008040 comp rx=0 tx=0).stop 2023-06-08T04:03:08.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 -- 172.21.15.16:0/1187586952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2fc0ced40 msgr2=0x7fe2fc15e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2fc0ced40 0x7fe2fc15e9d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4012000 tx=0x7fe2f4004ad0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 -- 172.21.15.16:0/1187586952 shutdown_connections 2023-06-08T04:03:08.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fe2dc06ace0 0x7fe2dc06d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2fc0ced40 0x7fe2fc15e9d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2fc0b4d20 0x7fe2fc145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 --2- 172.21.15.16:0/1187586952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2fc0b83f0 0x7fe2fc15e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 -- 172.21.15.16:0/1187586952 >> 172.21.15.16:0/1187586952 conn(0x7fe2fc0cf610 msgr2=0x7fe2fc0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:08.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 -- 172.21.15.16:0/1187586952 shutdown_connections 2023-06-08T04:03:08.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.340+0000 7fe3011ff700 1 -- 172.21.15.16:0/1187586952 wait complete. 2023-06-08T04:03:08.362 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-08T04:03:08.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.558+0000 7f598fdff700 1 Processor -- start 2023-06-08T04:03:08.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.559+0000 7f598fdff700 1 -- start start 2023-06-08T04:03:08.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.560+0000 7f598fdff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5988070990 0x7f59880adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:08.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.560+0000 7f598fdff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59880c9b60 con 0x7f598815d660 2023-06-08T04:03:08.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.560+0000 7f598fdff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598806d660 con 0x7f5988159200 2023-06-08T04:03:08.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.560+0000 7f598fdff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59881595d0 con 0x7f5988070990 2023-06-08T04:03:08.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.560+0000 7f598e39c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f598815d660 0x7f59880c9ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60186/0 (socket says 172.21.15.16:60186) 2023-06-08T04:03:08.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.560+0000 7f598e39c700 1 -- 172.21.15.16:0/379682003 learned_addr learned my addr 172.21.15.16:0/379682003 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:08.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.560+0000 7f598d39a700 1 --2- 172.21.15.16:0/379682003 >> v2:172.21.15.169:3300/0 conn(0x7f5988070990 0x7f59880adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:08.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.560+0000 7f598cb99700 1 -- 172.21.15.16:0/379682003 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741779124 0 0) 0x7f59880c9b60 con 0x7f598815d660 2023-06-08T04:03:08.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.561+0000 7f598cb99700 1 -- 172.21.15.16:0/379682003 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59740035b0 con 0x7f598815d660 2023-06-08T04:03:08.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.561+0000 7f598d39a700 1 -- 172.21.15.16:0/379682003 >> v1:172.21.15.169:6789/0 conn(0x7f5988159200 legacy=0x7f5988070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.561+0000 7f598d39a700 1 -- 172.21.15.16:0/379682003 >> v1:172.21.15.16:6789/0 conn(0x7f598815d660 legacy=0x7f59880c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.561+0000 7f598d39a700 1 -- 172.21.15.16:0/379682003 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598806d940 con 0x7f5988070990 2023-06-08T04:03:08.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.561+0000 7f598d39a700 1 --2- 172.21.15.16:0/379682003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5988070990 0x7f59880adb60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5978009840 tx=0x7f5978009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5de6474efb0f70c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:08.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.561+0000 7f598cb99700 1 -- 172.21.15.16:0/379682003 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978011830 con 0x7f5988070990 2023-06-08T04:03:08.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.561+0000 7f598cb99700 1 -- 172.21.15.16:0/379682003 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5978011990 con 0x7f5988070990 2023-06-08T04:03:08.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.561+0000 7f598cb99700 1 -- 172.21.15.16:0/379682003 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978011d20 con 0x7f5988070990 2023-06-08T04:03:08.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.562+0000 7f598fdff700 1 -- 172.21.15.16:0/379682003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5988070990 msgr2=0x7f59880adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.562+0000 7f598fdff700 1 --2- 172.21.15.16:0/379682003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5988070990 0x7f59880adb60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5978009840 tx=0x7f5978009b50 comp rx=0 tx=0).stop 2023-06-08T04:03:08.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.562+0000 7f598fdff700 1 -- 172.21.15.16:0/379682003 shutdown_connections 2023-06-08T04:03:08.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.562+0000 7f598fdff700 1 --2- 172.21.15.16:0/379682003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5988070990 0x7f59880adb60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.562+0000 7f598fdff700 1 -- 172.21.15.16:0/379682003 >> 172.21.15.16:0/379682003 conn(0x7f598806aa40 msgr2=0x7f59880b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:08.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.562+0000 7f598fdff700 1 -- 172.21.15.16:0/379682003 shutdown_connections 2023-06-08T04:03:08.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.562+0000 7f598fdff700 1 -- 172.21.15.16:0/379682003 wait complete. 2023-06-08T04:03:08.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.564+0000 7f598fdff700 1 Processor -- start 2023-06-08T04:03:08.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.564+0000 7f598fdff700 1 -- start start 2023-06-08T04:03:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.565+0000 7f598fdff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5988070990 0x7f598814db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.565+0000 7f598fdff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5988159200 0x7f598814cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.565+0000 7f598fdff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f598815d660 0x7f59880c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.565+0000 7f598fdff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5988159dc0 con 0x7f5988070990 2023-06-08T04:03:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.565+0000 7f598fdff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59881597b0 con 0x7f5988159200 2023-06-08T04:03:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.565+0000 7f598fdff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59880c84a0 con 0x7f598815d660 2023-06-08T04:03:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.565+0000 7f598db9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5988070990 0x7f598814db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.565+0000 7f598db9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5988070990 0x7f598814db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53644/0 (socket says 172.21.15.16:53644) 2023-06-08T04:03:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.565+0000 7f598db9b700 1 -- 172.21.15.16:0/1352906242 learned_addr learned my addr 172.21.15.16:0/1352906242 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.565+0000 7f598e39c700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f598815d660 0x7f59880c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:08.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.565+0000 7f598d39a700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5988159200 0x7f598814cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:08.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.566+0000 7f598db9b700 1 -- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f598815d660 msgr2=0x7f59880c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.566+0000 7f598db9b700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f598815d660 0x7f59880c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.566+0000 7f598db9b700 1 -- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5988159200 msgr2=0x7f598814cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.566+0000 7f598db9b700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5988159200 0x7f598814cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.566+0000 7f598db9b700 1 -- 172.21.15.16:0/1352906242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59780094a0 con 0x7f5988070990 2023-06-08T04:03:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.566+0000 7f598db9b700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5988070990 0x7f598814db20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f598400c4e0 tx=0x7f598400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.566+0000 7f597e7fc700 1 -- 172.21.15.16:0/1352906242 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59840052d0 con 0x7f5988070990 2023-06-08T04:03:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.566+0000 7f597e7fc700 1 -- 172.21.15.16:0/1352906242 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5984005430 con 0x7f5988070990 2023-06-08T04:03:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.566+0000 7f597e7fc700 1 -- 172.21.15.16:0/1352906242 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59840038c0 con 0x7f5988070990 2023-06-08T04:03:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.566+0000 7f598fdff700 1 -- 172.21.15.16:0/1352906242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5988159a50 con 0x7f5988070990 2023-06-08T04:03:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.566+0000 7f598fdff700 1 -- 172.21.15.16:0/1352906242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598814d1c0 con 0x7f5988070990 2023-06-08T04:03:08.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.567+0000 7f598fdff700 1 -- 172.21.15.16:0/1352906242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59880740e0 con 0x7f5988070990 2023-06-08T04:03:08.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.568+0000 7f597e7fc700 1 -- 172.21.15.16:0/1352906242 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5984003a20 con 0x7f5988070990 2023-06-08T04:03:08.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.569+0000 7f597e7fc700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f596c06ace0 0x7f596c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:08.575 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.569+0000 7f597e7fc700 1 -- 172.21.15.16:0/1352906242 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5984088440 con 0x7f5988070990 2023-06-08T04:03:08.575 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.570+0000 7f598d39a700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f596c06ace0 0x7f596c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:08.575 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.570+0000 7f598d39a700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f596c06ace0 0x7f596c06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5988070d80 tx=0x7f5978008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.574+0000 7f597e7fc700 1 -- 172.21.15.16:0/1352906242 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59840538d0 con 0x7f5988070990 2023-06-08T04:03:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.781+0000 7f598fdff700 1 -- 172.21.15.16:0/1352906242 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f59880ae910 con 0x7f5988070990 2023-06-08T04:03:08.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.782+0000 7f597e7fc700 1 -- 172.21.15.16:0/1352906242 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5984056ef0 con 0x7f5988070990 2023-06-08T04:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2023-06-08T04:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2023-06-08T04:03:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": "rbd" 2023-06-08T04:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-06-08T04:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-06-08T04:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 2, 2023-06-08T04:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2023-06-08T04:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-06-08T04:03:08.787 INFO:teuthology.orchestra.run.smithi016.stdout:] 2023-06-08T04:03:08.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 -- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f596c06ace0 msgr2=0x7f596c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f596c06ace0 0x7f596c06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5988070d80 tx=0x7f5978008030 comp rx=0 tx=0).stop 2023-06-08T04:03:08.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 -- 172.21.15.16:0/1352906242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5988070990 msgr2=0x7f598814db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:08.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5988070990 0x7f598814db20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f598400c4e0 tx=0x7f598400c7f0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 -- 172.21.15.16:0/1352906242 shutdown_connections 2023-06-08T04:03:08.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f596c06ace0 0x7f596c06d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f598815d660 0x7f59880c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5988070990 0x7f598814db20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 --2- 172.21.15.16:0/1352906242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5988159200 0x7f598814cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:08.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 -- 172.21.15.16:0/1352906242 >> 172.21.15.16:0/1352906242 conn(0x7f598806aa40 msgr2=0x7f59880733a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:08.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 -- 172.21.15.16:0/1352906242 shutdown_connections 2023-06-08T04:03:08.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:08.784+0000 7f598fdff700 1 -- 172.21.15.16:0/1352906242 wait complete. 2023-06-08T04:03:08.805 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-08T04:03:08.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-08T04:03:09.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.008+0000 7feb18fff700 1 Processor -- start 2023-06-08T04:03:09.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.008+0000 7feb18fff700 1 -- start start 2023-06-08T04:03:09.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.009+0000 7feb18fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feb140b83f0 0x7feb14160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:09.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.009+0000 7feb18fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb140ced40 0x7feb140b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:09.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.009+0000 7feb18fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb140d0800 con 0x7feb140b4b50 2023-06-08T04:03:09.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.009+0000 7feb18fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140b4fd0 con 0x7feb140b83f0 2023-06-08T04:03:09.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.009+0000 7feb18fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb140cd1e0 con 0x7feb140ced40 2023-06-08T04:03:09.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.010+0000 7feb1259c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feb140b83f0 0x7feb14160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:09.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.010+0000 7feb1259c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feb140b83f0 0x7feb14160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53660/0 (socket says 172.21.15.16:53660) 2023-06-08T04:03:09.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.010+0000 7feb1259c700 1 -- 172.21.15.16:0/1419318536 learned_addr learned my addr 172.21.15.16:0/1419318536 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:09.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.010+0000 7feb0bfff700 1 --2- 172.21.15.16:0/1419318536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb140ced40 0x7feb140b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:09.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.010+0000 7feb1259c700 1 -- 172.21.15.16:0/1419318536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb140ced40 msgr2=0x7feb140b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:09.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.010+0000 7feb1259c700 1 --2- 172.21.15.16:0/1419318536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb140ced40 0x7feb140b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:09.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.010+0000 7feb1259c700 1 -- 172.21.15.16:0/1419318536 >> v1:172.21.15.16:6789/0 conn(0x7feb140b4b50 legacy=0x7feb1406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:09.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.010+0000 7feb1259c700 1 -- 172.21.15.16:0/1419318536 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb140cd4c0 con 0x7feb140b83f0 2023-06-08T04:03:09.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.010+0000 7feb11d9b700 1 -- 172.21.15.16:0/1419318536 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325371084 0 0) 0x7feb140d0800 con 0x7feb140b4b50 2023-06-08T04:03:09.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.011+0000 7feb1259c700 1 --2- 172.21.15.16:0/1419318536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb140b83f0 0x7feb14160a60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feb040098f0 tx=0x7feb04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80fafe11b8bb39e server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:09.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.011+0000 7feb11d9b700 1 -- 172.21.15.16:0/1419318536 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04011830 con 0x7feb140b83f0 2023-06-08T04:03:09.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.011+0000 7feb11d9b700 1 -- 172.21.15.16:0/1419318536 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb04011990 con 0x7feb140b83f0 2023-06-08T04:03:09.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.011+0000 7feb11d9b700 1 -- 172.21.15.16:0/1419318536 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04011d20 con 0x7feb140b83f0 2023-06-08T04:03:09.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.011+0000 7feb18fff700 1 -- 172.21.15.16:0/1419318536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb140b83f0 msgr2=0x7feb14160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:09.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.011+0000 7feb18fff700 1 --2- 172.21.15.16:0/1419318536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb140b83f0 0x7feb14160a60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feb040098f0 tx=0x7feb04009c00 comp rx=0 tx=0).stop 2023-06-08T04:03:09.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.011+0000 7feb18fff700 1 -- 172.21.15.16:0/1419318536 shutdown_connections 2023-06-08T04:03:09.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.011+0000 7feb18fff700 1 --2- 172.21.15.16:0/1419318536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb140b83f0 0x7feb14160a60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:09.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.011+0000 7feb18fff700 1 --2- 172.21.15.16:0/1419318536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb140ced40 0x7feb140b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:09.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.011+0000 7feb18fff700 1 -- 172.21.15.16:0/1419318536 >> 172.21.15.16:0/1419318536 conn(0x7feb140cf610 msgr2=0x7feb140cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:09.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.012+0000 7feb18fff700 1 -- 172.21.15.16:0/1419318536 shutdown_connections 2023-06-08T04:03:09.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.012+0000 7feb18fff700 1 -- 172.21.15.16:0/1419318536 wait complete. 2023-06-08T04:03:09.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.013+0000 7feb18fff700 1 Processor -- start 2023-06-08T04:03:09.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.013+0000 7feb18fff700 1 -- start start 2023-06-08T04:03:09.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.014+0000 7feb18fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb140b4b50 0x7feb1415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:09.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.014+0000 7feb18fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb140b83f0 0x7feb140cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:09.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.014+0000 7feb18fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb140ced40 0x7feb14159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:09.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.014+0000 7feb18fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1415d810 con 0x7feb140b83f0 2023-06-08T04:03:09.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.014+0000 7feb18fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb141e6720 con 0x7feb140b4b50 2023-06-08T04:03:09.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.014+0000 7feb18fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb140ccc60 con 0x7feb140ced40 2023-06-08T04:03:09.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.015+0000 7feb0bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb140b83f0 0x7feb140cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:09.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.015+0000 7feb0bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb140b83f0 0x7feb140cb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53672/0 (socket says 172.21.15.16:53672) 2023-06-08T04:03:09.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.015+0000 7feb0bfff700 1 -- 172.21.15.16:0/387518198 learned_addr learned my addr 172.21.15.16:0/387518198 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:09.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.015+0000 7feb1259c700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb140b4b50 0x7feb1415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:09.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.015+0000 7feb12d9d700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb140ced40 0x7feb14159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:09.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.015+0000 7feb0bfff700 1 -- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb140ced40 msgr2=0x7feb14159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:09.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.015+0000 7feb0bfff700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb140ced40 0x7feb14159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:09.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.015+0000 7feb0bfff700 1 -- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb140b4b50 msgr2=0x7feb1415d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:09.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.015+0000 7feb0bfff700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb140b4b50 0x7feb1415d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:09.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.015+0000 7feb0bfff700 1 -- 172.21.15.16:0/387518198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb04009550 con 0x7feb140b83f0 2023-06-08T04:03:09.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.015+0000 7feb0bfff700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb140b83f0 0x7feb140cb4c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feafc00e870 tx=0x7feafc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:09.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.016+0000 7feb0affd700 1 -- 172.21.15.16:0/387518198 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc009590 con 0x7feb140b83f0 2023-06-08T04:03:09.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.016+0000 7feb0affd700 1 -- 172.21.15.16:0/387518198 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc013680 con 0x7feb140b83f0 2023-06-08T04:03:09.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.016+0000 7feb18fff700 1 -- 172.21.15.16:0/387518198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1415f120 con 0x7feb140b83f0 2023-06-08T04:03:09.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.016+0000 7feb0affd700 1 -- 172.21.15.16:0/387518198 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc0139f0 con 0x7feb140b83f0 2023-06-08T04:03:09.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.016+0000 7feb18fff700 1 -- 172.21.15.16:0/387518198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1415f6a0 con 0x7feb140b83f0 2023-06-08T04:03:09.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.017+0000 7feb18fff700 1 -- 172.21.15.16:0/387518198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb140740e0 con 0x7feb140b83f0 2023-06-08T04:03:09.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.018+0000 7feb0affd700 1 -- 172.21.15.16:0/387518198 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feafc013b50 con 0x7feb140b83f0 2023-06-08T04:03:09.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.019+0000 7feb0affd700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7feaf406ace0 0x7feaf406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:09.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.019+0000 7feb0affd700 1 -- 172.21.15.16:0/387518198 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feafc088fb0 con 0x7feb140b83f0 2023-06-08T04:03:09.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.020+0000 7feb1259c700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7feaf406ace0 0x7feaf406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:09.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.020+0000 7feb1259c700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7feaf406ace0 0x7feaf406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feb04009c40 tx=0x7feb04008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:09.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.024+0000 7feb0affd700 1 -- 172.21.15.16:0/387518198 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feafc057e30 con 0x7feb140b83f0 2023-06-08T04:03:09.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:09.231+0000 7feb18fff700 1 -- 172.21.15.16:0/387518198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feb1406c170 con 0x7feb140b83f0 2023-06-08T04:03:10.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.043+0000 7feb0affd700 1 -- 172.21.15.16:0/387518198 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7feafc0170b0 con 0x7feb140b83f0 2023-06-08T04:03:10.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.048+0000 7feb18fff700 1 -- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7feaf406ace0 msgr2=0x7feaf406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:10.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.048+0000 7feb18fff700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7feaf406ace0 0x7feaf406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feb04009c40 tx=0x7feb04008030 comp rx=0 tx=0).stop 2023-06-08T04:03:10.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.048+0000 7feb18fff700 1 -- 172.21.15.16:0/387518198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb140b83f0 msgr2=0x7feb140cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:10.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.048+0000 7feb18fff700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb140b83f0 0x7feb140cb4c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feafc00e870 tx=0x7feafc00eb80 comp rx=0 tx=0).stop 2023-06-08T04:03:10.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.049+0000 7feb18fff700 1 -- 172.21.15.16:0/387518198 shutdown_connections 2023-06-08T04:03:10.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.049+0000 7feb18fff700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7feaf406ace0 0x7feaf406d190 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feb04009c40 tx=0x7feb04008030 comp rx=0 tx=0).stop 2023-06-08T04:03:10.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.049+0000 7feb18fff700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb140ced40 0x7feb14159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:10.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.049+0000 7feb18fff700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb140b4b50 0x7feb1415d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:10.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.049+0000 7feb18fff700 1 --2- 172.21.15.16:0/387518198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb140b83f0 0x7feb140cb4c0 secure :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feafc00e870 tx=0x7feafc00eb80 comp rx=0 tx=0).stop 2023-06-08T04:03:10.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.049+0000 7feb18fff700 1 -- 172.21.15.16:0/387518198 >> 172.21.15.16:0/387518198 conn(0x7feb140cf610 msgr2=0x7feb140b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:10.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.050+0000 7feb18fff700 1 -- 172.21.15.16:0/387518198 shutdown_connections 2023-06-08T04:03:10.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.051+0000 7feb18fff700 1 -- 172.21.15.16:0/387518198 wait complete. 2023-06-08T04:03:10.057 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2023-06-08T04:03:10.077 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-08T04:03:10.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.286+0000 7fbf89bff700 1 Processor -- start 2023-06-08T04:03:10.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.286+0000 7fbf89bff700 1 -- start start 2023-06-08T04:03:10.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.287+0000 7fbf89bff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbf840b83f0 0x7fbf84160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:10.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.287+0000 7fbf89bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf840b4d20 0x7fbf840d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:10.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.287+0000 7fbf89bff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf840d0800 con 0x7fbf840ced40 2023-06-08T04:03:10.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.287+0000 7fbf89bff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf840cd1e0 con 0x7fbf840b83f0 2023-06-08T04:03:10.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.287+0000 7fbf89bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840cd4c0 con 0x7fbf840b4d20 2023-06-08T04:03:10.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.288+0000 7fbf837fe700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbf840b83f0 0x7fbf84160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:10.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.288+0000 7fbf82ffd700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fbf840ced40 0x7fbf840b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:56230/0 (socket says 172.21.15.16:56230) 2023-06-08T04:03:10.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.288+0000 7fbf82ffd700 1 -- 172.21.15.16:0/844184876 learned_addr learned my addr 172.21.15.16:0/844184876 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:10.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.288+0000 7fbf83fff700 1 --2- 172.21.15.16:0/844184876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf840b4d20 0x7fbf840d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:10.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.288+0000 7fbf827fc700 1 -- 172.21.15.16:0/844184876 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501655929 0 0) 0x7fbf840d0800 con 0x7fbf840ced40 2023-06-08T04:03:10.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.288+0000 7fbf827fc700 1 -- 172.21.15.16:0/844184876 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf6c0035b0 con 0x7fbf840ced40 2023-06-08T04:03:10.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.288+0000 7fbf837fe700 1 -- 172.21.15.16:0/844184876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf840b4d20 msgr2=0x7fbf840d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:10.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.288+0000 7fbf837fe700 1 --2- 172.21.15.16:0/844184876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf840b4d20 0x7fbf840d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:10.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.288+0000 7fbf837fe700 1 -- 172.21.15.16:0/844184876 >> v1:172.21.15.169:6789/0 conn(0x7fbf840ced40 legacy=0x7fbf840b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:10.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.288+0000 7fbf837fe700 1 -- 172.21.15.16:0/844184876 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf840d0aa0 con 0x7fbf840b83f0 2023-06-08T04:03:10.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.288+0000 7fbf83fff700 1 --2- 172.21.15.16:0/844184876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf840b4d20 0x7fbf840d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:03:10.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.289+0000 7fbf837fe700 1 --2- 172.21.15.16:0/844184876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf840b83f0 0x7fbf84160a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009840 tx=0x7fbf74009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9913f141746d707 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:10.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.289+0000 7fbf827fc700 1 -- 172.21.15.16:0/844184876 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74011830 con 0x7fbf840b83f0 2023-06-08T04:03:10.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.289+0000 7fbf827fc700 1 -- 172.21.15.16:0/844184876 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf74011990 con 0x7fbf840b83f0 2023-06-08T04:03:10.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.289+0000 7fbf827fc700 1 -- 172.21.15.16:0/844184876 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74011d00 con 0x7fbf840b83f0 2023-06-08T04:03:10.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.289+0000 7fbf89bff700 1 -- 172.21.15.16:0/844184876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf840b83f0 msgr2=0x7fbf84160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:10.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.289+0000 7fbf89bff700 1 --2- 172.21.15.16:0/844184876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf840b83f0 0x7fbf84160a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009840 tx=0x7fbf74009b50 comp rx=0 tx=0).stop 2023-06-08T04:03:10.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.289+0000 7fbf89bff700 1 -- 172.21.15.16:0/844184876 shutdown_connections 2023-06-08T04:03:10.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.289+0000 7fbf89bff700 1 --2- 172.21.15.16:0/844184876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf840b83f0 0x7fbf84160a60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:10.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.289+0000 7fbf89bff700 1 --2- 172.21.15.16:0/844184876 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf840b4d20 0x7fbf840d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:10.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.289+0000 7fbf89bff700 1 -- 172.21.15.16:0/844184876 >> 172.21.15.16:0/844184876 conn(0x7fbf840cf610 msgr2=0x7fbf840cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:10.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.290+0000 7fbf89bff700 1 -- 172.21.15.16:0/844184876 shutdown_connections 2023-06-08T04:03:10.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.290+0000 7fbf89bff700 1 -- 172.21.15.16:0/844184876 wait complete. 2023-06-08T04:03:10.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.291+0000 7fbf89bff700 1 Processor -- start 2023-06-08T04:03:10.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.292+0000 7fbf89bff700 1 -- start start 2023-06-08T04:03:10.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf89bff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf840b4d20 0x7fbf841f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:10.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf89bff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf840b83f0 0x7fbf841f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:10.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf89bff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf840ced40 0x7fbf84144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:10.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf89bff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840cb260 con 0x7fbf840b4d20 2023-06-08T04:03:10.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf89bff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84152470 con 0x7fbf840b83f0 2023-06-08T04:03:10.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf89bff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840ca670 con 0x7fbf840ced40 2023-06-08T04:03:10.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf837fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf840b4d20 0x7fbf841f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:10.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf837fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf840b4d20 0x7fbf841f2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53684/0 (socket says 172.21.15.16:53684) 2023-06-08T04:03:10.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf837fe700 1 -- 172.21.15.16:0/3626073904 learned_addr learned my addr 172.21.15.16:0/3626073904 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:10.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf83fff700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf840ced40 0x7fbf84144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:10.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf82ffd700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf840b83f0 0x7fbf841f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:10.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf837fe700 1 -- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf840ced40 msgr2=0x7fbf84144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:10.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf837fe700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf840ced40 0x7fbf84144660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:10.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf837fe700 1 -- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf840b83f0 msgr2=0x7fbf841f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:10.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf837fe700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf840b83f0 0x7fbf841f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:10.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.293+0000 7fbf837fe700 1 -- 172.21.15.16:0/3626073904 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c009a70 con 0x7fbf840b4d20 2023-06-08T04:03:10.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.294+0000 7fbf837fe700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf840b4d20 0x7fbf841f2330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009b90 tx=0x7fbf74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:10.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.294+0000 7fbf6bfff700 1 -- 172.21.15.16:0/3626073904 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740045d0 con 0x7fbf840b4d20 2023-06-08T04:03:10.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.294+0000 7fbf6bfff700 1 -- 172.21.15.16:0/3626073904 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7401f070 con 0x7fbf840b4d20 2023-06-08T04:03:10.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.294+0000 7fbf6bfff700 1 -- 172.21.15.16:0/3626073904 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740038e0 con 0x7fbf840b4d20 2023-06-08T04:03:10.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.294+0000 7fbf89bff700 1 -- 172.21.15.16:0/3626073904 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf740094a0 con 0x7fbf840b4d20 2023-06-08T04:03:10.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.294+0000 7fbf89bff700 1 -- 172.21.15.16:0/3626073904 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf840caba0 con 0x7fbf840b4d20 2023-06-08T04:03:10.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.295+0000 7fbf89bff700 1 -- 172.21.15.16:0/3626073904 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf84066d50 con 0x7fbf840b4d20 2023-06-08T04:03:10.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.296+0000 7fbf6bfff700 1 -- 172.21.15.16:0/3626073904 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf74003a40 con 0x7fbf840b4d20 2023-06-08T04:03:10.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.297+0000 7fbf6bfff700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbf7006ace0 0x7fbf7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:10.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.297+0000 7fbf6bfff700 1 -- 172.21.15.16:0/3626073904 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fbf74021070 con 0x7fbf840b4d20 2023-06-08T04:03:10.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.298+0000 7fbf82ffd700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbf7006ace0 0x7fbf7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:10.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.298+0000 7fbf82ffd700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbf7006ace0 0x7fbf7006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf78007fd0 tx=0x7fbf78007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:10.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.302+0000 7fbf6bfff700 1 -- 172.21.15.16:0/3626073904 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbf74055bf0 con 0x7fbf840b4d20 2023-06-08T04:03:10.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:10.509+0000 7fbf89bff700 1 -- 172.21.15.16:0/3626073904 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbf840740e0 con 0x7fbf840b4d20 2023-06-08T04:03:11.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.050+0000 7fbf6bfff700 1 -- 172.21.15.16:0/3626073904 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbf74059210 con 0x7fbf840b4d20 2023-06-08T04:03:11.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.055+0000 7fbf89bff700 1 -- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbf7006ace0 msgr2=0x7fbf7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.055+0000 7fbf89bff700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbf7006ace0 0x7fbf7006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf78007fd0 tx=0x7fbf78007dc0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.055+0000 7fbf89bff700 1 -- 172.21.15.16:0/3626073904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf840b4d20 msgr2=0x7fbf841f2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.055+0000 7fbf89bff700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf840b4d20 0x7fbf841f2330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009b90 tx=0x7fbf74004750 comp rx=0 tx=0).stop 2023-06-08T04:03:11.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.056+0000 7fbf89bff700 1 -- 172.21.15.16:0/3626073904 shutdown_connections 2023-06-08T04:03:11.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.056+0000 7fbf89bff700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fbf7006ace0 0x7fbf7006d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.056+0000 7fbf89bff700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf840ced40 0x7fbf84144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.056+0000 7fbf89bff700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf840b4d20 0x7fbf841f2330 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.056+0000 7fbf89bff700 1 --2- 172.21.15.16:0/3626073904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf840b83f0 0x7fbf841f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.056+0000 7fbf89bff700 1 -- 172.21.15.16:0/3626073904 >> 172.21.15.16:0/3626073904 conn(0x7fbf840cf610 msgr2=0x7fbf840b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:11.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.061+0000 7fbf89bff700 1 -- 172.21.15.16:0/3626073904 shutdown_connections 2023-06-08T04:03:11.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.062+0000 7fbf89bff700 1 -- 172.21.15.16:0/3626073904 wait complete. 2023-06-08T04:03:11.072 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2023-06-08T04:03:11.093 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-08T04:03:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.295+0000 7f534dbff700 1 Processor -- start 2023-06-08T04:03:11.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.295+0000 7f534dbff700 1 -- start start 2023-06-08T04:03:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.296+0000 7f534dbff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5348160a60 0x7f53480b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.296+0000 7f534dbff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f53480b4b50 0x7f53480d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.296+0000 7f534dbff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53480d0800 con 0x7f53480b83f0 2023-06-08T04:03:11.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.296+0000 7f534dbff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5348160ed0 con 0x7f5348160a60 2023-06-08T04:03:11.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.296+0000 7f534dbff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53480b4fd0 con 0x7f53480b4b50 2023-06-08T04:03:11.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.296+0000 7f5346ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5348160a60 0x7f53480b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.296+0000 7f5346ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5348160a60 0x7f53480b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53698/0 (socket says 172.21.15.16:53698) 2023-06-08T04:03:11.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.296+0000 7f5346ffd700 1 -- 172.21.15.16:0/2542997516 learned_addr learned my addr 172.21.15.16:0/2542997516 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:11.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.296+0000 7f5347fff700 1 --2- 172.21.15.16:0/2542997516 >> v2:172.21.15.169:3300/0 conn(0x7f53480b4b50 0x7f53480d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.297+0000 7f5346ffd700 1 -- 172.21.15.16:0/2542997516 >> v2:172.21.15.169:3300/0 conn(0x7f53480b4b50 msgr2=0x7f53480d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:11.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.297+0000 7f5346ffd700 1 --2- 172.21.15.16:0/2542997516 >> v2:172.21.15.169:3300/0 conn(0x7f53480b4b50 0x7f53480d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.297+0000 7f5346ffd700 1 -- 172.21.15.16:0/2542997516 >> v1:172.21.15.169:6789/0 conn(0x7f53480b83f0 legacy=0x7f53480ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.297+0000 7f5346ffd700 1 -- 172.21.15.16:0/2542997516 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480cd1e0 con 0x7f5348160a60 2023-06-08T04:03:11.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.297+0000 7f5346ffd700 1 --2- 172.21.15.16:0/2542997516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5348160a60 0x7f53480b4610 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f53480b2590 tx=0x7f533c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c2bcc57ee3f46f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:11.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.297+0000 7f53467fc700 1 -- 172.21.15.16:0/2542997516 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c011830 con 0x7f5348160a60 2023-06-08T04:03:11.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.297+0000 7f53467fc700 1 -- 172.21.15.16:0/2542997516 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c011990 con 0x7f5348160a60 2023-06-08T04:03:11.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.297+0000 7f53467fc700 1 -- 172.21.15.16:0/2542997516 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c011d20 con 0x7f5348160a60 2023-06-08T04:03:11.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.298+0000 7f534dbff700 1 -- 172.21.15.16:0/2542997516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5348160a60 msgr2=0x7f53480b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.298+0000 7f534dbff700 1 --2- 172.21.15.16:0/2542997516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5348160a60 0x7f53480b4610 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f53480b2590 tx=0x7f533c009bd0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.298+0000 7f534dbff700 1 -- 172.21.15.16:0/2542997516 shutdown_connections 2023-06-08T04:03:11.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.298+0000 7f534dbff700 1 --2- 172.21.15.16:0/2542997516 >> v2:172.21.15.169:3300/0 conn(0x7f53480b4b50 0x7f53480d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.298+0000 7f534dbff700 1 --2- 172.21.15.16:0/2542997516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5348160a60 0x7f53480b4610 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.298+0000 7f534dbff700 1 -- 172.21.15.16:0/2542997516 >> 172.21.15.16:0/2542997516 conn(0x7f53480cf610 msgr2=0x7f53480cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:11.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.298+0000 7f534dbff700 1 -- 172.21.15.16:0/2542997516 shutdown_connections 2023-06-08T04:03:11.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.298+0000 7f534dbff700 1 -- 172.21.15.16:0/2542997516 wait complete. 2023-06-08T04:03:11.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.300+0000 7f534dbff700 1 Processor -- start 2023-06-08T04:03:11.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.300+0000 7f534dbff700 1 -- start start 2023-06-08T04:03:11.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.301+0000 7f534dbff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53480b4b50 0x7f53480c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.301+0000 7f534dbff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53480b83f0 0x7f534814ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.301+0000 7f534dbff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5348160a60 0x7f534814f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.301+0000 7f534dbff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53480ca410 con 0x7f5348160a60 2023-06-08T04:03:11.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.301+0000 7f534dbff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53480c93f0 con 0x7f53480b83f0 2023-06-08T04:03:11.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.301+0000 7f534dbff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53480c96d0 con 0x7f53480b4b50 2023-06-08T04:03:11.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.301+0000 7f5347fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5348160a60 0x7f534814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.301+0000 7f5347fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5348160a60 0x7f534814f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:53702/0 (socket says 172.21.15.16:53702) 2023-06-08T04:03:11.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.301+0000 7f5347fff700 1 -- 172.21.15.16:0/2472898718 learned_addr learned my addr 172.21.15.16:0/2472898718 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:11.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.301+0000 7f53477fe700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53480b4b50 0x7f53480c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.301+0000 7f5346ffd700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53480b83f0 0x7f534814ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.302+0000 7f5347fff700 1 -- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53480b4b50 msgr2=0x7f53480c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.302+0000 7f5347fff700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53480b4b50 0x7f53480c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.302+0000 7f5347fff700 1 -- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53480b83f0 msgr2=0x7f534814ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.302+0000 7f5347fff700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53480b83f0 0x7f534814ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.302+0000 7f5347fff700 1 -- 172.21.15.16:0/2472898718 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c009550 con 0x7f5348160a60 2023-06-08T04:03:11.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.302+0000 7f5347fff700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5348160a60 0x7f534814f190 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f534000efc0 tx=0x7f534000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:11.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.302+0000 7f532ffff700 1 -- 172.21.15.16:0/2472898718 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340009ea0 con 0x7f5348160a60 2023-06-08T04:03:11.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.302+0000 7f532ffff700 1 -- 172.21.15.16:0/2472898718 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534000f040 con 0x7f5348160a60 2023-06-08T04:03:11.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.302+0000 7f532ffff700 1 -- 172.21.15.16:0/2472898718 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000ced0 con 0x7f5348160a60 2023-06-08T04:03:11.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.302+0000 7f534dbff700 1 -- 172.21.15.16:0/2472898718 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53480c99b0 con 0x7f5348160a60 2023-06-08T04:03:11.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.302+0000 7f534dbff700 1 -- 172.21.15.16:0/2472898718 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53480c6c70 con 0x7f5348160a60 2023-06-08T04:03:11.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.303+0000 7f534dbff700 1 -- 172.21.15.16:0/2472898718 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53480c6e60 con 0x7f5348160a60 2023-06-08T04:03:11.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.306+0000 7f532ffff700 1 -- 172.21.15.16:0/2472898718 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5340014480 con 0x7f5348160a60 2023-06-08T04:03:11.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.307+0000 7f532ffff700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f533406ace0 0x7f533406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.307+0000 7f532ffff700 1 -- 172.21.15.16:0/2472898718 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f534008a450 con 0x7f5348160a60 2023-06-08T04:03:11.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.307+0000 7f53477fe700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f533406ace0 0x7f533406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.308+0000 7f53477fe700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f533406ace0 0x7f533406d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5338007fd0 tx=0x7f5338009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:11.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.310+0000 7f532ffff700 1 -- 172.21.15.16:0/2472898718 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5340055540 con 0x7f5348160a60 2023-06-08T04:03:11.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.562+0000 7f534dbff700 1 -- 172.21.15.16:0/2472898718 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f53480740e0 con 0x7f5348160a60 2023-06-08T04:03:11.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.574+0000 7f532ffff700 1 -- 172.21.15.16:0/2472898718 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5340058b60 con 0x7f5348160a60 2023-06-08T04:03:11.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.586+0000 7f534dbff700 1 -- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f533406ace0 msgr2=0x7f533406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.589 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.586+0000 7f534dbff700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f533406ace0 0x7f533406d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5338007fd0 tx=0x7f5338009040 comp rx=0 tx=0).stop 2023-06-08T04:03:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.586+0000 7f534dbff700 1 -- 172.21.15.16:0/2472898718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5348160a60 msgr2=0x7f534814f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.586+0000 7f534dbff700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5348160a60 0x7f534814f190 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f534000efc0 tx=0x7f534000c3a0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.587+0000 7f534dbff700 1 -- 172.21.15.16:0/2472898718 shutdown_connections 2023-06-08T04:03:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.587+0000 7f534dbff700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f533406ace0 0x7f533406d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.587+0000 7f534dbff700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5348160a60 0x7f534814f190 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.587+0000 7f534dbff700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53480b4b50 0x7f53480c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.587+0000 7f534dbff700 1 --2- 172.21.15.16:0/2472898718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53480b83f0 0x7f534814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.587+0000 7f534dbff700 1 -- 172.21.15.16:0/2472898718 >> 172.21.15.16:0/2472898718 conn(0x7f53480cf610 msgr2=0x7f53480cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:11.592 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.588+0000 7f534dbff700 1 -- 172.21.15.16:0/2472898718 shutdown_connections 2023-06-08T04:03:11.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.589+0000 7f534dbff700 1 -- 172.21.15.16:0/2472898718 wait complete. 2023-06-08T04:03:11.602 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 5 and data pool 6 2023-06-08T04:03:11.618 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:03:11.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.816+0000 7f97fc5ff700 1 Processor -- start 2023-06-08T04:03:11.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.816+0000 7f97fc5ff700 1 -- start start 2023-06-08T04:03:11.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.817+0000 7f97fc5ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f97f40b83f0 0x7f97f4160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.817+0000 7f97fc5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40ced40 0x7f97f40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.817+0000 7f97fc5ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f40d0800 con 0x7f97f40b4b50 2023-06-08T04:03:11.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.817+0000 7f97fc5ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f40b4fd0 con 0x7f97f40b83f0 2023-06-08T04:03:11.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.817+0000 7f97fc5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40cd1e0 con 0x7f97f40ced40 2023-06-08T04:03:11.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.818+0000 7f97fa39b700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f97f40b83f0 0x7f97f4160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.818+0000 7f97f9b9a700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40ced40 0x7f97f40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.818+0000 7f97f9b9a700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40ced40 0x7f97f40b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:54612/0 (socket says 172.21.15.16:54612) 2023-06-08T04:03:11.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.818+0000 7f97fab9c700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f97f40b4b50 0x7f97f406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:56252/0 (socket says 172.21.15.16:56252) 2023-06-08T04:03:11.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.818+0000 7f97f9b9a700 1 -- 172.21.15.16:0/1485386160 learned_addr learned my addr 172.21.15.16:0/1485386160 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:11.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.818+0000 7f97f9b9a700 1 -- 172.21.15.16:0/1485386160 >> v2:172.21.15.169:3300/0 conn(0x7f97f40b83f0 msgr2=0x7f97f4160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:11.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.818+0000 7f97f9b9a700 1 --2- 172.21.15.16:0/1485386160 >> v2:172.21.15.169:3300/0 conn(0x7f97f40b83f0 0x7f97f4160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.818+0000 7f97f9b9a700 1 -- 172.21.15.16:0/1485386160 >> v1:172.21.15.169:6789/0 conn(0x7f97f40b4b50 legacy=0x7f97f406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.818+0000 7f97f9b9a700 1 -- 172.21.15.16:0/1485386160 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40cd4c0 con 0x7f97f40ced40 2023-06-08T04:03:11.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.818+0000 7f97fa39b700 1 --2- 172.21.15.16:0/1485386160 >> v2:172.21.15.169:3300/0 conn(0x7f97f40b83f0 0x7f97f4160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:03:11.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.819+0000 7f97f9b9a700 1 --2- 172.21.15.16:0/1485386160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40ced40 0x7f97f40b4610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97e40098f0 tx=0x7f97e4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2e200de5bc8e07f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:11.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.819+0000 7f97f9399700 1 -- 172.21.15.16:0/1485386160 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4011830 con 0x7f97f40ced40 2023-06-08T04:03:11.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.819+0000 7f97f9399700 1 -- 172.21.15.16:0/1485386160 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e4011990 con 0x7f97f40ced40 2023-06-08T04:03:11.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.819+0000 7f97f9399700 1 -- 172.21.15.16:0/1485386160 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4011d20 con 0x7f97f40ced40 2023-06-08T04:03:11.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.820+0000 7f97fc5ff700 1 -- 172.21.15.16:0/1485386160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40ced40 msgr2=0x7f97f40b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.820+0000 7f97fc5ff700 1 --2- 172.21.15.16:0/1485386160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40ced40 0x7f97f40b4610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97e40098f0 tx=0x7f97e4009c00 comp rx=0 tx=0).stop 2023-06-08T04:03:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.820+0000 7f97fc5ff700 1 -- 172.21.15.16:0/1485386160 shutdown_connections 2023-06-08T04:03:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.820+0000 7f97fc5ff700 1 --2- 172.21.15.16:0/1485386160 >> v2:172.21.15.169:3300/0 conn(0x7f97f40b83f0 0x7f97f4160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.820+0000 7f97fc5ff700 1 --2- 172.21.15.16:0/1485386160 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40ced40 0x7f97f40b4610 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.820+0000 7f97fc5ff700 1 -- 172.21.15.16:0/1485386160 >> 172.21.15.16:0/1485386160 conn(0x7f97f40cf610 msgr2=0x7f97f40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.820+0000 7f97fc5ff700 1 -- 172.21.15.16:0/1485386160 shutdown_connections 2023-06-08T04:03:11.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.820+0000 7f97fc5ff700 1 -- 172.21.15.16:0/1485386160 wait complete. 2023-06-08T04:03:11.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.822+0000 7f97fc5ff700 1 Processor -- start 2023-06-08T04:03:11.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.822+0000 7f97fc5ff700 1 -- start start 2023-06-08T04:03:11.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.823+0000 7f97fc5ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40b4b50 0x7f97f41f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.823+0000 7f97fc5ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97f40b83f0 0x7f97f415e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.823+0000 7f97fc5ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f40ced40 0x7f97f41571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.823+0000 7f97fc5ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40b3550 con 0x7f97f40ced40 2023-06-08T04:03:11.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.823+0000 7f97fc5ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f41f4e40 con 0x7f97f40b83f0 2023-06-08T04:03:11.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.823+0000 7f97fc5ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40b29d0 con 0x7f97f40b4b50 2023-06-08T04:03:11.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.823+0000 7f97f9b9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97f40b83f0 0x7f97f415e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.823+0000 7f97fa39b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40b4b50 0x7f97f41f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97fab9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f40ced40 0x7f97f41571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97fa39b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40b4b50 0x7f97f41f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:54618/0 (socket says 172.21.15.16:54618) 2023-06-08T04:03:11.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97f9b9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97f40b83f0 0x7f97f415e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:38276/0 (socket says 172.21.15.16:38276) 2023-06-08T04:03:11.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97fa39b700 1 -- 172.21.15.16:0/3600821867 learned_addr learned my addr 172.21.15.16:0/3600821867 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:11.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97fab9c700 1 -- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40b4b50 msgr2=0x7f97f41f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97fab9c700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40b4b50 0x7f97f41f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97fab9c700 1 -- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97f40b83f0 msgr2=0x7f97f415e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:11.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97fab9c700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97f40b83f0 0x7f97f415e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:11.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97fab9c700 1 -- 172.21.15.16:0/3600821867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00094a0 con 0x7f97f40ced40 2023-06-08T04:03:11.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97fab9c700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f40ced40 0x7f97f41571d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00cb40 tx=0x7f97ec00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:11.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97eaffd700 1 -- 172.21.15.16:0/3600821867 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00a9a0 con 0x7f97f40ced40 2023-06-08T04:03:11.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97eaffd700 1 -- 172.21.15.16:0/3600821867 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec00ab00 con 0x7f97f40ced40 2023-06-08T04:03:11.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97eaffd700 1 -- 172.21.15.16:0/3600821867 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00ae70 con 0x7f97f40ced40 2023-06-08T04:03:11.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.824+0000 7f97fc5ff700 1 -- 172.21.15.16:0/3600821867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e4009550 con 0x7f97f40ced40 2023-06-08T04:03:11.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.825+0000 7f97fc5ff700 1 -- 172.21.15.16:0/3600821867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f40b2f90 con 0x7f97f40ced40 2023-06-08T04:03:11.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.826+0000 7f97fc5ff700 1 -- 172.21.15.16:0/3600821867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f40740e0 con 0x7f97f40ced40 2023-06-08T04:03:11.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.827+0000 7f97eaffd700 1 -- 172.21.15.16:0/3600821867 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97ec007070 con 0x7f97f40ced40 2023-06-08T04:03:11.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.828+0000 7f97eaffd700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f97d806ace0 0x7f97d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:11.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.828+0000 7f97eaffd700 1 -- 172.21.15.16:0/3600821867 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97ec088ff0 con 0x7f97f40ced40 2023-06-08T04:03:11.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.828+0000 7f97fa39b700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f97d806ace0 0x7f97d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:11.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.829+0000 7f97fa39b700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f97d806ace0 0x7f97d806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009e70 tx=0x7f97f0009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:11.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:11.832+0000 7f97eaffd700 1 -- 172.21.15.16:0/3600821867 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f97ec0541a0 con 0x7f97f40ced40 2023-06-08T04:03:12.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.037+0000 7f97fc5ff700 1 -- 172.21.15.16:0/3600821867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97f406a220 con 0x7f97f40ced40 2023-06-08T04:03:12.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.038+0000 7f97eaffd700 1 -- 172.21.15.16:0/3600821867 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f97ec017090 con 0x7f97f40ced40 2023-06-08T04:03:12.043 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:12.043 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":34,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:03:11.563394+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:03:09.272435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-08T04:03:10.551045+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:03:12.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 -- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f97d806ace0 msgr2=0x7f97d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f97d806ace0 0x7f97d806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009e70 tx=0x7f97f0009210 comp rx=0 tx=0).stop 2023-06-08T04:03:12.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 -- 172.21.15.16:0/3600821867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f40ced40 msgr2=0x7f97f41571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f40ced40 0x7f97f41571d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00cb40 tx=0x7f97ec00ce50 comp rx=0 tx=0).stop 2023-06-08T04:03:12.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 -- 172.21.15.16:0/3600821867 shutdown_connections 2023-06-08T04:03:12.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f97d806ace0 0x7f97d806d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f40ced40 0x7f97f41571d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f97f40b4b50 0x7f97f41f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 --2- 172.21.15.16:0/3600821867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97f40b83f0 0x7f97f415e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 -- 172.21.15.16:0/3600821867 >> 172.21.15.16:0/3600821867 conn(0x7f97f40cf610 msgr2=0x7f97f40d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:12.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 -- 172.21.15.16:0/3600821867 shutdown_connections 2023-06-08T04:03:12.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.041+0000 7f97fc5ff700 1 -- 172.21.15.16:0/3600821867 wait complete. 2023-06-08T04:03:12.063 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:03:12.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.258+0000 7fb13cfff700 1 Processor -- start 2023-06-08T04:03:12.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.258+0000 7fb13cfff700 1 -- start start 2023-06-08T04:03:12.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.259+0000 7fb13cfff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1380b4d20 0x7fb138167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.259+0000 7fb13cfff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1380d0800 con 0x7fb1380b83f0 2023-06-08T04:03:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.260+0000 7fb13cfff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1380cd1e0 con 0x7fb138160a60 2023-06-08T04:03:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.260+0000 7fb13cfff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb138160ed0 con 0x7fb1380b4d20 2023-06-08T04:03:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.260+0000 7fb13659c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb1380b83f0 0x7fb1380ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51080/0 (socket says 172.21.15.16:51080) 2023-06-08T04:03:12.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.260+0000 7fb13659c700 1 -- 172.21.15.16:0/707433922 learned_addr learned my addr 172.21.15.16:0/707433922 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:12.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.260+0000 7fb136d9d700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1380b4d20 0x7fb138167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.260+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790984911 0 0) 0x7fb1380d0800 con 0x7fb1380b83f0 2023-06-08T04:03:12.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.260+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1200035b0 con 0x7fb1380b83f0 2023-06-08T04:03:12.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.260+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1706072951 0 0) 0x7fb1200035b0 con 0x7fb1380b83f0 2023-06-08T04:03:12.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.260+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1380b4d20 msgr2=0x7fb138167260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:12.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.260+0000 7fb13559a700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1380b4d20 0x7fb138167260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 >> v1:172.21.15.169:6789/0 conn(0x7fb138160a60 legacy=0x7fb1380b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1380cd4c0 con 0x7fb1380b83f0 2023-06-08T04:03:12.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7fb128001670 con 0x7fb1380b83f0 2023-06-08T04:03:12.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 >> v1:172.21.15.16:6789/0 conn(0x7fb1380b83f0 legacy=0x7fb1380ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb13559a700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1380b4d20 0x7fb120003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb13559a700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb120003fb0 0x7fb120004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb13559a700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb120004d90 0x7fb120005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12000bba0 con 0x7fb120003fb0 2023-06-08T04:03:12.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12000bce0 con 0x7fb120004d90 2023-06-08T04:03:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12000bea0 con 0x7fb1380b4d20 2023-06-08T04:03:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb135d9b700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb120003fb0 0x7fb120004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb13659c700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1380b4d20 0x7fb120003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb136d9d700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb120004d90 0x7fb120005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb135d9b700 1 -- 172.21.15.16:0/707433922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1380b4d20 msgr2=0x7fb120003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb135d9b700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1380b4d20 0x7fb120003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb135d9b700 1 -- 172.21.15.16:0/707433922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb120004d90 msgr2=0x7fb120005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:12.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb135d9b700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb120004d90 0x7fb120005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.261+0000 7fb135d9b700 1 -- 172.21.15.16:0/707433922 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1200035b0 con 0x7fb120003fb0 2023-06-08T04:03:12.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.262+0000 7fb135d9b700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb120003fb0 0x7fb120004850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb12c007fd0 tx=0x7fb120005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e54850b6497258 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:12.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.262+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0052d0 con 0x7fb120003fb0 2023-06-08T04:03:12.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.262+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c005470 con 0x7fb120003fb0 2023-06-08T04:03:12.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.262+0000 7fb13559a700 1 -- 172.21.15.16:0/707433922 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0038c0 con 0x7fb120003fb0 2023-06-08T04:03:12.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.262+0000 7fb13cfff700 1 -- 172.21.15.16:0/707433922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb120003fb0 msgr2=0x7fb120004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.262+0000 7fb13cfff700 1 --2- 172.21.15.16:0/707433922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb120003fb0 0x7fb120004850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb12c007fd0 tx=0x7fb120005880 comp rx=0 tx=0).stop 2023-06-08T04:03:12.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.262+0000 7fb136d9d700 1 -- 172.21.15.16:0/707433922 reap_dead start 2023-06-08T04:03:12.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.263+0000 7fb13cfff700 1 -- 172.21.15.16:0/707433922 shutdown_connections 2023-06-08T04:03:12.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.263+0000 7fb13cfff700 1 -- 172.21.15.16:0/707433922 >> 172.21.15.16:0/707433922 conn(0x7fb1380cf610 msgr2=0x7fb1380cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:12.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.263+0000 7fb13cfff700 1 -- 172.21.15.16:0/707433922 shutdown_connections 2023-06-08T04:03:12.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.263+0000 7fb13cfff700 1 -- 172.21.15.16:0/707433922 wait complete. 2023-06-08T04:03:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.264+0000 7fb13cfff700 1 Processor -- start 2023-06-08T04:03:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.265+0000 7fb13cfff700 1 -- start start 2023-06-08T04:03:12.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb13cfff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb120003fb0 0x7fb1380c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb13cfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c9c60 0x7fb138159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb13cfff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb13815d8b0 0x7fb13815dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb13cfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1381e7870 con 0x7fb1380c9c60 2023-06-08T04:03:12.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb13cfff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1381e6c30 con 0x7fb13815d8b0 2023-06-08T04:03:12.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb13cfff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1381e6ed0 con 0x7fb120003fb0 2023-06-08T04:03:12.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb135d9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c9c60 0x7fb138159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb135d9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c9c60 0x7fb138159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37656/0 (socket says 172.21.15.16:37656) 2023-06-08T04:03:12.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb135d9b700 1 -- 172.21.15.16:0/2309255786 learned_addr learned my addr 172.21.15.16:0/2309255786 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:12.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb13659c700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb120003fb0 0x7fb1380c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb136d9d700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb13815d8b0 0x7fb13815dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb135d9b700 1 -- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb120003fb0 msgr2=0x7fb1380c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb135d9b700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb120003fb0 0x7fb1380c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb135d9b700 1 -- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb13815d8b0 msgr2=0x7fb13815dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb135d9b700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb13815d8b0 0x7fb13815dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.266+0000 7fb135d9b700 1 -- 172.21.15.16:0/2309255786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1381e71b0 con 0x7fb1380c9c60 2023-06-08T04:03:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.267+0000 7fb135d9b700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c9c60 0x7fb138159670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb12c004000 tx=0x7fb12c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.267+0000 7fb126ffd700 1 -- 172.21.15.16:0/2309255786 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c007240 con 0x7fb1380c9c60 2023-06-08T04:03:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.267+0000 7fb126ffd700 1 -- 172.21.15.16:0/2309255786 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c0073a0 con 0x7fb1380c9c60 2023-06-08T04:03:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.267+0000 7fb126ffd700 1 -- 172.21.15.16:0/2309255786 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c001290 con 0x7fb1380c9c60 2023-06-08T04:03:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.267+0000 7fb13cfff700 1 -- 172.21.15.16:0/2309255786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1381e7490 con 0x7fb1380c9c60 2023-06-08T04:03:12.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.267+0000 7fb13cfff700 1 -- 172.21.15.16:0/2309255786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1380ca0d0 con 0x7fb1380c9c60 2023-06-08T04:03:12.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.268+0000 7fb13cfff700 1 -- 172.21.15.16:0/2309255786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1381e79b0 con 0x7fb1380c9c60 2023-06-08T04:03:12.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.269+0000 7fb126ffd700 1 -- 172.21.15.16:0/2309255786 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb12c003680 con 0x7fb1380c9c60 2023-06-08T04:03:12.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.270+0000 7fb126ffd700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb11806ace0 0x7fb11806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.270+0000 7fb126ffd700 1 -- 172.21.15.16:0/2309255786 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb12c089f20 con 0x7fb1380c9c60 2023-06-08T04:03:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.270+0000 7fb13659c700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb11806ace0 0x7fb11806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.271+0000 7fb13659c700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb11806ace0 0x7fb11806d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb128001050 tx=0x7fb128000fe0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:12.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.275+0000 7fb126ffd700 1 -- 172.21.15.16:0/2309255786 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb1381e79b0 con 0x7fb1380c9c60 2023-06-08T04:03:12.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.480+0000 7fb13cfff700 1 -- 172.21.15.16:0/2309255786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1381e79b0 con 0x7fb1380c9c60 2023-06-08T04:03:12.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.481+0000 7fb126ffd700 1 -- 172.21.15.16:0/2309255786 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18282 (secure 0 0 0) 0x7fb1381e79b0 con 0x7fb1380c9c60 2023-06-08T04:03:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:12.485 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":34,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:03:11.563394+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:03:09.272435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-08T04:03:10.551045+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:03:12.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.483+0000 7fb13cfff700 1 -- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb11806ace0 msgr2=0x7fb11806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.483+0000 7fb13cfff700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb11806ace0 0x7fb11806d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb128001050 tx=0x7fb128000fe0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.483+0000 7fb13cfff700 1 -- 172.21.15.16:0/2309255786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c9c60 msgr2=0x7fb138159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.483+0000 7fb13cfff700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c9c60 0x7fb138159670 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb12c004000 tx=0x7fb12c001120 comp rx=0 tx=0).stop 2023-06-08T04:03:12.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.483+0000 7fb13cfff700 1 -- 172.21.15.16:0/2309255786 shutdown_connections 2023-06-08T04:03:12.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.483+0000 7fb13cfff700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb11806ace0 0x7fb11806d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.483+0000 7fb13cfff700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb13815d8b0 0x7fb13815dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.483+0000 7fb13cfff700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb120003fb0 0x7fb1380c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.483+0000 7fb13cfff700 1 --2- 172.21.15.16:0/2309255786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1380c9c60 0x7fb138159670 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.483+0000 7fb13cfff700 1 -- 172.21.15.16:0/2309255786 >> 172.21.15.16:0/2309255786 conn(0x7fb1380cf610 msgr2=0x7fb13806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:12.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.483+0000 7fb13cfff700 1 -- 172.21.15.16:0/2309255786 shutdown_connections 2023-06-08T04:03:12.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.484+0000 7fb13cfff700 1 -- 172.21.15.16:0/2309255786 wait complete. 2023-06-08T04:03:12.505 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-08T04:03:12.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.706+0000 7fea2f7ff700 1 Processor -- start 2023-06-08T04:03:12.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.706+0000 7fea2f7ff700 1 -- start start 2023-06-08T04:03:12.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.707+0000 7fea2f7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea28160a60 0x7fea280b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.707+0000 7fea2f7ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea280b4b50 0x7fea280d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.707+0000 7fea2f7ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea280d0800 con 0x7fea280b83f0 2023-06-08T04:03:12.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.707+0000 7fea2f7ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea28160ed0 con 0x7fea280b4b50 2023-06-08T04:03:12.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.707+0000 7fea2f7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea280b4fd0 con 0x7fea28160a60 2023-06-08T04:03:12.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.707+0000 7fea2dd9c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea280b4b50 0x7fea280d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.707+0000 7fea2d59b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fea280b83f0 0x7fea280ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51094/0 (socket says 172.21.15.16:51094) 2023-06-08T04:03:12.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.707+0000 7fea2d59b700 1 -- 172.21.15.16:0/1644871631 learned_addr learned my addr 172.21.15.16:0/1644871631 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:12.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.708+0000 7fea2cd9a700 1 --2- 172.21.15.16:0/1644871631 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea28160a60 0x7fea280b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.708+0000 7fea2dd9c700 1 -- 172.21.15.16:0/1644871631 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea28160a60 msgr2=0x7fea280b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:12.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.708+0000 7fea2dd9c700 1 --2- 172.21.15.16:0/1644871631 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea28160a60 0x7fea280b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.708+0000 7fea2dd9c700 1 -- 172.21.15.16:0/1644871631 >> v1:172.21.15.16:6789/0 conn(0x7fea280b83f0 legacy=0x7fea280ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.708+0000 7fea2dd9c700 1 -- 172.21.15.16:0/1644871631 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea280cd1e0 con 0x7fea280b4b50 2023-06-08T04:03:12.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.708+0000 7fea2cd9a700 1 --2- 172.21.15.16:0/1644871631 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea28160a60 0x7fea280b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:03:12.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.708+0000 7fea1ffff700 1 -- 172.21.15.16:0/1644871631 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690618288 0 0) 0x7fea280d0800 con 0x7fea280b83f0 2023-06-08T04:03:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.708+0000 7fea2dd9c700 1 --2- 172.21.15.16:0/1644871631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea280b4b50 0x7fea280d0fc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea20009d90 tx=0x7fea2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7470fc9f79f0644a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.708+0000 7fea1ffff700 1 -- 172.21.15.16:0/1644871631 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000e070 con 0x7fea280b4b50 2023-06-08T04:03:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.708+0000 7fea1ffff700 1 -- 172.21.15.16:0/1644871631 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2000bbd0 con 0x7fea280b4b50 2023-06-08T04:03:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.708+0000 7fea1ffff700 1 -- 172.21.15.16:0/1644871631 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20012430 con 0x7fea280b4b50 2023-06-08T04:03:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.709+0000 7fea2f7ff700 1 -- 172.21.15.16:0/1644871631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea280b4b50 msgr2=0x7fea280d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.709+0000 7fea2f7ff700 1 --2- 172.21.15.16:0/1644871631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea280b4b50 0x7fea280d0fc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea20009d90 tx=0x7fea2000b330 comp rx=0 tx=0).stop 2023-06-08T04:03:12.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.709+0000 7fea2f7ff700 1 -- 172.21.15.16:0/1644871631 shutdown_connections 2023-06-08T04:03:12.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.709+0000 7fea2f7ff700 1 --2- 172.21.15.16:0/1644871631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea280b4b50 0x7fea280d0fc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.709+0000 7fea2f7ff700 1 --2- 172.21.15.16:0/1644871631 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea28160a60 0x7fea280b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.709+0000 7fea2f7ff700 1 -- 172.21.15.16:0/1644871631 >> 172.21.15.16:0/1644871631 conn(0x7fea280cf610 msgr2=0x7fea280cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:12.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.709+0000 7fea2f7ff700 1 -- 172.21.15.16:0/1644871631 shutdown_connections 2023-06-08T04:03:12.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.709+0000 7fea2f7ff700 1 -- 172.21.15.16:0/1644871631 wait complete. 2023-06-08T04:03:12.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.711+0000 7fea2f7ff700 1 Processor -- start 2023-06-08T04:03:12.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.711+0000 7fea2f7ff700 1 -- start start 2023-06-08T04:03:12.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.712+0000 7fea2f7ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea280b4b50 0x7fea2814cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.712+0000 7fea2f7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea280b83f0 0x7fea2815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.712+0000 7fea2f7ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea28160a60 0x7fea280ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.713+0000 7fea2f7ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea280cbf70 con 0x7fea280b4b50 2023-06-08T04:03:12.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.713+0000 7fea2f7ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2814d4d0 con 0x7fea28160a60 2023-06-08T04:03:12.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.713+0000 7fea2f7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2815d310 con 0x7fea280b83f0 2023-06-08T04:03:12.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.713+0000 7fea2d59b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea280b4b50 0x7fea2814cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.713+0000 7fea2d59b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea280b4b50 0x7fea2814cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37664/0 (socket says 172.21.15.16:37664) 2023-06-08T04:03:12.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.713+0000 7fea2d59b700 1 -- 172.21.15.16:0/4199660866 learned_addr learned my addr 172.21.15.16:0/4199660866 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:12.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.713+0000 7fea2cd9a700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea280b83f0 0x7fea2815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.713+0000 7fea2dd9c700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea28160a60 0x7fea280ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea2d59b700 1 -- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea280b83f0 msgr2=0x7fea2815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea2d59b700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea280b83f0 0x7fea2815ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea2d59b700 1 -- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea28160a60 msgr2=0x7fea280ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea2d59b700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea28160a60 0x7fea280ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea2d59b700 1 -- 172.21.15.16:0/4199660866 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea20009a70 con 0x7fea280b4b50 2023-06-08T04:03:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea2cd9a700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea280b83f0 0x7fea2815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea2dd9c700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea28160a60 0x7fea280ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:03:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea2d59b700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea280b4b50 0x7fea2814cf90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fea240011e0 tx=0x7fea2400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea1dffb700 1 -- 172.21.15.16:0/4199660866 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24004c80 con 0x7fea280b4b50 2023-06-08T04:03:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea1dffb700 1 -- 172.21.15.16:0/4199660866 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea24004de0 con 0x7fea280b4b50 2023-06-08T04:03:12.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea2f7ff700 1 -- 172.21.15.16:0/4199660866 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2815d5f0 con 0x7fea280b4b50 2023-06-08T04:03:12.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea1dffb700 1 -- 172.21.15.16:0/4199660866 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24007310 con 0x7fea280b4b50 2023-06-08T04:03:12.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.714+0000 7fea2f7ff700 1 -- 172.21.15.16:0/4199660866 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2815dbb0 con 0x7fea280b4b50 2023-06-08T04:03:12.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.716+0000 7fea2f7ff700 1 -- 172.21.15.16:0/4199660866 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2815e200 con 0x7fea280b4b50 2023-06-08T04:03:12.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.717+0000 7fea1dffb700 1 -- 172.21.15.16:0/4199660866 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea24007470 con 0x7fea280b4b50 2023-06-08T04:03:12.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.717+0000 7fea1dffb700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fea0c06ace0 0x7fea0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:12.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.718+0000 7fea1dffb700 1 -- 172.21.15.16:0/4199660866 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea24089170 con 0x7fea280b4b50 2023-06-08T04:03:12.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.718+0000 7fea2cd9a700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fea0c06ace0 0x7fea0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:12.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.719+0000 7fea2cd9a700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fea0c06ace0 0x7fea0c06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fea281f63d0 tx=0x7fea18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:12.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.722+0000 7fea1dffb700 1 -- 172.21.15.16:0/4199660866 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fea24054210 con 0x7fea280b4b50 2023-06-08T04:03:12.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:12.971+0000 7fea2f7ff700 1 -- 172.21.15.16:0/4199660866 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fea280740e0 con 0x7fea280b4b50 2023-06-08T04:03:13.017 INFO:tasks.ceph.mds.a.smithi016.stderr:2023-06-08T04:03:13.013+0000 7f1b6ddf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-08T04:03:13.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.570+0000 7fea1dffb700 1 -- 172.21.15.16:0/4199660866 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fea24057830 con 0x7fea280b4b50 2023-06-08T04:03:13.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 -- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fea0c06ace0 msgr2=0x7fea0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:13.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fea0c06ace0 0x7fea0c06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fea281f63d0 tx=0x7fea18008040 comp rx=0 tx=0).stop 2023-06-08T04:03:13.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 -- 172.21.15.16:0/4199660866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea280b4b50 msgr2=0x7fea2814cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:13.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea280b4b50 0x7fea2814cf90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fea240011e0 tx=0x7fea2400ca30 comp rx=0 tx=0).stop 2023-06-08T04:03:13.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 -- 172.21.15.16:0/4199660866 shutdown_connections 2023-06-08T04:03:13.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fea0c06ace0 0x7fea0c06d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:13.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea28160a60 0x7fea280ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:13.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea280b4b50 0x7fea2814cf90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:13.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 --2- 172.21.15.16:0/4199660866 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fea280b83f0 0x7fea2815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:13.578 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 -- 172.21.15.16:0/4199660866 >> 172.21.15.16:0/4199660866 conn(0x7fea280cf610 msgr2=0x7fea280d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:13.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 -- 172.21.15.16:0/4199660866 shutdown_connections 2023-06-08T04:03:13.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.573+0000 7fea2f7ff700 1 -- 172.21.15.16:0/4199660866 wait complete. 2023-06-08T04:03:13.596 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-08T04:03:13.597 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-08T04:03:13.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.798+0000 7fa3f57ff700 1 Processor -- start 2023-06-08T04:03:13.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.799+0000 7fa3f57ff700 1 -- start start 2023-06-08T04:03:13.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.800+0000 7fa3f57ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f0160a60 0x7fa3f00b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:13.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.800+0000 7fa3f57ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa3f00b4b50 0x7fa3f00d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:13.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.800+0000 7fa3f57ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f00d0800 con 0x7fa3f00b83f0 2023-06-08T04:03:13.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.800+0000 7fa3f57ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f0160ed0 con 0x7fa3f00b4b50 2023-06-08T04:03:13.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.800+0000 7fa3f57ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00b4fd0 con 0x7fa3f0160a60 2023-06-08T04:03:13.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.800+0000 7fa3eeffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa3f00b83f0 0x7fa3f00ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51100/0 (socket says 172.21.15.16:51100) 2023-06-08T04:03:13.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.800+0000 7fa3eeffd700 1 -- 172.21.15.16:0/493665987 learned_addr learned my addr 172.21.15.16:0/493665987 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:13.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.800+0000 7fa3e7fff700 1 --2- 172.21.15.16:0/493665987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f0160a60 0x7fa3f00b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:13.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.800+0000 7fa3ef7fe700 1 --2- 172.21.15.16:0/493665987 >> v2:172.21.15.169:3300/0 conn(0x7fa3f00b4b50 0x7fa3f00d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:13.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.801+0000 7fa3ee7fc700 1 -- 172.21.15.16:0/493665987 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384990212 0 0) 0x7fa3f00d0800 con 0x7fa3f00b83f0 2023-06-08T04:03:13.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.801+0000 7fa3ee7fc700 1 -- 172.21.15.16:0/493665987 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3dc0035b0 con 0x7fa3f00b83f0 2023-06-08T04:03:13.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.801+0000 7fa3e7fff700 1 -- 172.21.15.16:0/493665987 >> v2:172.21.15.169:3300/0 conn(0x7fa3f00b4b50 msgr2=0x7fa3f00d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:13.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.801+0000 7fa3e7fff700 1 --2- 172.21.15.16:0/493665987 >> v2:172.21.15.169:3300/0 conn(0x7fa3f00b4b50 0x7fa3f00d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:13.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.801+0000 7fa3e7fff700 1 -- 172.21.15.16:0/493665987 >> v1:172.21.15.16:6789/0 conn(0x7fa3f00b83f0 legacy=0x7fa3f00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:13.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.801+0000 7fa3e7fff700 1 -- 172.21.15.16:0/493665987 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f00cd1e0 con 0x7fa3f0160a60 2023-06-08T04:03:13.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.801+0000 7fa3e7fff700 1 --2- 172.21.15.16:0/493665987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f0160a60 0x7fa3f00b4610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009840 tx=0x7fa3d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d955a0dea4160ce2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:13.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.801+0000 7fa3ee7fc700 1 -- 172.21.15.16:0/493665987 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8011830 con 0x7fa3f0160a60 2023-06-08T04:03:13.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.802+0000 7fa3ee7fc700 1 -- 172.21.15.16:0/493665987 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d8011990 con 0x7fa3f0160a60 2023-06-08T04:03:13.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.802+0000 7fa3ee7fc700 1 -- 172.21.15.16:0/493665987 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8011d20 con 0x7fa3f0160a60 2023-06-08T04:03:13.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.802+0000 7fa3f57ff700 1 -- 172.21.15.16:0/493665987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f0160a60 msgr2=0x7fa3f00b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:13.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.802+0000 7fa3f57ff700 1 --2- 172.21.15.16:0/493665987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f0160a60 0x7fa3f00b4610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009840 tx=0x7fa3d8009b50 comp rx=0 tx=0).stop 2023-06-08T04:03:13.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.802+0000 7fa3f57ff700 1 -- 172.21.15.16:0/493665987 shutdown_connections 2023-06-08T04:03:13.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.802+0000 7fa3f57ff700 1 --2- 172.21.15.16:0/493665987 >> v2:172.21.15.169:3300/0 conn(0x7fa3f00b4b50 0x7fa3f00d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:13.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.802+0000 7fa3f57ff700 1 --2- 172.21.15.16:0/493665987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f0160a60 0x7fa3f00b4610 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:13.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.802+0000 7fa3f57ff700 1 -- 172.21.15.16:0/493665987 >> 172.21.15.16:0/493665987 conn(0x7fa3f00cf610 msgr2=0x7fa3f00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:13.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.802+0000 7fa3f57ff700 1 -- 172.21.15.16:0/493665987 shutdown_connections 2023-06-08T04:03:13.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.802+0000 7fa3f57ff700 1 -- 172.21.15.16:0/493665987 wait complete. 2023-06-08T04:03:13.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.804+0000 7fa3f57ff700 1 Processor -- start 2023-06-08T04:03:13.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.804+0000 7fa3f57ff700 1 -- start start 2023-06-08T04:03:13.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.805+0000 7fa3f57ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f00b4b50 0x7fa3f00cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:13.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.805+0000 7fa3f57ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f00b83f0 0x7fa3f015ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:13.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.805+0000 7fa3f57ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3f0160a60 0x7fa3f00c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:13.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.805+0000 7fa3f57ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f014b1e0 con 0x7fa3f00b4b50 2023-06-08T04:03:13.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.805+0000 7fa3f57ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00cb3a0 con 0x7fa3f0160a60 2023-06-08T04:03:13.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.805+0000 7fa3f57ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00ca2c0 con 0x7fa3f00b83f0 2023-06-08T04:03:13.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.805+0000 7fa3eeffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f00b4b50 0x7fa3f00cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:13.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.805+0000 7fa3eeffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f00b4b50 0x7fa3f00cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37666/0 (socket says 172.21.15.16:37666) 2023-06-08T04:03:13.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.805+0000 7fa3eeffd700 1 -- 172.21.15.16:0/2961529684 learned_addr learned my addr 172.21.15.16:0/2961529684 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:13.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.805+0000 7fa3e7fff700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f00b83f0 0x7fa3f015ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:13.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.805+0000 7fa3ef7fe700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3f0160a60 0x7fa3f00c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:13.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3eeffd700 1 -- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f00b83f0 msgr2=0x7fa3f015ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:13.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3eeffd700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f00b83f0 0x7fa3f015ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:13.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3eeffd700 1 -- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3f0160a60 msgr2=0x7fa3f00c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:13.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3eeffd700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3f0160a60 0x7fa3f00c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:13.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3eeffd700 1 -- 172.21.15.16:0/2961529684 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d80094a0 con 0x7fa3f00b4b50 2023-06-08T04:03:13.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3e7fff700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f00b83f0 0x7fa3f015ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:03:13.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3eeffd700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f00b4b50 0x7fa3f00cc780 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c730 tx=0x7fa3e000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:13.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3e77fe700 1 -- 172.21.15.16:0/2961529684 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0005d70 con 0x7fa3f00b4b50 2023-06-08T04:03:13.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3e77fe700 1 -- 172.21.15.16:0/2961529684 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e00070d0 con 0x7fa3f00b4b50 2023-06-08T04:03:13.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3f57ff700 1 -- 172.21.15.16:0/2961529684 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f00c9fe0 con 0x7fa3f00b4b50 2023-06-08T04:03:13.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3e77fe700 1 -- 172.21.15.16:0/2961529684 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0007440 con 0x7fa3f00b4b50 2023-06-08T04:03:13.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.806+0000 7fa3f57ff700 1 -- 172.21.15.16:0/2961529684 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f014ae00 con 0x7fa3f00b4b50 2023-06-08T04:03:13.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.807+0000 7fa3f57ff700 1 -- 172.21.15.16:0/2961529684 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f00740e0 con 0x7fa3f00b4b50 2023-06-08T04:03:13.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.808+0000 7fa3e77fe700 1 -- 172.21.15.16:0/2961529684 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3e00075a0 con 0x7fa3f00b4b50 2023-06-08T04:03:13.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.809+0000 7fa3e77fe700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa3d006ace0 0x7fa3d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:13.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.809+0000 7fa3e77fe700 1 -- 172.21.15.16:0/2961529684 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3e00887c0 con 0x7fa3f00b4b50 2023-06-08T04:03:13.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.810+0000 7fa3e7fff700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa3d006ace0 0x7fa3d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:13.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.811+0000 7fa3e7fff700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa3d006ace0 0x7fa3d006d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8000c00 tx=0x7fa3d801c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:13.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:13.813+0000 7fa3e77fe700 1 -- 172.21.15.16:0/2961529684 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa3e0053910 con 0x7fa3f00b4b50 2023-06-08T04:03:14.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.067+0000 7fa3f57ff700 1 -- 172.21.15.16:0/2961529684 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa3f00ce0f0 con 0x7fa3f00b4b50 2023-06-08T04:03:14.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.577+0000 7fa3e77fe700 1 -- 172.21.15.16:0/2961529684 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa3e0056f30 con 0x7fa3f00b4b50 2023-06-08T04:03:14.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.580+0000 7fa3f57ff700 1 -- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa3d006ace0 msgr2=0x7fa3d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:14.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.580+0000 7fa3f57ff700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa3d006ace0 0x7fa3d006d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8000c00 tx=0x7fa3d801c040 comp rx=0 tx=0).stop 2023-06-08T04:03:14.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.580+0000 7fa3f57ff700 1 -- 172.21.15.16:0/2961529684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f00b4b50 msgr2=0x7fa3f00cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:14.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.580+0000 7fa3f57ff700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f00b4b50 0x7fa3f00cc780 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000c730 tx=0x7fa3e000ca40 comp rx=0 tx=0).stop 2023-06-08T04:03:14.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.580+0000 7fa3f57ff700 1 -- 172.21.15.16:0/2961529684 shutdown_connections 2023-06-08T04:03:14.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.580+0000 7fa3f57ff700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fa3d006ace0 0x7fa3d006d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:14.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.580+0000 7fa3f57ff700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa3f0160a60 0x7fa3f00c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:14.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.580+0000 7fa3f57ff700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f00b4b50 0x7fa3f00cc780 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:14.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.580+0000 7fa3f57ff700 1 --2- 172.21.15.16:0/2961529684 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa3f00b83f0 0x7fa3f015ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:14.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.580+0000 7fa3f57ff700 1 -- 172.21.15.16:0/2961529684 >> 172.21.15.16:0/2961529684 conn(0x7fa3f00cf610 msgr2=0x7fa3f00cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:14.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.581+0000 7fa3f57ff700 1 -- 172.21.15.16:0/2961529684 shutdown_connections 2023-06-08T04:03:14.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.581+0000 7fa3f57ff700 1 -- 172.21.15.16:0/2961529684 wait complete. 2023-06-08T04:03:14.604 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-08T04:03:14.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T04:03:14.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.802+0000 7fec8f9ff700 1 Processor -- start 2023-06-08T04:03:14.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.803+0000 7fec8f9ff700 1 -- start start 2023-06-08T04:03:14.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.804+0000 7fec8f9ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88160a60 0x7fec880b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:14.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.804+0000 7fec8f9ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec880d0800 con 0x7fec880b83f0 2023-06-08T04:03:14.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.804+0000 7fec8f9ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec880cd1e0 con 0x7fec880b4b50 2023-06-08T04:03:14.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.804+0000 7fec8f9ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec88160ed0 con 0x7fec88160a60 2023-06-08T04:03:14.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.804+0000 7fec8d79b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fec880b83f0 0x7fec880ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51106/0 (socket says 172.21.15.16:51106) 2023-06-08T04:03:14.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.804+0000 7fec8d79b700 1 -- 172.21.15.16:0/4165472402 learned_addr learned my addr 172.21.15.16:0/4165472402 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:14.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.804+0000 7fec8cf9a700 1 --2- 172.21.15.16:0/4165472402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88160a60 0x7fec880b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:14.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.804+0000 7fec7ffff700 1 -- 172.21.15.16:0/4165472402 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217306946 0 0) 0x7fec880d0800 con 0x7fec880b83f0 2023-06-08T04:03:14.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.805+0000 7fec7ffff700 1 -- 172.21.15.16:0/4165472402 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec740035b0 con 0x7fec880b83f0 2023-06-08T04:03:14.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.805+0000 7fec7ffff700 1 -- 172.21.15.16:0/4165472402 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193908374 0 0) 0x7fec880cd1e0 con 0x7fec880b4b50 2023-06-08T04:03:14.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.805+0000 7fec7ffff700 1 -- 172.21.15.16:0/4165472402 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec880d0800 con 0x7fec880b4b50 2023-06-08T04:03:14.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.805+0000 7fec8cf9a700 1 -- 172.21.15.16:0/4165472402 >> v1:172.21.15.169:6789/0 conn(0x7fec880b4b50 legacy=0x7fec880d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:14.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.805+0000 7fec8cf9a700 1 -- 172.21.15.16:0/4165472402 >> v1:172.21.15.16:6789/0 conn(0x7fec880b83f0 legacy=0x7fec880ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:14.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.805+0000 7fec8cf9a700 1 -- 172.21.15.16:0/4165472402 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880cd4c0 con 0x7fec88160a60 2023-06-08T04:03:14.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.805+0000 7fec8cf9a700 1 --2- 172.21.15.16:0/4165472402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88160a60 0x7fec880b4610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec78009870 tx=0x7fec78009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18a49faedd4d1084 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:14.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.805+0000 7fec7ffff700 1 -- 172.21.15.16:0/4165472402 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78011830 con 0x7fec88160a60 2023-06-08T04:03:14.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.805+0000 7fec7ffff700 1 -- 172.21.15.16:0/4165472402 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec78011990 con 0x7fec88160a60 2023-06-08T04:03:14.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.805+0000 7fec7ffff700 1 -- 172.21.15.16:0/4165472402 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78011d20 con 0x7fec88160a60 2023-06-08T04:03:14.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.806+0000 7fec8f9ff700 1 -- 172.21.15.16:0/4165472402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88160a60 msgr2=0x7fec880b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:14.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.806+0000 7fec8f9ff700 1 --2- 172.21.15.16:0/4165472402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88160a60 0x7fec880b4610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec78009870 tx=0x7fec78009b80 comp rx=0 tx=0).stop 2023-06-08T04:03:14.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.806+0000 7fec8f9ff700 1 -- 172.21.15.16:0/4165472402 shutdown_connections 2023-06-08T04:03:14.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.806+0000 7fec8f9ff700 1 --2- 172.21.15.16:0/4165472402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec88160a60 0x7fec880b4610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:14.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.806+0000 7fec8f9ff700 1 -- 172.21.15.16:0/4165472402 >> 172.21.15.16:0/4165472402 conn(0x7fec880cf610 msgr2=0x7fec880cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:14.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.806+0000 7fec8f9ff700 1 -- 172.21.15.16:0/4165472402 shutdown_connections 2023-06-08T04:03:14.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.806+0000 7fec8f9ff700 1 -- 172.21.15.16:0/4165472402 wait complete. 2023-06-08T04:03:14.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.808+0000 7fec8f9ff700 1 Processor -- start 2023-06-08T04:03:14.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.808+0000 7fec8f9ff700 1 -- start start 2023-06-08T04:03:14.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.809+0000 7fec8f9ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec880b4b50 0x7fec881580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:14.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.809+0000 7fec8f9ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec880b83f0 0x7fec880ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:14.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.809+0000 7fec8f9ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec88160a60 0x7fec880cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:14.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.809+0000 7fec8f9ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8815ec60 con 0x7fec880b4b50 2023-06-08T04:03:14.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.809+0000 7fec8f9ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8815ef40 con 0x7fec88160a60 2023-06-08T04:03:14.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.809+0000 7fec8f9ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8815f220 con 0x7fec880b83f0 2023-06-08T04:03:14.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.809+0000 7fec8d79b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec880b4b50 0x7fec881580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:14.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.809+0000 7fec8d79b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec880b4b50 0x7fec881580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37680/0 (socket says 172.21.15.16:37680) 2023-06-08T04:03:14.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.809+0000 7fec8d79b700 1 -- 172.21.15.16:0/2878626902 learned_addr learned my addr 172.21.15.16:0/2878626902 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:14.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.809+0000 7fec8cf9a700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec880b83f0 0x7fec880ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:14.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.809+0000 7fec8df9c700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec88160a60 0x7fec880cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:14.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec8d79b700 1 -- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec880b83f0 msgr2=0x7fec880ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:14.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec8d79b700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec880b83f0 0x7fec880ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:14.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec8d79b700 1 -- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec88160a60 msgr2=0x7fec880cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:14.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec8d79b700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec88160a60 0x7fec880cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:14.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec8d79b700 1 -- 172.21.15.16:0/2878626902 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec780094a0 con 0x7fec880b4b50 2023-06-08T04:03:14.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec8df9c700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec88160a60 0x7fec880cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:14.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec8d79b700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec880b4b50 0x7fec881580f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fec8400c700 tx=0x7fec8400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:14.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec7dffb700 1 -- 172.21.15.16:0/2878626902 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84005d70 con 0x7fec880b4b50 2023-06-08T04:03:14.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec7dffb700 1 -- 172.21.15.16:0/2878626902 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec840070d0 con 0x7fec880b4b50 2023-06-08T04:03:14.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec7dffb700 1 -- 172.21.15.16:0/2878626902 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84007460 con 0x7fec880b4b50 2023-06-08T04:03:14.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec8f9ff700 1 -- 172.21.15.16:0/2878626902 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8815f500 con 0x7fec880b4b50 2023-06-08T04:03:14.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.810+0000 7fec8f9ff700 1 -- 172.21.15.16:0/2878626902 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8815f7e0 con 0x7fec880b4b50 2023-06-08T04:03:14.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.811+0000 7fec8f9ff700 1 -- 172.21.15.16:0/2878626902 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec880740e0 con 0x7fec880b4b50 2023-06-08T04:03:14.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.812+0000 7fec7dffb700 1 -- 172.21.15.16:0/2878626902 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec840075c0 con 0x7fec880b4b50 2023-06-08T04:03:14.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.813+0000 7fec7dffb700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fec6c06ace0 0x7fec6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:14.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.813+0000 7fec7dffb700 1 -- 172.21.15.16:0/2878626902 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec84088ab0 con 0x7fec880b4b50 2023-06-08T04:03:14.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.814+0000 7fec8cf9a700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fec6c06ace0 0x7fec6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:14.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.815+0000 7fec8cf9a700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fec6c06ace0 0x7fec6c06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec780097c0 tx=0x7fec7801c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:14.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:14.818+0000 7fec7dffb700 1 -- 172.21.15.16:0/2878626902 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fec84053ac0 con 0x7fec880b4b50 2023-06-08T04:03:15.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.069+0000 7fec8f9ff700 1 -- 172.21.15.16:0/2878626902 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec88160360 con 0x7fec880b4b50 2023-06-08T04:03:15.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.070+0000 7fec7dffb700 1 -- 172.21.15.16:0/2878626902 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fec840570e0 con 0x7fec880b4b50 2023-06-08T04:03:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:15.074 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6836/2291587896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2291587896},{"type":"v1","addr":"172.21.15.169:6836","nonce":2291587896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4838,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4137260434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4137260434},{"type":"v1","addr":"172.21.15.16:6835","nonce":4137260434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1096417178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":1096417178},{"type":"v1","addr":"172.21.15.169:6837","nonce":1096417178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T04:03:11.563705+0000","modified":"2023-06-08T04:03:14.570288+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6833/3183010605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3183010605},{"type":"v1","addr":"172.21.15.16:6833","nonce":3183010605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-08T04:03:15.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 -- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fec6c06ace0 msgr2=0x7fec6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fec6c06ace0 0x7fec6c06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec780097c0 tx=0x7fec7801c040 comp rx=0 tx=0).stop 2023-06-08T04:03:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 -- 172.21.15.16:0/2878626902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec880b4b50 msgr2=0x7fec881580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec880b4b50 0x7fec881580f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fec8400c700 tx=0x7fec8400ca10 comp rx=0 tx=0).stop 2023-06-08T04:03:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 -- 172.21.15.16:0/2878626902 shutdown_connections 2023-06-08T04:03:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fec6c06ace0 0x7fec6c06d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec88160a60 0x7fec880cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec880b4b50 0x7fec881580f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 --2- 172.21.15.16:0/2878626902 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec880b83f0 0x7fec880ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 -- 172.21.15.16:0/2878626902 >> 172.21.15.16:0/2878626902 conn(0x7fec880cf610 msgr2=0x7fec880b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 -- 172.21.15.16:0/2878626902 shutdown_connections 2023-06-08T04:03:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.072+0000 7fec8f9ff700 1 -- 172.21.15.16:0/2878626902 wait complete. 2023-06-08T04:03:15.078 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 15 2023-06-08T04:03:15.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:03:15.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.291+0000 7f2d081ff700 1 Processor -- start 2023-06-08T04:03:15.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.291+0000 7f2d081ff700 1 -- start start 2023-06-08T04:03:15.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.292+0000 7f2d081ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000b83f0 0x7f2d00160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.292+0000 7f2d081ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d000ced40 0x7f2d000b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.292+0000 7f2d081ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2d000b4b50 0x7f2d0006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.292+0000 7f2d081ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d000b4fd0 con 0x7f2d000ced40 2023-06-08T04:03:15.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.292+0000 7f2d081ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d000d0800 con 0x7f2d000b4b50 2023-06-08T04:03:15.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.292+0000 7f2d081ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d000cd1e0 con 0x7f2d000b83f0 2023-06-08T04:03:15.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d0579a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d000ced40 0x7f2d000b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d0579a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d000ced40 0x7f2d000b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37688/0 (socket says 172.21.15.16:37688) 2023-06-08T04:03:15.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d0579a700 1 -- 172.21.15.16:0/2407148282 learned_addr learned my addr 172.21.15.16:0/2407148282 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:15.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d0679c700 1 --2- 172.21.15.16:0/2407148282 >> v2:172.21.15.169:3300/0 conn(0x7f2d000b4b50 0x7f2d0006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d05f9b700 1 --2- 172.21.15.16:0/2407148282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000b83f0 0x7f2d00160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d0579a700 1 -- 172.21.15.16:0/2407148282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000b83f0 msgr2=0x7f2d00160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:15.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d0579a700 1 --2- 172.21.15.16:0/2407148282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000b83f0 0x7f2d00160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d0579a700 1 -- 172.21.15.16:0/2407148282 >> v2:172.21.15.169:3300/0 conn(0x7f2d000b4b50 msgr2=0x7f2d0006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:15.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d0579a700 1 --2- 172.21.15.16:0/2407148282 >> v2:172.21.15.169:3300/0 conn(0x7f2d000b4b50 0x7f2d0006b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d0579a700 1 -- 172.21.15.16:0/2407148282 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d000cd4c0 con 0x7f2d000ced40 2023-06-08T04:03:15.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d0579a700 1 --2- 172.21.15.16:0/2407148282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d000ced40 0x7f2d000b4610 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2d00073cb0 tx=0x7f2cf0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed48cb1d56fe948f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:15.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.293+0000 7f2d04f99700 1 -- 172.21.15.16:0/2407148282 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000b870 con 0x7f2d000ced40 2023-06-08T04:03:15.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.294+0000 7f2d04f99700 1 -- 172.21.15.16:0/2407148282 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf000b9d0 con 0x7f2d000ced40 2023-06-08T04:03:15.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.294+0000 7f2d04f99700 1 -- 172.21.15.16:0/2407148282 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000bd60 con 0x7f2d000ced40 2023-06-08T04:03:15.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.294+0000 7f2d081ff700 1 -- 172.21.15.16:0/2407148282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d000ced40 msgr2=0x7f2d000b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.294+0000 7f2d081ff700 1 --2- 172.21.15.16:0/2407148282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d000ced40 0x7f2d000b4610 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2d00073cb0 tx=0x7f2cf0009bd0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.294+0000 7f2d081ff700 1 -- 172.21.15.16:0/2407148282 shutdown_connections 2023-06-08T04:03:15.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.294+0000 7f2d081ff700 1 --2- 172.21.15.16:0/2407148282 >> v2:172.21.15.169:3300/0 conn(0x7f2d000b4b50 0x7f2d0006b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.294+0000 7f2d081ff700 1 --2- 172.21.15.16:0/2407148282 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000b83f0 0x7f2d00160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.294+0000 7f2d081ff700 1 --2- 172.21.15.16:0/2407148282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d000ced40 0x7f2d000b4610 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.294+0000 7f2d081ff700 1 -- 172.21.15.16:0/2407148282 >> 172.21.15.16:0/2407148282 conn(0x7f2d000cf610 msgr2=0x7f2d000cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:15.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.294+0000 7f2d081ff700 1 -- 172.21.15.16:0/2407148282 shutdown_connections 2023-06-08T04:03:15.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.294+0000 7f2d081ff700 1 -- 172.21.15.16:0/2407148282 wait complete. 2023-06-08T04:03:15.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.296+0000 7f2d081ff700 1 Processor -- start 2023-06-08T04:03:15.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.296+0000 7f2d081ff700 1 -- start start 2023-06-08T04:03:15.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.297+0000 7f2d081ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d000b4b50 0x7f2d0015df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.297+0000 7f2d081ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d000b83f0 0x7f2d0015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.297+0000 7f2d081ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000ced40 0x7f2d000d1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.297+0000 7f2d081ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0015a6c0 con 0x7f2d000b4b50 2023-06-08T04:03:15.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.297+0000 7f2d081ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0015f200 con 0x7f2d000b83f0 2023-06-08T04:03:15.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.297+0000 7f2d081ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d000d1850 con 0x7f2d000ced40 2023-06-08T04:03:15.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.297+0000 7f2d05f9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d000b4b50 0x7f2d0015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.297+0000 7f2d05f9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d000b4b50 0x7f2d0015df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37700/0 (socket says 172.21.15.16:37700) 2023-06-08T04:03:15.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2d05f9b700 1 -- 172.21.15.16:0/3512805391 learned_addr learned my addr 172.21.15.16:0/3512805391 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:15.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2d0579a700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d000b83f0 0x7f2d0015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2d0679c700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000ced40 0x7f2d000d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2d05f9b700 1 -- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000ced40 msgr2=0x7f2d000d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2d05f9b700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000ced40 0x7f2d000d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2d05f9b700 1 -- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d000b83f0 msgr2=0x7f2d0015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2d05f9b700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d000b83f0 0x7f2d0015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2d05f9b700 1 -- 172.21.15.16:0/3512805391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0009550 con 0x7f2d000b4b50 2023-06-08T04:03:15.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2d0579a700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d000b83f0 0x7f2d0015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:15.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2d05f9b700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d000b4b50 0x7f2d0015df60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00e810 tx=0x7f2cfc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:15.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2cf67fc700 1 -- 172.21.15.16:0/3512805391 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc013610 con 0x7f2d000b4b50 2023-06-08T04:03:15.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2cf67fc700 1 -- 172.21.15.16:0/3512805391 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc013770 con 0x7f2d000b4b50 2023-06-08T04:03:15.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2cf67fc700 1 -- 172.21.15.16:0/3512805391 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc013b20 con 0x7f2d000b4b50 2023-06-08T04:03:15.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.298+0000 7f2d081ff700 1 -- 172.21.15.16:0/3512805391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0015e5f0 con 0x7f2d000b4b50 2023-06-08T04:03:15.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.299+0000 7f2d081ff700 1 -- 172.21.15.16:0/3512805391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0015ebb0 con 0x7f2d000b4b50 2023-06-08T04:03:15.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.299+0000 7f2d081ff700 1 -- 172.21.15.16:0/3512805391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d000740e0 con 0x7f2d000b4b50 2023-06-08T04:03:15.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.301+0000 7f2cf67fc700 1 -- 172.21.15.16:0/3512805391 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2cfc013c80 con 0x7f2d000b4b50 2023-06-08T04:03:15.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.302+0000 7f2cf67fc700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2ce406ace0 0x7f2ce406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.302+0000 7f2cf67fc700 1 -- 172.21.15.16:0/3512805391 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2cfc089250 con 0x7f2d000b4b50 2023-06-08T04:03:15.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.303+0000 7f2d0579a700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2ce406ace0 0x7f2ce406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.303+0000 7f2d0579a700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2ce406ace0 0x7f2ce406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0014040 tx=0x7f2cf0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:15.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.306+0000 7f2cf67fc700 1 -- 172.21.15.16:0/3512805391 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2cfc054270 con 0x7f2d000b4b50 2023-06-08T04:03:15.517 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.513+0000 7f2d081ff700 1 -- 172.21.15.16:0/3512805391 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d0006c150 con 0x7f2d000b4b50 2023-06-08T04:03:15.518 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.514+0000 7f2cf67fc700 1 -- 172.21.15.16:0/3512805391 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f2cfc057890 con 0x7f2d000b4b50 2023-06-08T04:03:15.518 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:15.519 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":35,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:03:12.565842+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:03:09.272435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-08T04:03:10.551045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:03:15.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.516+0000 7f2d081ff700 1 -- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2ce406ace0 msgr2=0x7f2ce406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.516+0000 7f2d081ff700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2ce406ace0 0x7f2ce406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0014040 tx=0x7f2cf0008030 comp rx=0 tx=0).stop 2023-06-08T04:03:15.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.516+0000 7f2d081ff700 1 -- 172.21.15.16:0/3512805391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d000b4b50 msgr2=0x7f2d0015df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.516+0000 7f2d081ff700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d000b4b50 0x7f2d0015df60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00e810 tx=0x7f2cfc00ebd0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.516+0000 7f2d081ff700 1 -- 172.21.15.16:0/3512805391 shutdown_connections 2023-06-08T04:03:15.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.517+0000 7f2d081ff700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f2ce406ace0 0x7f2ce406d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.517+0000 7f2d081ff700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d000ced40 0x7f2d000d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.517+0000 7f2d081ff700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d000b4b50 0x7f2d0015df60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.517+0000 7f2d081ff700 1 --2- 172.21.15.16:0/3512805391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d000b83f0 0x7f2d0015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.517+0000 7f2d081ff700 1 -- 172.21.15.16:0/3512805391 >> 172.21.15.16:0/3512805391 conn(0x7f2d000cf610 msgr2=0x7f2d0015fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:15.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.517+0000 7f2d081ff700 1 -- 172.21.15.16:0/3512805391 shutdown_connections 2023-06-08T04:03:15.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.517+0000 7f2d081ff700 1 -- 172.21.15.16:0/3512805391 wait complete. 2023-06-08T04:03:15.538 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-08T04:03:15.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T04:03:15.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.736+0000 7fc9539ff700 1 Processor -- start 2023-06-08T04:03:15.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.736+0000 7fc9539ff700 1 -- start start 2023-06-08T04:03:15.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.737+0000 7fc9539ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc94c0d2800 0x7fc94c0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.738+0000 7fc9539ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c15caa0 con 0x7fc94c15c6d0 2023-06-08T04:03:15.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.738+0000 7fc9539ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c160250 con 0x7fc94c0cd940 2023-06-08T04:03:15.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.738+0000 7fc9539ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c160530 con 0x7fc94c0d2800 2023-06-08T04:03:15.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.738+0000 7fc95179b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc94c15c6d0 0x7fc94c0cd230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51122/0 (socket says 172.21.15.16:51122) 2023-06-08T04:03:15.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.738+0000 7fc95179b700 1 -- 172.21.15.16:0/2885303758 learned_addr learned my addr 172.21.15.16:0/2885303758 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.738+0000 7fc950f9a700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc94c0d2800 0x7fc94c0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.738+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199766147 0 0) 0x7fc94c15caa0 con 0x7fc94c15c6d0 2023-06-08T04:03:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.738+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9380035b0 con 0x7fc94c15c6d0 2023-06-08T04:03:15.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.738+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198135505 0 0) 0x7fc94c160250 con 0x7fc94c0cd940 2023-06-08T04:03:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.738+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc94c15caa0 con 0x7fc94c0cd940 2023-06-08T04:03:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2028453305 0 0) 0x7fc9380035b0 con 0x7fc94c15c6d0 2023-06-08T04:03:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc94c0d2800 msgr2=0x7fc94c0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc94c0d2800 0x7fc94c0d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 >> v1:172.21.15.169:6789/0 conn(0x7fc94c0cd940 legacy=0x7fc94c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c160810 con 0x7fc94c15c6d0 2023-06-08T04:03:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3960182689 0 0) 0x7fc948001670 con 0x7fc94c15c6d0 2023-06-08T04:03:15.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 >> v1:172.21.15.16:6789/0 conn(0x7fc94c15c6d0 legacy=0x7fc94c0cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc938003bc0 0x7fc938003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc938004850 0x7fc938004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc938005200 0x7fc93800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c160530 con 0x7fc938005200 2023-06-08T04:03:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93800bf50 con 0x7fc938004850 2023-06-08T04:03:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93800c0c0 con 0x7fc938003bc0 2023-06-08T04:03:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc951f9c700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc938005200 0x7fc93800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc950f9a700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc938004850 0x7fc938004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.739+0000 7fc95179b700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc938003bc0 0x7fc938003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.740+0000 7fc951f9c700 1 -- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc938003bc0 msgr2=0x7fc938003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.740+0000 7fc951f9c700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc938003bc0 0x7fc938003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.740+0000 7fc951f9c700 1 -- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc938004850 msgr2=0x7fc938004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.740+0000 7fc951f9c700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc938004850 0x7fc938004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.740+0000 7fc951f9c700 1 -- 172.21.15.16:0/2885303758 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9380035b0 con 0x7fc938005200 2023-06-08T04:03:15.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.740+0000 7fc950f9a700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc938004850 0x7fc938004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:03:15.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.740+0000 7fc951f9c700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc938005200 0x7fc93800ba10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc94400c490 tx=0x7fc938005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355eeb957ffe53c2 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:15.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.740+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944003a00 con 0x7fc938005200 2023-06-08T04:03:15.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.740+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc944003b60 con 0x7fc938005200 2023-06-08T04:03:15.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.740+0000 7fc943fff700 1 -- 172.21.15.16:0/2885303758 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440050d0 con 0x7fc938005200 2023-06-08T04:03:15.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.741+0000 7fc9539ff700 1 -- 172.21.15.16:0/2885303758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc938005200 msgr2=0x7fc93800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.741+0000 7fc9539ff700 1 --2- 172.21.15.16:0/2885303758 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc938005200 0x7fc93800ba10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc94400c490 tx=0x7fc938005880 comp rx=0 tx=0).stop 2023-06-08T04:03:15.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.741+0000 7fc951f9c700 1 -- 172.21.15.16:0/2885303758 reap_dead start 2023-06-08T04:03:15.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.741+0000 7fc9539ff700 1 -- 172.21.15.16:0/2885303758 shutdown_connections 2023-06-08T04:03:15.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.741+0000 7fc9539ff700 1 -- 172.21.15.16:0/2885303758 >> 172.21.15.16:0/2885303758 conn(0x7fc94c0666a0 msgr2=0x7fc94c0cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:15.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.741+0000 7fc9539ff700 1 -- 172.21.15.16:0/2885303758 shutdown_connections 2023-06-08T04:03:15.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.741+0000 7fc9539ff700 1 -- 172.21.15.16:0/2885303758 wait complete. 2023-06-08T04:03:15.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.743+0000 7fc9539ff700 1 Processor -- start 2023-06-08T04:03:15.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.743+0000 7fc9539ff700 1 -- start start 2023-06-08T04:03:15.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc9539ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc94c14af90 0x7fc94c0cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc9539ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc94c0cb240 0x7fc94c15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc9539ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc94c15b790 0x7fc94c0b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc9539ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c15bc00 con 0x7fc94c15b790 2023-06-08T04:03:15.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc9539ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0cb780 con 0x7fc94c0cb240 2023-06-08T04:03:15.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc9539ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0cba60 con 0x7fc94c14af90 2023-06-08T04:03:15.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc951f9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc94c15b790 0x7fc94c0b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc95179b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc94c14af90 0x7fc94c0cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc951f9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc94c15b790 0x7fc94c0b6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37720/0 (socket says 172.21.15.16:37720) 2023-06-08T04:03:15.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc950f9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc94c0cb240 0x7fc94c15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc951f9c700 1 -- 172.21.15.16:0/248368662 learned_addr learned my addr 172.21.15.16:0/248368662 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:15.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc951f9c700 1 -- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc94c14af90 msgr2=0x7fc94c0cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc951f9c700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc94c14af90 0x7fc94c0cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc951f9c700 1 -- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc94c0cb240 msgr2=0x7fc94c15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc951f9c700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc94c0cb240 0x7fc94c15b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.744+0000 7fc951f9c700 1 -- 172.21.15.16:0/248368662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c0cbd40 con 0x7fc94c15b790 2023-06-08T04:03:15.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.745+0000 7fc951f9c700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc94c15b790 0x7fc94c0b6f20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc944004000 tx=0x7fc944001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:15.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.745+0000 7fc941ffb700 1 -- 172.21.15.16:0/248368662 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944003a00 con 0x7fc94c15b790 2023-06-08T04:03:15.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.745+0000 7fc941ffb700 1 -- 172.21.15.16:0/248368662 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc944001e90 con 0x7fc94c15b790 2023-06-08T04:03:15.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.745+0000 7fc941ffb700 1 -- 172.21.15.16:0/248368662 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944005500 con 0x7fc94c15b790 2023-06-08T04:03:15.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.745+0000 7fc9539ff700 1 -- 172.21.15.16:0/248368662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c0cc020 con 0x7fc94c15b790 2023-06-08T04:03:15.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.745+0000 7fc9539ff700 1 -- 172.21.15.16:0/248368662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c15d2a0 con 0x7fc94c15b790 2023-06-08T04:03:15.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.746+0000 7fc9539ff700 1 -- 172.21.15.16:0/248368662 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c15d580 con 0x7fc94c15b790 2023-06-08T04:03:15.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.747+0000 7fc941ffb700 1 -- 172.21.15.16:0/248368662 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc944019070 con 0x7fc94c15b790 2023-06-08T04:03:15.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.748+0000 7fc941ffb700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc93006ace0 0x7fc93006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:15.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.748+0000 7fc941ffb700 1 -- 172.21.15.16:0/248368662 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc944089ef0 con 0x7fc94c15b790 2023-06-08T04:03:15.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.748+0000 7fc95179b700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc93006ace0 0x7fc93006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:15.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.749+0000 7fc95179b700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc93006ace0 0x7fc93006d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc948000c00 tx=0x7fc948000f80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:15.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.752+0000 7fc941ffb700 1 -- 172.21.15.16:0/248368662 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc944055030 con 0x7fc94c15b790 2023-06-08T04:03:15.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.952+0000 7fc9539ff700 1 -- 172.21.15.16:0/248368662 --> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc94c160dd0 con 0x7fc93006ace0 2023-06-08T04:03:15.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.963+0000 7fc941ffb700 1 -- 172.21.15.16:0/248368662 <== mgr.4103 v2:172.21.15.169:6832/2339348297 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+296314 (secure 0 0 0) 0x7fc948007e80 con 0x7fc93006ace0 2023-06-08T04:03:15.970 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:15.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 -- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc93006ace0 msgr2=0x7fc93006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc93006ace0 0x7fc93006d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc948000c00 tx=0x7fc948000f80 comp rx=0 tx=0).stop 2023-06-08T04:03:15.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 -- 172.21.15.16:0/248368662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc94c15b790 msgr2=0x7fc94c0b6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc94c15b790 0x7fc94c0b6f20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc944004000 tx=0x7fc944001690 comp rx=0 tx=0).stop 2023-06-08T04:03:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 -- 172.21.15.16:0/248368662 shutdown_connections 2023-06-08T04:03:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fc93006ace0 0x7fc93006d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc94c15b790 0x7fc94c0b6f20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc94c14af90 0x7fc94c0cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 --2- 172.21.15.16:0/248368662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc94c0cb240 0x7fc94c15b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 -- 172.21.15.16:0/248368662 >> 172.21.15.16:0/248368662 conn(0x7fc938005200 msgr2=0x7fc94c0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:15.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 -- 172.21.15.16:0/248368662 shutdown_connections 2023-06-08T04:03:15.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:15.968+0000 7fc9539ff700 1 -- 172.21.15.16:0/248368662 wait complete. 2023-06-08T04:03:15.974 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-06-08T04:03:15.990 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-06-08T04:03:14.203614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219492,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755228,"statfs":{"total":773094113280,"available":772869353472,"internally_reserved":0,"allocated":3969024,"data_stored":2289110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.159950"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-08T04:03:03.286455+0000","last_change":"2023-06-08T04:01:50.999784+0000","last_active":"2023-06-08T04:03:03.286455+0000","last_peered":"2023-06-08T04:03:03.286455+0000","last_clean":"2023-06-08T04:03:03.286455+0000","last_became_active":"2023-06-08T04:01:50.999446+0000","last_became_peered":"2023-06-08T04:01:50.999446+0000","last_unstale":"2023-06-08T04:03:03.286455+0000","last_undegraded":"2023-06-08T04:03:03.286455+0000","last_fullsized":"2023-06-08T04:03:03.286455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:05.579001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-08T04:03:03.989090+0000","last_change":"2023-06-08T04:01:50.729188+0000","last_active":"2023-06-08T04:03:03.989090+0000","last_peered":"2023-06-08T04:03:03.989090+0000","last_clean":"2023-06-08T04:03:03.989090+0000","last_became_active":"2023-06-08T04:01:50.728711+0000","last_became_peered":"2023-06-08T04:01:50.728711+0000","last_unstale":"2023-06-08T04:03:03.989090+0000","last_undegraded":"2023-06-08T04:03:03.989090+0000","last_fullsized":"2023-06-08T04:03:03.989090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:18:37.424952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-08T04:03:03.988968+0000","last_change":"2023-06-08T04:01:50.734710+0000","last_active":"2023-06-08T04:03:03.988968+0000","last_peered":"2023-06-08T04:03:03.988968+0000","last_clean":"2023-06-08T04:03:03.988968+0000","last_became_active":"2023-06-08T04:01:50.734287+0000","last_became_peered":"2023-06-08T04:01:50.734287+0000","last_unstale":"2023-06-08T04:03:03.988968+0000","last_undegraded":"2023-06-08T04:03:03.988968+0000","last_fullsized":"2023-06-08T04:03:03.988968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:09:56.445220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-08T04:03:03.484590+0000","last_change":"2023-06-08T04:01:51.742803+0000","last_active":"2023-06-08T04:03:03.484590+0000","last_peered":"2023-06-08T04:03:03.484590+0000","last_clean":"2023-06-08T04:03:03.484590+0000","last_became_active":"2023-06-08T04:01:51.742466+0000","last_became_peered":"2023-06-08T04:01:51.742466+0000","last_unstale":"2023-06-08T04:03:03.484590+0000","last_undegraded":"2023-06-08T04:03:03.484590+0000","last_fullsized":"2023-06-08T04:03:03.484590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_clean_scrub_stamp":"2023-06-08T04:01:50.718021+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:13:42.992663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-08T04:03:03.484589+0000","last_change":"2023-06-08T04:01:51.001331+0000","last_active":"2023-06-08T04:03:03.484589+0000","last_peered":"2023-06-08T04:03:03.484589+0000","last_clean":"2023-06-08T04:03:03.484589+0000","last_became_active":"2023-06-08T04:01:51.001009+0000","last_became_peered":"2023-06-08T04:01:51.001009+0000","last_unstale":"2023-06-08T04:03:03.484589+0000","last_undegraded":"2023-06-08T04:03:03.484589+0000","last_fullsized":"2023-06-08T04:03:03.484589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:11:14.375638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-08T04:03:03.484561+0000","last_change":"2023-06-08T04:01:51.000319+0000","last_active":"2023-06-08T04:03:03.484561+0000","last_peered":"2023-06-08T04:03:03.484561+0000","last_clean":"2023-06-08T04:03:03.484561+0000","last_became_active":"2023-06-08T04:01:50.999943+0000","last_became_peered":"2023-06-08T04:01:50.999943+0000","last_unstale":"2023-06-08T04:03:03.484561+0000","last_undegraded":"2023-06-08T04:03:03.484561+0000","last_fullsized":"2023-06-08T04:03:03.484561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:14.130272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-08T04:03:03.286310+0000","last_change":"2023-06-08T04:01:51.000090+0000","last_active":"2023-06-08T04:03:03.286310+0000","last_peered":"2023-06-08T04:03:03.286310+0000","last_clean":"2023-06-08T04:03:03.286310+0000","last_became_active":"2023-06-08T04:01:50.999789+0000","last_became_peered":"2023-06-08T04:01:50.999789+0000","last_unstale":"2023-06-08T04:03:03.286310+0000","last_undegraded":"2023-06-08T04:03:03.286310+0000","last_fullsized":"2023-06-08T04:03:03.286310+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:17:00.200084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-08T04:03:03.989344+0000","last_change":"2023-06-08T04:01:51.000507+0000","last_active":"2023-06-08T04:03:03.989344+0000","last_peered":"2023-06-08T04:03:03.989344+0000","last_clean":"2023-06-08T04:03:03.989344+0000","last_became_active":"2023-06-08T04:01:51.000175+0000","last_became_peered":"2023-06-08T04:01:51.000175+0000","last_unstale":"2023-06-08T04:03:03.989344+0000","last_undegraded":"2023-06-08T04:03:03.989344+0000","last_fullsized":"2023-06-08T04:03:03.989344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:40:10.730712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:11.043187+0000","last_change":"2023-06-08T04:03:11.043187+0000","last_active":"2023-06-08T04:03:11.043187+0000","last_peered":"2023-06-08T04:03:11.043187+0000","last_clean":"2023-06-08T04:03:11.043187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:11.043187+0000","last_undegraded":"2023-06-08T04:03:11.043187+0000","last_fullsized":"2023-06-08T04:03:11.043187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-08T04:03:10.035471+0000","last_change":"2023-06-08T04:03:10.035471+0000","last_active":"2023-06-08T04:03:10.035471+0000","last_peered":"2023-06-08T04:03:10.035471+0000","last_clean":"2023-06-08T04:03:10.035471+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-08T04:03:10.035471+0000","last_undegraded":"2023-06-08T04:03:10.035471+0000","last_fullsized":"2023-06-08T04:03:10.035471+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-08T04:03:03.989345+0000","last_change":"2023-06-08T04:01:50.734174+0000","last_active":"2023-06-08T04:03:03.989345+0000","last_peered":"2023-06-08T04:03:03.989345+0000","last_clean":"2023-06-08T04:03:03.989345+0000","last_became_active":"2023-06-08T04:01:50.733832+0000","last_became_peered":"2023-06-08T04:01:50.733832+0000","last_unstale":"2023-06-08T04:03:03.989345+0000","last_undegraded":"2023-06-08T04:03:03.989345+0000","last_fullsized":"2023-06-08T04:03:03.989345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:13:39.603399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":729038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.627}]},{"osd":1,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.755}]},{"osd":2,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.2189999999999999,"5min":3.2189999999999999,"15min":3.2189999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.78100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":348160,"data_stored":138670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.1070000000000002,"5min":3.1070000000000002,"15min":3.1070000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.9669999999999996,"5min":4.9669999999999996,"15min":4.9669999999999996},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.623},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70799999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":729038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.499}]},{"osd":2,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.437}]},{"osd":4,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.746}]},{"osd":5,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.753}]},{"osd":6,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.86799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":344064,"data_stored":137684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.442}]},{"osd":2,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":348160,"data_stored":138670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.0679999999999996,"5min":8.0679999999999996,"15min":8.0679999999999996},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":8.1020000000000003,"5min":8.1020000000000003,"15min":8.1020000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":8.5199999999999996,"5min":8.5199999999999996,"15min":8.5199999999999996},"last":0.44}]},{"osd":3,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":18.933,"5min":18.933,"15min":18.933},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":8.0340000000000007,"5min":8.0340000000000007,"15min":8.0340000000000007},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":12.004,"5min":12.004,"15min":12.004},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.746,"5min":2.746,"15min":2.746},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":7.9880000000000004,"5min":7.9880000000000004,"15min":7.9880000000000004},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":11.927,"5min":11.927,"15min":11.927},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":7.9409999999999998,"5min":7.9409999999999998,"15min":7.9409999999999998},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":11.971,"5min":11.971,"15min":11.971},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.84299999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":348160,"data_stored":138670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.375},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.874}]},{"osd":5,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":3.4489999999999998,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.72399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":348160,"data_stored":138670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.76600000000000001}]},{"osd":1,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.623},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.871}]},{"osd":7,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":348160,"data_stored":138670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.7879999999999998,"5min":3.7879999999999998,"15min":3.7879999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":0.5},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.8959999999999999,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.7000000000000002,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.623},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T04:03:15.998 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-08T04:03:16.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.226+0000 7f0e15fff700 1 Processor -- start 2023-06-08T04:03:16.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.226+0000 7f0e15fff700 1 -- start start 2023-06-08T04:03:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.228+0000 7f0e15fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0e1015fb60 0x7f0e100c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.228+0000 7f0e15fff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0e100b0940 0x7f0e10069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.228+0000 7f0e15fff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e100af3f0 con 0x7f0e100af9e0 2023-06-08T04:03:16.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.228+0000 7f0e15fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e100b0e40 con 0x7f0e1015fb60 2023-06-08T04:03:16.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.228+0000 7f0e15fff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e100af1e0 con 0x7f0e100b0940 2023-06-08T04:03:16.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.228+0000 7f0e0f7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0e1015fb60 0x7f0e100c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.228+0000 7f0e0f7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0e1015fb60 0x7f0e100c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37724/0 (socket says 172.21.15.16:37724) 2023-06-08T04:03:16.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.228+0000 7f0e0f7fe700 1 -- 172.21.15.16:0/1917735335 learned_addr learned my addr 172.21.15.16:0/1917735335 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:16.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.229+0000 7f0e0effd700 1 --2- 172.21.15.16:0/1917735335 >> v2:172.21.15.169:3300/0 conn(0x7f0e100b0940 0x7f0e10069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.229+0000 7f0e0f7fe700 1 -- 172.21.15.16:0/1917735335 >> v2:172.21.15.169:3300/0 conn(0x7f0e100b0940 msgr2=0x7f0e10069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:16.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.229+0000 7f0e0f7fe700 1 --2- 172.21.15.16:0/1917735335 >> v2:172.21.15.169:3300/0 conn(0x7f0e100b0940 0x7f0e10069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.229+0000 7f0e0f7fe700 1 -- 172.21.15.16:0/1917735335 >> v1:172.21.15.169:6789/0 conn(0x7f0e100af9e0 legacy=0x7f0e100cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:16.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.229+0000 7f0e0f7fe700 1 -- 172.21.15.16:0/1917735335 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e100af6d0 con 0x7f0e1015fb60 2023-06-08T04:03:16.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.229+0000 7f0e0f7fe700 1 --2- 172.21.15.16:0/1917735335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e1015fb60 0x7f0e100c9ed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0e10070630 tx=0x7f0e00009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf062cc8e0b69e3c server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:16.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.229+0000 7f0e0e7fc700 1 -- 172.21.15.16:0/1917735335 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00011830 con 0x7f0e1015fb60 2023-06-08T04:03:16.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.229+0000 7f0e0e7fc700 1 -- 172.21.15.16:0/1917735335 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e00011990 con 0x7f0e1015fb60 2023-06-08T04:03:16.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.229+0000 7f0e0e7fc700 1 -- 172.21.15.16:0/1917735335 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00011d20 con 0x7f0e1015fb60 2023-06-08T04:03:16.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.230+0000 7f0e15fff700 1 -- 172.21.15.16:0/1917735335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e1015fb60 msgr2=0x7f0e100c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:16.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.230+0000 7f0e15fff700 1 --2- 172.21.15.16:0/1917735335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e1015fb60 0x7f0e100c9ed0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0e10070630 tx=0x7f0e00009bd0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.230+0000 7f0e15fff700 1 -- 172.21.15.16:0/1917735335 shutdown_connections 2023-06-08T04:03:16.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.230+0000 7f0e15fff700 1 --2- 172.21.15.16:0/1917735335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e1015fb60 0x7f0e100c9ed0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.230+0000 7f0e15fff700 1 --2- 172.21.15.16:0/1917735335 >> v2:172.21.15.169:3300/0 conn(0x7f0e100b0940 0x7f0e10069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.230+0000 7f0e15fff700 1 -- 172.21.15.16:0/1917735335 >> 172.21.15.16:0/1917735335 conn(0x7f0e10098a50 msgr2=0x7f0e100cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:16.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.230+0000 7f0e15fff700 1 -- 172.21.15.16:0/1917735335 shutdown_connections 2023-06-08T04:03:16.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.230+0000 7f0e15fff700 1 -- 172.21.15.16:0/1917735335 wait complete. 2023-06-08T04:03:16.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.232+0000 7f0e15fff700 1 Processor -- start 2023-06-08T04:03:16.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.233+0000 7f0e15fff700 1 -- start start 2023-06-08T04:03:16.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.234+0000 7f0e15fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e100af9e0 0x7f0e100b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.234+0000 7f0e15fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e100b0940 0x7f0e100c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.234+0000 7f0e15fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e1015fb60 0x7f0e101f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.234+0000 7f0e15fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100c3ed0 con 0x7f0e100af9e0 2023-06-08T04:03:16.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.234+0000 7f0e15fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100c4170 con 0x7f0e1015fb60 2023-06-08T04:03:16.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.234+0000 7f0e15fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100c4450 con 0x7f0e100b0940 2023-06-08T04:03:16.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.234+0000 7f0e0f7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e100af9e0 0x7f0e100b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.234+0000 7f0e0f7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e100af9e0 0x7f0e100b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37740/0 (socket says 172.21.15.16:37740) 2023-06-08T04:03:16.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.234+0000 7f0e0f7fe700 1 -- 172.21.15.16:0/2906393964 learned_addr learned my addr 172.21.15.16:0/2906393964 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:16.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.234+0000 7f0e0effd700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e100b0940 0x7f0e100c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.234+0000 7f0e0ffff700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e1015fb60 0x7f0e101f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.235+0000 7f0e0f7fe700 1 -- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e100b0940 msgr2=0x7f0e100c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:16.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.235+0000 7f0e0f7fe700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e100b0940 0x7f0e100c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.235+0000 7f0e0f7fe700 1 -- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e1015fb60 msgr2=0x7f0e101f6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:16.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.235+0000 7f0e0f7fe700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e1015fb60 0x7f0e101f6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.235+0000 7f0e0f7fe700 1 -- 172.21.15.16:0/2906393964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e00009550 con 0x7f0e100af9e0 2023-06-08T04:03:16.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.235+0000 7f0e0f7fe700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e100af9e0 0x7f0e100b3df0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0e00000c00 tx=0x7f0e00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:16.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.235+0000 7f0df7fff700 1 -- 172.21.15.16:0/2906393964 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00004480 con 0x7f0e100af9e0 2023-06-08T04:03:16.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.235+0000 7f0df7fff700 1 -- 172.21.15.16:0/2906393964 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0001f070 con 0x7f0e100af9e0 2023-06-08T04:03:16.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.235+0000 7f0e15fff700 1 -- 172.21.15.16:0/2906393964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e100c4730 con 0x7f0e100af9e0 2023-06-08T04:03:16.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.235+0000 7f0df7fff700 1 -- 172.21.15.16:0/2906393964 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e000038c0 con 0x7f0e100af9e0 2023-06-08T04:03:16.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.236+0000 7f0e15fff700 1 -- 172.21.15.16:0/2906393964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1015be50 con 0x7f0e100af9e0 2023-06-08T04:03:16.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.237+0000 7f0e15fff700 1 -- 172.21.15.16:0/2906393964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e100b1060 con 0x7f0e100af9e0 2023-06-08T04:03:16.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.237+0000 7f0df7fff700 1 -- 172.21.15.16:0/2906393964 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e00021030 con 0x7f0e100af9e0 2023-06-08T04:03:16.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.238+0000 7f0df7fff700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0dfc06ace0 0x7f0dfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.238+0000 7f0df7fff700 1 -- 172.21.15.16:0/2906393964 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e0008aa20 con 0x7f0e100af9e0 2023-06-08T04:03:16.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.239+0000 7f0e0effd700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0dfc06ace0 0x7f0dfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.239+0000 7f0e0effd700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0dfc06ace0 0x7f0dfc06d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0e100ae710 tx=0x7f0e04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:16.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.243+0000 7f0df7fff700 1 -- 172.21.15.16:0/2906393964 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0e00055be0 con 0x7f0e100af9e0 2023-06-08T04:03:16.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.442+0000 7f0e15fff700 1 -- 172.21.15.16:0/2906393964 --> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e1015bfe0 con 0x7f0dfc06ace0 2023-06-08T04:03:16.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.452+0000 7f0df7fff700 1 -- 172.21.15.16:0/2906393964 <== mgr.4103 v2:172.21.15.169:6832/2339348297 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311181 (secure 0 0 0) 0x7f0e04011780 con 0x7f0dfc06ace0 2023-06-08T04:03:16.459 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:16.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.456+0000 7f0e15fff700 1 -- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0dfc06ace0 msgr2=0x7f0dfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:16.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.456+0000 7f0e15fff700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0dfc06ace0 0x7f0dfc06d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0e100ae710 tx=0x7f0e04008040 comp rx=0 tx=0).stop 2023-06-08T04:03:16.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.456+0000 7f0e15fff700 1 -- 172.21.15.16:0/2906393964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e100af9e0 msgr2=0x7f0e100b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.456+0000 7f0e15fff700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e100af9e0 0x7f0e100b3df0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0e00000c00 tx=0x7f0e00004750 comp rx=0 tx=0).stop 2023-06-08T04:03:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.456+0000 7f0e15fff700 1 -- 172.21.15.16:0/2906393964 shutdown_connections 2023-06-08T04:03:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.456+0000 7f0e15fff700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f0dfc06ace0 0x7f0dfc06d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.456+0000 7f0e15fff700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0e1015fb60 0x7f0e101f6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.456+0000 7f0e15fff700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e100af9e0 0x7f0e100b3df0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.456+0000 7f0e15fff700 1 --2- 172.21.15.16:0/2906393964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0e100b0940 0x7f0e100c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.457+0000 7f0e15fff700 1 -- 172.21.15.16:0/2906393964 >> 172.21.15.16:0/2906393964 conn(0x7f0e10098a50 msgr2=0x7f0e1006e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.457+0000 7f0e15fff700 1 -- 172.21.15.16:0/2906393964 shutdown_connections 2023-06-08T04:03:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.457+0000 7f0e15fff700 1 -- 172.21.15.16:0/2906393964 wait complete. 2023-06-08T04:03:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-06-08T04:03:16.478 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-06-08T04:03:16.203957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219940,"kb_used_data":4324,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754780,"statfs":{"total":773094113280,"available":772868894720,"internally_reserved":0,"allocated":4427776,"data_stored":2506466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001211"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084879+0000","last_change":"2023-06-08T04:03:11.581395+0000","last_active":"2023-06-08T04:03:13.084879+0000","last_peered":"2023-06-08T04:03:13.084879+0000","last_clean":"2023-06-08T04:03:13.084879+0000","last_became_active":"2023-06-08T04:03:11.581143+0000","last_became_peered":"2023-06-08T04:03:11.581143+0000","last_unstale":"2023-06-08T04:03:13.084879+0000","last_undegraded":"2023-06-08T04:03:13.084879+0000","last_fullsized":"2023-06-08T04:03:13.084879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:41:51.859186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085130+0000","last_change":"2023-06-08T04:03:11.595776+0000","last_active":"2023-06-08T04:03:13.085130+0000","last_peered":"2023-06-08T04:03:13.085130+0000","last_clean":"2023-06-08T04:03:13.085130+0000","last_became_active":"2023-06-08T04:03:11.595509+0000","last_became_peered":"2023-06-08T04:03:11.595509+0000","last_unstale":"2023-06-08T04:03:13.085130+0000","last_undegraded":"2023-06-08T04:03:13.085130+0000","last_fullsized":"2023-06-08T04:03:13.085130+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:27:15.640361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084960+0000","last_change":"2023-06-08T04:03:11.580639+0000","last_active":"2023-06-08T04:03:13.084960+0000","last_peered":"2023-06-08T04:03:13.084960+0000","last_clean":"2023-06-08T04:03:13.084960+0000","last_became_active":"2023-06-08T04:03:11.580444+0000","last_became_peered":"2023-06-08T04:03:11.580444+0000","last_unstale":"2023-06-08T04:03:13.084960+0000","last_undegraded":"2023-06-08T04:03:13.084960+0000","last_fullsized":"2023-06-08T04:03:13.084960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:51:06.446587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.569969+0000","last_change":"2023-06-08T04:03:11.596985+0000","last_active":"2023-06-08T04:03:12.569969+0000","last_peered":"2023-06-08T04:03:12.569969+0000","last_clean":"2023-06-08T04:03:12.569969+0000","last_became_active":"2023-06-08T04:03:11.596561+0000","last_became_peered":"2023-06-08T04:03:11.596561+0000","last_unstale":"2023-06-08T04:03:12.569969+0000","last_undegraded":"2023-06-08T04:03:12.569969+0000","last_fullsized":"2023-06-08T04:03:12.569969+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:46:16.884243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.569913+0000","last_change":"2023-06-08T04:03:11.598364+0000","last_active":"2023-06-08T04:03:12.569913+0000","last_peered":"2023-06-08T04:03:12.569913+0000","last_clean":"2023-06-08T04:03:12.569913+0000","last_became_active":"2023-06-08T04:03:11.597666+0000","last_became_peered":"2023-06-08T04:03:11.597666+0000","last_unstale":"2023-06-08T04:03:12.569913+0000","last_undegraded":"2023-06-08T04:03:12.569913+0000","last_fullsized":"2023-06-08T04:03:12.569913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:58:51.080428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.714503+0000","last_change":"2023-06-08T04:03:11.587200+0000","last_active":"2023-06-08T04:03:12.714503+0000","last_peered":"2023-06-08T04:03:12.714503+0000","last_clean":"2023-06-08T04:03:12.714503+0000","last_became_active":"2023-06-08T04:03:11.586891+0000","last_became_peered":"2023-06-08T04:03:11.586891+0000","last_unstale":"2023-06-08T04:03:12.714503+0000","last_undegraded":"2023-06-08T04:03:12.714503+0000","last_fullsized":"2023-06-08T04:03:12.714503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:15:03.317829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571897+0000","last_change":"2023-06-08T04:03:11.580524+0000","last_active":"2023-06-08T04:03:12.571897+0000","last_peered":"2023-06-08T04:03:12.571897+0000","last_clean":"2023-06-08T04:03:12.571897+0000","last_became_active":"2023-06-08T04:03:11.580152+0000","last_became_peered":"2023-06-08T04:03:11.580152+0000","last_unstale":"2023-06-08T04:03:12.571897+0000","last_undegraded":"2023-06-08T04:03:12.571897+0000","last_fullsized":"2023-06-08T04:03:12.571897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:02:45.271131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084445+0000","last_change":"2023-06-08T04:03:11.578831+0000","last_active":"2023-06-08T04:03:13.084445+0000","last_peered":"2023-06-08T04:03:13.084445+0000","last_clean":"2023-06-08T04:03:13.084445+0000","last_became_active":"2023-06-08T04:03:11.578463+0000","last_became_peered":"2023-06-08T04:03:11.578463+0000","last_unstale":"2023-06-08T04:03:13.084445+0000","last_undegraded":"2023-06-08T04:03:13.084445+0000","last_fullsized":"2023-06-08T04:03:13.084445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:17:12.869643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085327+0000","last_change":"2023-06-08T04:03:11.580157+0000","last_active":"2023-06-08T04:03:13.085327+0000","last_peered":"2023-06-08T04:03:13.085327+0000","last_clean":"2023-06-08T04:03:13.085327+0000","last_became_active":"2023-06-08T04:03:11.579808+0000","last_became_peered":"2023-06-08T04:03:11.579808+0000","last_unstale":"2023-06-08T04:03:13.085327+0000","last_undegraded":"2023-06-08T04:03:13.085327+0000","last_fullsized":"2023-06-08T04:03:13.085327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:17:32.409683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572428+0000","last_change":"2023-06-08T04:03:11.596193+0000","last_active":"2023-06-08T04:03:12.572428+0000","last_peered":"2023-06-08T04:03:12.572428+0000","last_clean":"2023-06-08T04:03:12.572428+0000","last_became_active":"2023-06-08T04:03:11.595876+0000","last_became_peered":"2023-06-08T04:03:11.595876+0000","last_unstale":"2023-06-08T04:03:12.572428+0000","last_undegraded":"2023-06-08T04:03:12.572428+0000","last_fullsized":"2023-06-08T04:03:12.572428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:33:51.567053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572771+0000","last_change":"2023-06-08T04:03:11.584633+0000","last_active":"2023-06-08T04:03:12.572771+0000","last_peered":"2023-06-08T04:03:12.572771+0000","last_clean":"2023-06-08T04:03:12.572771+0000","last_became_active":"2023-06-08T04:03:11.584292+0000","last_became_peered":"2023-06-08T04:03:11.584292+0000","last_unstale":"2023-06-08T04:03:12.572771+0000","last_undegraded":"2023-06-08T04:03:12.572771+0000","last_fullsized":"2023-06-08T04:03:12.572771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:17:12.869643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084698+0000","last_change":"2023-06-08T04:03:11.594339+0000","last_active":"2023-06-08T04:03:13.084698+0000","last_peered":"2023-06-08T04:03:13.084698+0000","last_clean":"2023-06-08T04:03:13.084698+0000","last_became_active":"2023-06-08T04:03:11.594186+0000","last_became_peered":"2023-06-08T04:03:11.594186+0000","last_unstale":"2023-06-08T04:03:13.084698+0000","last_undegraded":"2023-06-08T04:03:13.084698+0000","last_fullsized":"2023-06-08T04:03:13.084698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:55:38.417291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571680+0000","last_change":"2023-06-08T04:03:11.584686+0000","last_active":"2023-06-08T04:03:12.571680+0000","last_peered":"2023-06-08T04:03:12.571680+0000","last_clean":"2023-06-08T04:03:12.571680+0000","last_became_active":"2023-06-08T04:03:11.584382+0000","last_became_peered":"2023-06-08T04:03:11.584382+0000","last_unstale":"2023-06-08T04:03:12.571680+0000","last_undegraded":"2023-06-08T04:03:12.571680+0000","last_fullsized":"2023-06-08T04:03:12.571680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:40:27.259522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.086215+0000","last_change":"2023-06-08T04:03:11.588272+0000","last_active":"2023-06-08T04:03:13.086215+0000","last_peered":"2023-06-08T04:03:13.086215+0000","last_clean":"2023-06-08T04:03:13.086215+0000","last_became_active":"2023-06-08T04:03:11.587988+0000","last_became_peered":"2023-06-08T04:03:11.587988+0000","last_unstale":"2023-06-08T04:03:13.086215+0000","last_undegraded":"2023-06-08T04:03:13.086215+0000","last_fullsized":"2023-06-08T04:03:13.086215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:09:50.738449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571493+0000","last_change":"2023-06-08T04:03:11.591996+0000","last_active":"2023-06-08T04:03:12.571493+0000","last_peered":"2023-06-08T04:03:12.571493+0000","last_clean":"2023-06-08T04:03:12.571493+0000","last_became_active":"2023-06-08T04:03:11.591729+0000","last_became_peered":"2023-06-08T04:03:11.591729+0000","last_unstale":"2023-06-08T04:03:12.571493+0000","last_undegraded":"2023-06-08T04:03:12.571493+0000","last_fullsized":"2023-06-08T04:03:12.571493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:49:34.886925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572420+0000","last_change":"2023-06-08T04:03:11.583257+0000","last_active":"2023-06-08T04:03:12.572420+0000","last_peered":"2023-06-08T04:03:12.572420+0000","last_clean":"2023-06-08T04:03:12.572420+0000","last_became_active":"2023-06-08T04:03:11.582986+0000","last_became_peered":"2023-06-08T04:03:11.582986+0000","last_unstale":"2023-06-08T04:03:12.572420+0000","last_undegraded":"2023-06-08T04:03:12.572420+0000","last_fullsized":"2023-06-08T04:03:12.572420+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:37:57.745970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571758+0000","last_change":"2023-06-08T04:03:11.582253+0000","last_active":"2023-06-08T04:03:12.571758+0000","last_peered":"2023-06-08T04:03:12.571758+0000","last_clean":"2023-06-08T04:03:12.571758+0000","last_became_active":"2023-06-08T04:03:11.581944+0000","last_became_peered":"2023-06-08T04:03:11.581944+0000","last_unstale":"2023-06-08T04:03:12.571758+0000","last_undegraded":"2023-06-08T04:03:12.571758+0000","last_fullsized":"2023-06-08T04:03:12.571758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:26:34.820142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085679+0000","last_change":"2023-06-08T04:03:11.598056+0000","last_active":"2023-06-08T04:03:13.085679+0000","last_peered":"2023-06-08T04:03:13.085679+0000","last_clean":"2023-06-08T04:03:13.085679+0000","last_became_active":"2023-06-08T04:03:11.597694+0000","last_became_peered":"2023-06-08T04:03:11.597694+0000","last_unstale":"2023-06-08T04:03:13.085679+0000","last_undegraded":"2023-06-08T04:03:13.085679+0000","last_fullsized":"2023-06-08T04:03:13.085679+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:46:00.630419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.570157+0000","last_change":"2023-06-08T04:03:11.597592+0000","last_active":"2023-06-08T04:03:12.570157+0000","last_peered":"2023-06-08T04:03:12.570157+0000","last_clean":"2023-06-08T04:03:12.570157+0000","last_became_active":"2023-06-08T04:03:11.597305+0000","last_became_peered":"2023-06-08T04:03:11.597305+0000","last_unstale":"2023-06-08T04:03:12.570157+0000","last_undegraded":"2023-06-08T04:03:12.570157+0000","last_fullsized":"2023-06-08T04:03:12.570157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:15:00.931200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.086042+0000","last_change":"2023-06-08T04:03:11.599102+0000","last_active":"2023-06-08T04:03:13.086042+0000","last_peered":"2023-06-08T04:03:13.086042+0000","last_clean":"2023-06-08T04:03:13.086042+0000","last_became_active":"2023-06-08T04:03:11.598841+0000","last_became_peered":"2023-06-08T04:03:11.598841+0000","last_unstale":"2023-06-08T04:03:13.086042+0000","last_undegraded":"2023-06-08T04:03:13.086042+0000","last_fullsized":"2023-06-08T04:03:13.086042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:12:35.703438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571973+0000","last_change":"2023-06-08T04:03:11.595195+0000","last_active":"2023-06-08T04:03:12.571973+0000","last_peered":"2023-06-08T04:03:12.571973+0000","last_clean":"2023-06-08T04:03:12.571973+0000","last_became_active":"2023-06-08T04:03:11.594766+0000","last_became_peered":"2023-06-08T04:03:11.594766+0000","last_unstale":"2023-06-08T04:03:12.571973+0000","last_undegraded":"2023-06-08T04:03:12.571973+0000","last_fullsized":"2023-06-08T04:03:12.571973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:54:14.645705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085999+0000","last_change":"2023-06-08T04:03:11.596910+0000","last_active":"2023-06-08T04:03:13.085999+0000","last_peered":"2023-06-08T04:03:13.085999+0000","last_clean":"2023-06-08T04:03:13.085999+0000","last_became_active":"2023-06-08T04:03:11.596527+0000","last_became_peered":"2023-06-08T04:03:11.596527+0000","last_unstale":"2023-06-08T04:03:13.085999+0000","last_undegraded":"2023-06-08T04:03:13.085999+0000","last_fullsized":"2023-06-08T04:03:13.085999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:09:07.223873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572307+0000","last_change":"2023-06-08T04:03:11.594843+0000","last_active":"2023-06-08T04:03:12.572307+0000","last_peered":"2023-06-08T04:03:12.572307+0000","last_clean":"2023-06-08T04:03:12.572307+0000","last_became_active":"2023-06-08T04:03:11.594208+0000","last_became_peered":"2023-06-08T04:03:11.594208+0000","last_unstale":"2023-06-08T04:03:12.572307+0000","last_undegraded":"2023-06-08T04:03:12.572307+0000","last_fullsized":"2023-06-08T04:03:12.572307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:36:48.384750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.570200+0000","last_change":"2023-06-08T04:03:11.595133+0000","last_active":"2023-06-08T04:03:12.570200+0000","last_peered":"2023-06-08T04:03:12.570200+0000","last_clean":"2023-06-08T04:03:12.570200+0000","last_became_active":"2023-06-08T04:03:11.594762+0000","last_became_peered":"2023-06-08T04:03:11.594762+0000","last_unstale":"2023-06-08T04:03:12.570200+0000","last_undegraded":"2023-06-08T04:03:12.570200+0000","last_fullsized":"2023-06-08T04:03:12.570200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:51:00.740606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085713+0000","last_change":"2023-06-08T04:03:11.590227+0000","last_active":"2023-06-08T04:03:13.085713+0000","last_peered":"2023-06-08T04:03:13.085713+0000","last_clean":"2023-06-08T04:03:13.085713+0000","last_became_active":"2023-06-08T04:03:11.589885+0000","last_became_peered":"2023-06-08T04:03:11.589885+0000","last_unstale":"2023-06-08T04:03:13.085713+0000","last_undegraded":"2023-06-08T04:03:13.085713+0000","last_fullsized":"2023-06-08T04:03:13.085713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:16:58.429370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.714946+0000","last_change":"2023-06-08T04:03:11.597654+0000","last_active":"2023-06-08T04:03:12.714946+0000","last_peered":"2023-06-08T04:03:12.714946+0000","last_clean":"2023-06-08T04:03:12.714946+0000","last_became_active":"2023-06-08T04:03:11.597376+0000","last_became_peered":"2023-06-08T04:03:11.597376+0000","last_unstale":"2023-06-08T04:03:12.714946+0000","last_undegraded":"2023-06-08T04:03:12.714946+0000","last_fullsized":"2023-06-08T04:03:12.714946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:42:49.673257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085499+0000","last_change":"2023-06-08T04:03:11.601753+0000","last_active":"2023-06-08T04:03:13.085499+0000","last_peered":"2023-06-08T04:03:13.085499+0000","last_clean":"2023-06-08T04:03:13.085499+0000","last_became_active":"2023-06-08T04:03:11.601488+0000","last_became_peered":"2023-06-08T04:03:11.601488+0000","last_unstale":"2023-06-08T04:03:13.085499+0000","last_undegraded":"2023-06-08T04:03:13.085499+0000","last_fullsized":"2023-06-08T04:03:13.085499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:04:45.623152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572235+0000","last_change":"2023-06-08T04:03:11.580681+0000","last_active":"2023-06-08T04:03:12.572235+0000","last_peered":"2023-06-08T04:03:12.572235+0000","last_clean":"2023-06-08T04:03:12.572235+0000","last_became_active":"2023-06-08T04:03:11.579863+0000","last_became_peered":"2023-06-08T04:03:11.579863+0000","last_unstale":"2023-06-08T04:03:12.572235+0000","last_undegraded":"2023-06-08T04:03:12.572235+0000","last_fullsized":"2023-06-08T04:03:12.572235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:06:30.815940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085230+0000","last_change":"2023-06-08T04:03:11.586901+0000","last_active":"2023-06-08T04:03:13.085230+0000","last_peered":"2023-06-08T04:03:13.085230+0000","last_clean":"2023-06-08T04:03:13.085230+0000","last_became_active":"2023-06-08T04:03:11.586572+0000","last_became_peered":"2023-06-08T04:03:11.586572+0000","last_unstale":"2023-06-08T04:03:13.085230+0000","last_undegraded":"2023-06-08T04:03:13.085230+0000","last_fullsized":"2023-06-08T04:03:13.085230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:54:03.415804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085157+0000","last_change":"2023-06-08T04:03:11.597351+0000","last_active":"2023-06-08T04:03:13.085157+0000","last_peered":"2023-06-08T04:03:13.085157+0000","last_clean":"2023-06-08T04:03:13.085157+0000","last_became_active":"2023-06-08T04:03:11.597078+0000","last_became_peered":"2023-06-08T04:03:11.597078+0000","last_unstale":"2023-06-08T04:03:13.085157+0000","last_undegraded":"2023-06-08T04:03:13.085157+0000","last_fullsized":"2023-06-08T04:03:13.085157+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:12:53.304930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572138+0000","last_change":"2023-06-08T04:03:11.595016+0000","last_active":"2023-06-08T04:03:12.572138+0000","last_peered":"2023-06-08T04:03:12.572138+0000","last_clean":"2023-06-08T04:03:12.572138+0000","last_became_active":"2023-06-08T04:03:11.594568+0000","last_became_peered":"2023-06-08T04:03:11.594568+0000","last_unstale":"2023-06-08T04:03:12.572138+0000","last_undegraded":"2023-06-08T04:03:12.572138+0000","last_fullsized":"2023-06-08T04:03:12.572138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:32:19.958487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.714410+0000","last_change":"2023-06-08T04:03:11.593517+0000","last_active":"2023-06-08T04:03:12.714410+0000","last_peered":"2023-06-08T04:03:12.714410+0000","last_clean":"2023-06-08T04:03:12.714410+0000","last_became_active":"2023-06-08T04:03:11.593207+0000","last_became_peered":"2023-06-08T04:03:11.593207+0000","last_unstale":"2023-06-08T04:03:12.714410+0000","last_undegraded":"2023-06-08T04:03:12.714410+0000","last_fullsized":"2023-06-08T04:03:12.714410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:12:35.703438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571580+0000","last_change":"2023-06-08T04:03:11.593975+0000","last_active":"2023-06-08T04:03:12.571580+0000","last_peered":"2023-06-08T04:03:12.571580+0000","last_clean":"2023-06-08T04:03:12.571580+0000","last_became_active":"2023-06-08T04:03:11.593634+0000","last_became_peered":"2023-06-08T04:03:11.593634+0000","last_unstale":"2023-06-08T04:03:12.571580+0000","last_undegraded":"2023-06-08T04:03:12.571580+0000","last_fullsized":"2023-06-08T04:03:12.571580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:39:20.236981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085795+0000","last_change":"2023-06-08T04:03:11.075989+0000","last_active":"2023-06-08T04:03:13.085795+0000","last_peered":"2023-06-08T04:03:13.085795+0000","last_clean":"2023-06-08T04:03:13.085795+0000","last_became_active":"2023-06-08T04:03:11.075701+0000","last_became_peered":"2023-06-08T04:03:11.075701+0000","last_unstale":"2023-06-08T04:03:13.085795+0000","last_undegraded":"2023-06-08T04:03:13.085795+0000","last_fullsized":"2023-06-08T04:03:13.085795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:06:55.580280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.714975+0000","last_change":"2023-06-08T04:03:11.597791+0000","last_active":"2023-06-08T04:03:12.714975+0000","last_peered":"2023-06-08T04:03:12.714975+0000","last_clean":"2023-06-08T04:03:12.714975+0000","last_became_active":"2023-06-08T04:03:11.597554+0000","last_became_peered":"2023-06-08T04:03:11.597554+0000","last_unstale":"2023-06-08T04:03:12.714975+0000","last_undegraded":"2023-06-08T04:03:12.714975+0000","last_fullsized":"2023-06-08T04:03:12.714975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:46:54.630663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085197+0000","last_change":"2023-06-08T04:03:11.072417+0000","last_active":"2023-06-08T04:03:13.085197+0000","last_peered":"2023-06-08T04:03:13.085197+0000","last_clean":"2023-06-08T04:03:13.085197+0000","last_became_active":"2023-06-08T04:03:11.072129+0000","last_became_peered":"2023-06-08T04:03:11.072129+0000","last_unstale":"2023-06-08T04:03:13.085197+0000","last_undegraded":"2023-06-08T04:03:13.085197+0000","last_fullsized":"2023-06-08T04:03:13.085197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:57:32.248009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085974+0000","last_change":"2023-06-08T04:03:11.588827+0000","last_active":"2023-06-08T04:03:13.085974+0000","last_peered":"2023-06-08T04:03:13.085974+0000","last_clean":"2023-06-08T04:03:13.085974+0000","last_became_active":"2023-06-08T04:03:11.588560+0000","last_became_peered":"2023-06-08T04:03:11.588560+0000","last_unstale":"2023-06-08T04:03:13.085974+0000","last_undegraded":"2023-06-08T04:03:13.085974+0000","last_fullsized":"2023-06-08T04:03:13.085974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:58:03.498082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.715094+0000","last_change":"2023-06-08T04:03:11.076051+0000","last_active":"2023-06-08T04:03:12.715094+0000","last_peered":"2023-06-08T04:03:12.715094+0000","last_clean":"2023-06-08T04:03:12.715094+0000","last_became_active":"2023-06-08T04:03:11.075761+0000","last_became_peered":"2023-06-08T04:03:11.075761+0000","last_unstale":"2023-06-08T04:03:12.715094+0000","last_undegraded":"2023-06-08T04:03:12.715094+0000","last_fullsized":"2023-06-08T04:03:12.715094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:55:37.409575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084686+0000","last_change":"2023-06-08T04:03:11.598616+0000","last_active":"2023-06-08T04:03:13.084686+0000","last_peered":"2023-06-08T04:03:13.084686+0000","last_clean":"2023-06-08T04:03:13.084686+0000","last_became_active":"2023-06-08T04:03:11.598359+0000","last_became_peered":"2023-06-08T04:03:11.598359+0000","last_unstale":"2023-06-08T04:03:13.084686+0000","last_undegraded":"2023-06-08T04:03:13.084686+0000","last_fullsized":"2023-06-08T04:03:13.084686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:00:56.457098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085786+0000","last_change":"2023-06-08T04:03:11.061867+0000","last_active":"2023-06-08T04:03:13.085786+0000","last_peered":"2023-06-08T04:03:13.085786+0000","last_clean":"2023-06-08T04:03:13.085786+0000","last_became_active":"2023-06-08T04:03:11.061566+0000","last_became_peered":"2023-06-08T04:03:11.061566+0000","last_unstale":"2023-06-08T04:03:13.085786+0000","last_undegraded":"2023-06-08T04:03:13.085786+0000","last_fullsized":"2023-06-08T04:03:13.085786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:11:38.065840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084739+0000","last_change":"2023-06-08T04:03:11.585573+0000","last_active":"2023-06-08T04:03:13.084739+0000","last_peered":"2023-06-08T04:03:13.084739+0000","last_clean":"2023-06-08T04:03:13.084739+0000","last_became_active":"2023-06-08T04:03:11.584839+0000","last_became_peered":"2023-06-08T04:03:11.584839+0000","last_unstale":"2023-06-08T04:03:13.084739+0000","last_undegraded":"2023-06-08T04:03:13.084739+0000","last_fullsized":"2023-06-08T04:03:13.084739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:16:30.793238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571826+0000","last_change":"2023-06-08T04:03:11.074205+0000","last_active":"2023-06-08T04:03:12.571826+0000","last_peered":"2023-06-08T04:03:12.571826+0000","last_clean":"2023-06-08T04:03:12.571826+0000","last_became_active":"2023-06-08T04:03:11.073904+0000","last_became_peered":"2023-06-08T04:03:11.073904+0000","last_unstale":"2023-06-08T04:03:12.571826+0000","last_undegraded":"2023-06-08T04:03:12.571826+0000","last_fullsized":"2023-06-08T04:03:12.571826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:48:45.708113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571659+0000","last_change":"2023-06-08T04:03:11.590152+0000","last_active":"2023-06-08T04:03:12.571659+0000","last_peered":"2023-06-08T04:03:12.571659+0000","last_clean":"2023-06-08T04:03:12.571659+0000","last_became_active":"2023-06-08T04:03:11.589901+0000","last_became_peered":"2023-06-08T04:03:11.589901+0000","last_unstale":"2023-06-08T04:03:12.571659+0000","last_undegraded":"2023-06-08T04:03:12.571659+0000","last_fullsized":"2023-06-08T04:03:12.571659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:19:55.683899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572165+0000","last_change":"2023-06-08T04:03:11.071215+0000","last_active":"2023-06-08T04:03:12.572165+0000","last_peered":"2023-06-08T04:03:12.572165+0000","last_clean":"2023-06-08T04:03:12.572165+0000","last_became_active":"2023-06-08T04:03:11.070886+0000","last_became_peered":"2023-06-08T04:03:11.070886+0000","last_unstale":"2023-06-08T04:03:12.572165+0000","last_undegraded":"2023-06-08T04:03:12.572165+0000","last_fullsized":"2023-06-08T04:03:12.572165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T16:01:35.083461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.086018+0000","last_change":"2023-06-08T04:03:11.598344+0000","last_active":"2023-06-08T04:03:13.086018+0000","last_peered":"2023-06-08T04:03:13.086018+0000","last_clean":"2023-06-08T04:03:13.086018+0000","last_became_active":"2023-06-08T04:03:11.598036+0000","last_became_peered":"2023-06-08T04:03:11.598036+0000","last_unstale":"2023-06-08T04:03:13.086018+0000","last_undegraded":"2023-06-08T04:03:13.086018+0000","last_fullsized":"2023-06-08T04:03:13.086018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:15:42.263196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.714597+0000","last_change":"2023-06-08T04:03:11.075984+0000","last_active":"2023-06-08T04:03:12.714597+0000","last_peered":"2023-06-08T04:03:12.714597+0000","last_clean":"2023-06-08T04:03:12.714597+0000","last_became_active":"2023-06-08T04:03:11.075675+0000","last_became_peered":"2023-06-08T04:03:11.075675+0000","last_unstale":"2023-06-08T04:03:12.714597+0000","last_undegraded":"2023-06-08T04:03:12.714597+0000","last_fullsized":"2023-06-08T04:03:12.714597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:19:57.745036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085232+0000","last_change":"2023-06-08T04:03:11.584309+0000","last_active":"2023-06-08T04:03:13.085232+0000","last_peered":"2023-06-08T04:03:13.085232+0000","last_clean":"2023-06-08T04:03:13.085232+0000","last_became_active":"2023-06-08T04:03:11.584058+0000","last_became_peered":"2023-06-08T04:03:11.584058+0000","last_unstale":"2023-06-08T04:03:13.085232+0000","last_undegraded":"2023-06-08T04:03:13.085232+0000","last_fullsized":"2023-06-08T04:03:13.085232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:47:14.724681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085283+0000","last_change":"2023-06-08T04:03:11.070064+0000","last_active":"2023-06-08T04:03:13.085283+0000","last_peered":"2023-06-08T04:03:13.085283+0000","last_clean":"2023-06-08T04:03:13.085283+0000","last_became_active":"2023-06-08T04:03:11.069672+0000","last_became_peered":"2023-06-08T04:03:11.069672+0000","last_unstale":"2023-06-08T04:03:13.085283+0000","last_undegraded":"2023-06-08T04:03:13.085283+0000","last_fullsized":"2023-06-08T04:03:13.085283+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:23:39.222587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.570000+0000","last_change":"2023-06-08T04:03:11.598177+0000","last_active":"2023-06-08T04:03:12.570000+0000","last_peered":"2023-06-08T04:03:12.570000+0000","last_clean":"2023-06-08T04:03:12.570000+0000","last_became_active":"2023-06-08T04:03:11.597931+0000","last_became_peered":"2023-06-08T04:03:11.597931+0000","last_unstale":"2023-06-08T04:03:12.570000+0000","last_undegraded":"2023-06-08T04:03:12.570000+0000","last_fullsized":"2023-06-08T04:03:12.570000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:49:32.350636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084835+0000","last_change":"2023-06-08T04:03:11.069346+0000","last_active":"2023-06-08T04:03:13.084835+0000","last_peered":"2023-06-08T04:03:13.084835+0000","last_clean":"2023-06-08T04:03:13.084835+0000","last_became_active":"2023-06-08T04:03:11.069050+0000","last_became_peered":"2023-06-08T04:03:11.069050+0000","last_unstale":"2023-06-08T04:03:13.084835+0000","last_undegraded":"2023-06-08T04:03:13.084835+0000","last_fullsized":"2023-06-08T04:03:13.084835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:13:14.062375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572184+0000","last_change":"2023-06-08T04:03:11.601779+0000","last_active":"2023-06-08T04:03:12.572184+0000","last_peered":"2023-06-08T04:03:12.572184+0000","last_clean":"2023-06-08T04:03:12.572184+0000","last_became_active":"2023-06-08T04:03:11.601450+0000","last_became_peered":"2023-06-08T04:03:11.601450+0000","last_unstale":"2023-06-08T04:03:12.572184+0000","last_undegraded":"2023-06-08T04:03:12.572184+0000","last_fullsized":"2023-06-08T04:03:12.572184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:32:47.601390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572721+0000","last_change":"2023-06-08T04:03:11.073978+0000","last_active":"2023-06-08T04:03:12.572721+0000","last_peered":"2023-06-08T04:03:12.572721+0000","last_clean":"2023-06-08T04:03:12.572721+0000","last_became_active":"2023-06-08T04:03:11.073492+0000","last_became_peered":"2023-06-08T04:03:11.073492+0000","last_unstale":"2023-06-08T04:03:12.572721+0000","last_undegraded":"2023-06-08T04:03:12.572721+0000","last_fullsized":"2023-06-08T04:03:12.572721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:17:56.505196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085069+0000","last_change":"2023-06-08T04:03:11.593808+0000","last_active":"2023-06-08T04:03:13.085069+0000","last_peered":"2023-06-08T04:03:13.085069+0000","last_clean":"2023-06-08T04:03:13.085069+0000","last_became_active":"2023-06-08T04:03:11.593509+0000","last_became_peered":"2023-06-08T04:03:11.593509+0000","last_unstale":"2023-06-08T04:03:13.085069+0000","last_undegraded":"2023-06-08T04:03:13.085069+0000","last_fullsized":"2023-06-08T04:03:13.085069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:59:16.929971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572859+0000","last_change":"2023-06-08T04:03:11.070442+0000","last_active":"2023-06-08T04:03:12.572859+0000","last_peered":"2023-06-08T04:03:12.572859+0000","last_clean":"2023-06-08T04:03:12.572859+0000","last_became_active":"2023-06-08T04:03:11.070154+0000","last_became_peered":"2023-06-08T04:03:11.070154+0000","last_unstale":"2023-06-08T04:03:12.572859+0000","last_undegraded":"2023-06-08T04:03:12.572859+0000","last_fullsized":"2023-06-08T04:03:12.572859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:11:34.429611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085783+0000","last_change":"2023-06-08T04:03:11.591955+0000","last_active":"2023-06-08T04:03:13.085783+0000","last_peered":"2023-06-08T04:03:13.085783+0000","last_clean":"2023-06-08T04:03:13.085783+0000","last_became_active":"2023-06-08T04:03:11.591670+0000","last_became_peered":"2023-06-08T04:03:11.591670+0000","last_unstale":"2023-06-08T04:03:13.085783+0000","last_undegraded":"2023-06-08T04:03:13.085783+0000","last_fullsized":"2023-06-08T04:03:13.085783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:54:20.754148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085967+0000","last_change":"2023-06-08T04:03:11.073757+0000","last_active":"2023-06-08T04:03:13.085967+0000","last_peered":"2023-06-08T04:03:13.085967+0000","last_clean":"2023-06-08T04:03:13.085967+0000","last_became_active":"2023-06-08T04:03:11.073428+0000","last_became_peered":"2023-06-08T04:03:11.073428+0000","last_unstale":"2023-06-08T04:03:13.085967+0000","last_undegraded":"2023-06-08T04:03:13.085967+0000","last_fullsized":"2023-06-08T04:03:13.085967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:32:46.593674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084737+0000","last_change":"2023-06-08T04:03:11.580137+0000","last_active":"2023-06-08T04:03:13.084737+0000","last_peered":"2023-06-08T04:03:13.084737+0000","last_clean":"2023-06-08T04:03:13.084737+0000","last_became_active":"2023-06-08T04:03:11.579847+0000","last_became_peered":"2023-06-08T04:03:11.579847+0000","last_unstale":"2023-06-08T04:03:13.084737+0000","last_undegraded":"2023-06-08T04:03:13.084737+0000","last_fullsized":"2023-06-08T04:03:13.084737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:44:06.445274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085236+0000","last_change":"2023-06-08T04:03:11.064969+0000","last_active":"2023-06-08T04:03:13.085236+0000","last_peered":"2023-06-08T04:03:13.085236+0000","last_clean":"2023-06-08T04:03:13.085236+0000","last_became_active":"2023-06-08T04:03:11.064670+0000","last_became_peered":"2023-06-08T04:03:11.064670+0000","last_unstale":"2023-06-08T04:03:13.085236+0000","last_undegraded":"2023-06-08T04:03:13.085236+0000","last_fullsized":"2023-06-08T04:03:13.085236+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:58:27.762761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084686+0000","last_change":"2023-06-08T04:03:11.581929+0000","last_active":"2023-06-08T04:03:13.084686+0000","last_peered":"2023-06-08T04:03:13.084686+0000","last_clean":"2023-06-08T04:03:13.084686+0000","last_became_active":"2023-06-08T04:03:11.581062+0000","last_became_peered":"2023-06-08T04:03:11.581062+0000","last_unstale":"2023-06-08T04:03:13.084686+0000","last_undegraded":"2023-06-08T04:03:13.084686+0000","last_fullsized":"2023-06-08T04:03:13.084686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:46:52.862877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.714638+0000","last_change":"2023-06-08T04:03:11.075283+0000","last_active":"2023-06-08T04:03:12.714638+0000","last_peered":"2023-06-08T04:03:12.714638+0000","last_clean":"2023-06-08T04:03:12.714638+0000","last_became_active":"2023-06-08T04:03:11.074985+0000","last_became_peered":"2023-06-08T04:03:11.074985+0000","last_unstale":"2023-06-08T04:03:12.714638+0000","last_undegraded":"2023-06-08T04:03:12.714638+0000","last_fullsized":"2023-06-08T04:03:12.714638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:47:15.981350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571945+0000","last_change":"2023-06-08T04:03:11.602266+0000","last_active":"2023-06-08T04:03:12.571945+0000","last_peered":"2023-06-08T04:03:12.571945+0000","last_clean":"2023-06-08T04:03:12.571945+0000","last_became_active":"2023-06-08T04:03:11.601871+0000","last_became_peered":"2023-06-08T04:03:11.601871+0000","last_unstale":"2023-06-08T04:03:12.571945+0000","last_undegraded":"2023-06-08T04:03:12.571945+0000","last_fullsized":"2023-06-08T04:03:12.571945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:47:14.724681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084941+0000","last_change":"2023-06-08T04:03:11.076592+0000","last_active":"2023-06-08T04:03:13.084941+0000","last_peered":"2023-06-08T04:03:13.084941+0000","last_clean":"2023-06-08T04:03:13.084941+0000","last_became_active":"2023-06-08T04:03:11.076259+0000","last_became_peered":"2023-06-08T04:03:11.076259+0000","last_unstale":"2023-06-08T04:03:13.084941+0000","last_undegraded":"2023-06-08T04:03:13.084941+0000","last_fullsized":"2023-06-08T04:03:13.084941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:35:12.512713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084873+0000","last_change":"2023-06-08T04:03:11.581722+0000","last_active":"2023-06-08T04:03:13.084873+0000","last_peered":"2023-06-08T04:03:13.084873+0000","last_clean":"2023-06-08T04:03:13.084873+0000","last_became_active":"2023-06-08T04:03:11.581370+0000","last_became_peered":"2023-06-08T04:03:11.581370+0000","last_unstale":"2023-06-08T04:03:13.084873+0000","last_undegraded":"2023-06-08T04:03:13.084873+0000","last_fullsized":"2023-06-08T04:03:13.084873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T12:39:20.236981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":21,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572568+0000","last_change":"2023-06-08T04:03:11.076272+0000","last_active":"2023-06-08T04:03:12.572568+0000","last_peered":"2023-06-08T04:03:12.572568+0000","last_clean":"2023-06-08T04:03:12.572568+0000","last_became_active":"2023-06-08T04:03:11.075998+0000","last_became_peered":"2023-06-08T04:03:11.075998+0000","last_unstale":"2023-06-08T04:03:12.572568+0000","last_undegraded":"2023-06-08T04:03:12.572568+0000","last_fullsized":"2023-06-08T04:03:12.572568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:53:32.017747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085203+0000","last_change":"2023-06-08T04:03:11.592386+0000","last_active":"2023-06-08T04:03:13.085203+0000","last_peered":"2023-06-08T04:03:13.085203+0000","last_clean":"2023-06-08T04:03:13.085203+0000","last_became_active":"2023-06-08T04:03:11.590465+0000","last_became_peered":"2023-06-08T04:03:11.590465+0000","last_unstale":"2023-06-08T04:03:13.085203+0000","last_undegraded":"2023-06-08T04:03:13.085203+0000","last_fullsized":"2023-06-08T04:03:13.085203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:37:57.745970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572574+0000","last_change":"2023-06-08T04:03:11.075739+0000","last_active":"2023-06-08T04:03:12.572574+0000","last_peered":"2023-06-08T04:03:12.572574+0000","last_clean":"2023-06-08T04:03:12.572574+0000","last_became_active":"2023-06-08T04:03:11.075387+0000","last_became_peered":"2023-06-08T04:03:11.075387+0000","last_unstale":"2023-06-08T04:03:12.572574+0000","last_undegraded":"2023-06-08T04:03:12.572574+0000","last_fullsized":"2023-06-08T04:03:12.572574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:18:22.082866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572687+0000","last_change":"2023-06-08T04:03:11.593203+0000","last_active":"2023-06-08T04:03:12.572687+0000","last_peered":"2023-06-08T04:03:12.572687+0000","last_clean":"2023-06-08T04:03:12.572687+0000","last_became_active":"2023-06-08T04:03:11.592594+0000","last_became_peered":"2023-06-08T04:03:11.592594+0000","last_unstale":"2023-06-08T04:03:12.572687+0000","last_undegraded":"2023-06-08T04:03:12.572687+0000","last_fullsized":"2023-06-08T04:03:12.572687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:32:26.770136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.086120+0000","last_change":"2023-06-08T04:03:11.072144+0000","last_active":"2023-06-08T04:03:13.086120+0000","last_peered":"2023-06-08T04:03:13.086120+0000","last_clean":"2023-06-08T04:03:13.086120+0000","last_became_active":"2023-06-08T04:03:11.071847+0000","last_became_peered":"2023-06-08T04:03:11.071847+0000","last_unstale":"2023-06-08T04:03:13.086120+0000","last_undegraded":"2023-06-08T04:03:13.086120+0000","last_fullsized":"2023-06-08T04:03:13.086120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:17:30.610296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.086067+0000","last_change":"2023-06-08T04:03:11.585853+0000","last_active":"2023-06-08T04:03:13.086067+0000","last_peered":"2023-06-08T04:03:13.086067+0000","last_clean":"2023-06-08T04:03:13.086067+0000","last_became_active":"2023-06-08T04:03:11.585541+0000","last_became_peered":"2023-06-08T04:03:11.585541+0000","last_unstale":"2023-06-08T04:03:13.086067+0000","last_undegraded":"2023-06-08T04:03:13.086067+0000","last_fullsized":"2023-06-08T04:03:13.086067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:12:05.324538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.570382+0000","last_change":"2023-06-08T04:03:11.072067+0000","last_active":"2023-06-08T04:03:12.570382+0000","last_peered":"2023-06-08T04:03:12.570382+0000","last_clean":"2023-06-08T04:03:12.570382+0000","last_became_active":"2023-06-08T04:03:11.071760+0000","last_became_peered":"2023-06-08T04:03:11.071760+0000","last_unstale":"2023-06-08T04:03:12.570382+0000","last_undegraded":"2023-06-08T04:03:12.570382+0000","last_fullsized":"2023-06-08T04:03:12.570382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:05:20.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.570203+0000","last_change":"2023-06-08T04:03:11.600658+0000","last_active":"2023-06-08T04:03:12.570203+0000","last_peered":"2023-06-08T04:03:12.570203+0000","last_clean":"2023-06-08T04:03:12.570203+0000","last_became_active":"2023-06-08T04:03:11.600351+0000","last_became_peered":"2023-06-08T04:03:11.600351+0000","last_unstale":"2023-06-08T04:03:12.570203+0000","last_undegraded":"2023-06-08T04:03:12.570203+0000","last_fullsized":"2023-06-08T04:03:12.570203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T14:41:32.058512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.714976+0000","last_change":"2023-06-08T04:03:11.076348+0000","last_active":"2023-06-08T04:03:12.714976+0000","last_peered":"2023-06-08T04:03:12.714976+0000","last_clean":"2023-06-08T04:03:12.714976+0000","last_became_active":"2023-06-08T04:03:11.076111+0000","last_became_peered":"2023-06-08T04:03:11.076111+0000","last_unstale":"2023-06-08T04:03:12.714976+0000","last_undegraded":"2023-06-08T04:03:12.714976+0000","last_fullsized":"2023-06-08T04:03:12.714976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:04:49.668256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572649+0000","last_change":"2023-06-08T04:03:11.594668+0000","last_active":"2023-06-08T04:03:12.572649+0000","last_peered":"2023-06-08T04:03:12.572649+0000","last_clean":"2023-06-08T04:03:12.572649+0000","last_became_active":"2023-06-08T04:03:11.594337+0000","last_became_peered":"2023-06-08T04:03:11.594337+0000","last_unstale":"2023-06-08T04:03:12.572649+0000","last_undegraded":"2023-06-08T04:03:12.572649+0000","last_fullsized":"2023-06-08T04:03:12.572649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:25:16.151210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.570061+0000","last_change":"2023-06-08T04:03:11.067616+0000","last_active":"2023-06-08T04:03:12.570061+0000","last_peered":"2023-06-08T04:03:12.570061+0000","last_clean":"2023-06-08T04:03:12.570061+0000","last_became_active":"2023-06-08T04:03:11.066983+0000","last_became_peered":"2023-06-08T04:03:11.066983+0000","last_unstale":"2023-06-08T04:03:12.570061+0000","last_undegraded":"2023-06-08T04:03:12.570061+0000","last_fullsized":"2023-06-08T04:03:12.570061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:22:58.009572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084698+0000","last_change":"2023-06-08T04:03:11.585088+0000","last_active":"2023-06-08T04:03:13.084698+0000","last_peered":"2023-06-08T04:03:13.084698+0000","last_clean":"2023-06-08T04:03:13.084698+0000","last_became_active":"2023-06-08T04:03:11.584839+0000","last_became_peered":"2023-06-08T04:03:11.584839+0000","last_unstale":"2023-06-08T04:03:13.084698+0000","last_undegraded":"2023-06-08T04:03:13.084698+0000","last_fullsized":"2023-06-08T04:03:13.084698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:04:50.675971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.569893+0000","last_change":"2023-06-08T04:03:11.070764+0000","last_active":"2023-06-08T04:03:12.569893+0000","last_peered":"2023-06-08T04:03:12.569893+0000","last_clean":"2023-06-08T04:03:12.569893+0000","last_became_active":"2023-06-08T04:03:11.070462+0000","last_became_peered":"2023-06-08T04:03:11.070462+0000","last_unstale":"2023-06-08T04:03:12.569893+0000","last_undegraded":"2023-06-08T04:03:12.569893+0000","last_fullsized":"2023-06-08T04:03:12.569893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:21:08.705556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571493+0000","last_change":"2023-06-08T04:03:11.588628+0000","last_active":"2023-06-08T04:03:12.571493+0000","last_peered":"2023-06-08T04:03:12.571493+0000","last_clean":"2023-06-08T04:03:12.571493+0000","last_became_active":"2023-06-08T04:03:11.588375+0000","last_became_peered":"2023-06-08T04:03:11.588375+0000","last_unstale":"2023-06-08T04:03:12.571493+0000","last_undegraded":"2023-06-08T04:03:12.571493+0000","last_fullsized":"2023-06-08T04:03:12.571493+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:47:12.135843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572472+0000","last_change":"2023-06-08T04:03:11.072323+0000","last_active":"2023-06-08T04:03:12.572472+0000","last_peered":"2023-06-08T04:03:12.572472+0000","last_clean":"2023-06-08T04:03:12.572472+0000","last_became_active":"2023-06-08T04:03:11.071995+0000","last_became_peered":"2023-06-08T04:03:11.071995+0000","last_unstale":"2023-06-08T04:03:12.572472+0000","last_undegraded":"2023-06-08T04:03:12.572472+0000","last_fullsized":"2023-06-08T04:03:12.572472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:16:47.686351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085065+0000","last_change":"2023-06-08T04:03:11.576185+0000","last_active":"2023-06-08T04:03:13.085065+0000","last_peered":"2023-06-08T04:03:13.085065+0000","last_clean":"2023-06-08T04:03:13.085065+0000","last_became_active":"2023-06-08T04:03:11.575914+0000","last_became_peered":"2023-06-08T04:03:11.575914+0000","last_unstale":"2023-06-08T04:03:13.085065+0000","last_undegraded":"2023-06-08T04:03:13.085065+0000","last_fullsized":"2023-06-08T04:03:13.085065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:26:34.820142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.569786+0000","last_change":"2023-06-08T04:03:11.067312+0000","last_active":"2023-06-08T04:03:12.569786+0000","last_peered":"2023-06-08T04:03:12.569786+0000","last_clean":"2023-06-08T04:03:12.569786+0000","last_became_active":"2023-06-08T04:03:11.067025+0000","last_became_peered":"2023-06-08T04:03:11.067025+0000","last_unstale":"2023-06-08T04:03:12.569786+0000","last_undegraded":"2023-06-08T04:03:12.569786+0000","last_fullsized":"2023-06-08T04:03:12.569786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T05:45:49.320734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.086160+0000","last_change":"2023-06-08T04:03:11.587301+0000","last_active":"2023-06-08T04:03:13.086160+0000","last_peered":"2023-06-08T04:03:13.086160+0000","last_clean":"2023-06-08T04:03:13.086160+0000","last_became_active":"2023-06-08T04:03:11.586490+0000","last_became_peered":"2023-06-08T04:03:11.586490+0000","last_unstale":"2023-06-08T04:03:13.086160+0000","last_undegraded":"2023-06-08T04:03:13.086160+0000","last_fullsized":"2023-06-08T04:03:13.086160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:59:24.082866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085745+0000","last_change":"2023-06-08T04:03:11.063175+0000","last_active":"2023-06-08T04:03:13.085745+0000","last_peered":"2023-06-08T04:03:13.085745+0000","last_clean":"2023-06-08T04:03:13.085745+0000","last_became_active":"2023-06-08T04:03:11.062914+0000","last_became_peered":"2023-06-08T04:03:11.062914+0000","last_unstale":"2023-06-08T04:03:13.085745+0000","last_undegraded":"2023-06-08T04:03:13.085745+0000","last_fullsized":"2023-06-08T04:03:13.085745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T10:28:46.763417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085495+0000","last_change":"2023-06-08T04:01:50.999784+0000","last_active":"2023-06-08T04:03:13.085495+0000","last_peered":"2023-06-08T04:03:13.085495+0000","last_clean":"2023-06-08T04:03:13.085495+0000","last_became_active":"2023-06-08T04:01:50.999446+0000","last_became_peered":"2023-06-08T04:01:50.999446+0000","last_unstale":"2023-06-08T04:03:13.085495+0000","last_undegraded":"2023-06-08T04:03:13.085495+0000","last_fullsized":"2023-06-08T04:03:13.085495+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:55:05.698360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571740+0000","last_change":"2023-06-08T04:03:11.602732+0000","last_active":"2023-06-08T04:03:12.571740+0000","last_peered":"2023-06-08T04:03:12.571740+0000","last_clean":"2023-06-08T04:03:12.571740+0000","last_became_active":"2023-06-08T04:03:11.602406+0000","last_became_peered":"2023-06-08T04:03:11.602406+0000","last_unstale":"2023-06-08T04:03:12.571740+0000","last_undegraded":"2023-06-08T04:03:12.571740+0000","last_fullsized":"2023-06-08T04:03:12.571740+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:27:15.640361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084508+0000","last_change":"2023-06-08T04:03:11.061033+0000","last_active":"2023-06-08T04:03:13.084508+0000","last_peered":"2023-06-08T04:03:13.084508+0000","last_clean":"2023-06-08T04:03:13.084508+0000","last_became_active":"2023-06-08T04:03:11.060737+0000","last_became_peered":"2023-06-08T04:03:11.060737+0000","last_unstale":"2023-06-08T04:03:13.084508+0000","last_undegraded":"2023-06-08T04:03:13.084508+0000","last_fullsized":"2023-06-08T04:03:13.084508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:11:34.429611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085927+0000","last_change":"2023-06-08T04:01:50.729188+0000","last_active":"2023-06-08T04:03:13.085927+0000","last_peered":"2023-06-08T04:03:13.085927+0000","last_clean":"2023-06-08T04:03:13.085927+0000","last_became_active":"2023-06-08T04:01:50.728711+0000","last_became_peered":"2023-06-08T04:01:50.728711+0000","last_unstale":"2023-06-08T04:03:13.085927+0000","last_undegraded":"2023-06-08T04:03:13.085927+0000","last_fullsized":"2023-06-08T04:03:13.085927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T16:00:14.763377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.714939+0000","last_change":"2023-06-08T04:03:11.598543+0000","last_active":"2023-06-08T04:03:12.714939+0000","last_peered":"2023-06-08T04:03:12.714939+0000","last_clean":"2023-06-08T04:03:12.714939+0000","last_became_active":"2023-06-08T04:03:11.598313+0000","last_became_peered":"2023-06-08T04:03:11.598313+0000","last_unstale":"2023-06-08T04:03:12.714939+0000","last_undegraded":"2023-06-08T04:03:12.714939+0000","last_fullsized":"2023-06-08T04:03:12.714939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:56:48.967582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572724+0000","last_change":"2023-06-08T04:03:11.071392+0000","last_active":"2023-06-08T04:03:12.572724+0000","last_peered":"2023-06-08T04:03:12.572724+0000","last_clean":"2023-06-08T04:03:12.572724+0000","last_became_active":"2023-06-08T04:03:11.071086+0000","last_became_peered":"2023-06-08T04:03:11.071086+0000","last_unstale":"2023-06-08T04:03:12.572724+0000","last_undegraded":"2023-06-08T04:03:12.572724+0000","last_fullsized":"2023-06-08T04:03:12.572724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:07:13.225111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.714686+0000","last_change":"2023-06-08T04:01:50.734710+0000","last_active":"2023-06-08T04:03:12.714686+0000","last_peered":"2023-06-08T04:03:12.714686+0000","last_clean":"2023-06-08T04:03:12.714686+0000","last_became_active":"2023-06-08T04:01:50.734287+0000","last_became_peered":"2023-06-08T04:01:50.734287+0000","last_unstale":"2023-06-08T04:03:12.714686+0000","last_undegraded":"2023-06-08T04:03:12.714686+0000","last_fullsized":"2023-06-08T04:03:12.714686+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:50:40.857632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":193,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572750+0000","last_change":"2023-06-08T04:01:51.742803+0000","last_active":"2023-06-08T04:03:12.572750+0000","last_peered":"2023-06-08T04:03:12.572750+0000","last_clean":"2023-06-08T04:03:12.572750+0000","last_became_active":"2023-06-08T04:01:51.742466+0000","last_became_peered":"2023-06-08T04:01:51.742466+0000","last_unstale":"2023-06-08T04:03:12.572750+0000","last_undegraded":"2023-06-08T04:03:12.572750+0000","last_fullsized":"2023-06-08T04:03:12.572750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:50.718021+0000","last_clean_scrub_stamp":"2023-06-08T04:01:50.718021+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:51:46.928241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572345+0000","last_change":"2023-06-08T04:03:11.602576+0000","last_active":"2023-06-08T04:03:12.572345+0000","last_peered":"2023-06-08T04:03:12.572345+0000","last_clean":"2023-06-08T04:03:12.572345+0000","last_became_active":"2023-06-08T04:03:11.602205+0000","last_became_peered":"2023-06-08T04:03:11.602205+0000","last_unstale":"2023-06-08T04:03:12.572345+0000","last_undegraded":"2023-06-08T04:03:12.572345+0000","last_fullsized":"2023-06-08T04:03:12.572345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:47:59.934895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"34'1","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.570337+0000","last_change":"2023-06-08T04:03:11.074897+0000","last_active":"2023-06-08T04:03:12.570337+0000","last_peered":"2023-06-08T04:03:12.570337+0000","last_clean":"2023-06-08T04:03:12.570337+0000","last_became_active":"2023-06-08T04:03:11.074519+0000","last_became_peered":"2023-06-08T04:03:11.074519+0000","last_unstale":"2023-06-08T04:03:12.570337+0000","last_undegraded":"2023-06-08T04:03:12.570337+0000","last_fullsized":"2023-06-08T04:03:12.570337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T15:09:46.596418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572050+0000","last_change":"2023-06-08T04:01:51.001331+0000","last_active":"2023-06-08T04:03:12.572050+0000","last_peered":"2023-06-08T04:03:12.572050+0000","last_clean":"2023-06-08T04:03:12.572050+0000","last_became_active":"2023-06-08T04:01:51.001009+0000","last_became_peered":"2023-06-08T04:01:51.001009+0000","last_unstale":"2023-06-08T04:03:12.572050+0000","last_undegraded":"2023-06-08T04:03:12.572050+0000","last_fullsized":"2023-06-08T04:03:12.572050+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:57:07.442677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572410+0000","last_change":"2023-06-08T04:03:11.581866+0000","last_active":"2023-06-08T04:03:12.572410+0000","last_peered":"2023-06-08T04:03:12.572410+0000","last_clean":"2023-06-08T04:03:12.572410+0000","last_became_active":"2023-06-08T04:03:11.581247+0000","last_became_peered":"2023-06-08T04:03:11.581247+0000","last_unstale":"2023-06-08T04:03:12.572410+0000","last_undegraded":"2023-06-08T04:03:12.572410+0000","last_fullsized":"2023-06-08T04:03:12.572410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T06:15:39.060591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571720+0000","last_change":"2023-06-08T04:03:11.070400+0000","last_active":"2023-06-08T04:03:12.571720+0000","last_peered":"2023-06-08T04:03:12.571720+0000","last_clean":"2023-06-08T04:03:12.571720+0000","last_became_active":"2023-06-08T04:03:11.069945+0000","last_became_peered":"2023-06-08T04:03:11.069945+0000","last_unstale":"2023-06-08T04:03:12.571720+0000","last_undegraded":"2023-06-08T04:03:12.571720+0000","last_fullsized":"2023-06-08T04:03:12.571720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T04:41:50.851470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.572659+0000","last_change":"2023-06-08T04:01:51.000319+0000","last_active":"2023-06-08T04:03:12.572659+0000","last_peered":"2023-06-08T04:03:12.572659+0000","last_clean":"2023-06-08T04:03:12.572659+0000","last_became_active":"2023-06-08T04:01:50.999943+0000","last_became_peered":"2023-06-08T04:01:50.999943+0000","last_unstale":"2023-06-08T04:03:12.572659+0000","last_undegraded":"2023-06-08T04:03:12.572659+0000","last_fullsized":"2023-06-08T04:03:12.572659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:01:03.038888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085284+0000","last_change":"2023-06-08T04:03:11.582663+0000","last_active":"2023-06-08T04:03:13.085284+0000","last_peered":"2023-06-08T04:03:13.085284+0000","last_clean":"2023-06-08T04:03:13.085284+0000","last_became_active":"2023-06-08T04:03:11.582403+0000","last_became_peered":"2023-06-08T04:03:11.582403+0000","last_unstale":"2023-06-08T04:03:13.085284+0000","last_undegraded":"2023-06-08T04:03:13.085284+0000","last_fullsized":"2023-06-08T04:03:13.085284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:32:19.958487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085089+0000","last_change":"2023-06-08T04:03:11.069345+0000","last_active":"2023-06-08T04:03:13.085089+0000","last_peered":"2023-06-08T04:03:13.085089+0000","last_clean":"2023-06-08T04:03:13.085089+0000","last_became_active":"2023-06-08T04:03:11.069036+0000","last_became_peered":"2023-06-08T04:03:11.069036+0000","last_unstale":"2023-06-08T04:03:13.085089+0000","last_undegraded":"2023-06-08T04:03:13.085089+0000","last_fullsized":"2023-06-08T04:03:13.085089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T11:23:49.940030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.571986+0000","last_change":"2023-06-08T04:01:51.000090+0000","last_active":"2023-06-08T04:03:12.571986+0000","last_peered":"2023-06-08T04:03:12.571986+0000","last_clean":"2023-06-08T04:03:12.571986+0000","last_became_active":"2023-06-08T04:01:50.999789+0000","last_became_peered":"2023-06-08T04:01:50.999789+0000","last_unstale":"2023-06-08T04:03:12.571986+0000","last_undegraded":"2023-06-08T04:03:12.571986+0000","last_fullsized":"2023-06-08T04:03:12.571986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:05.579001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:12.714884+0000","last_change":"2023-06-08T04:03:11.593694+0000","last_active":"2023-06-08T04:03:12.714884+0000","last_peered":"2023-06-08T04:03:12.714884+0000","last_clean":"2023-06-08T04:03:12.714884+0000","last_became_active":"2023-06-08T04:03:11.593427+0000","last_became_peered":"2023-06-08T04:03:11.593427+0000","last_unstale":"2023-06-08T04:03:12.714884+0000","last_undegraded":"2023-06-08T04:03:12.714884+0000","last_fullsized":"2023-06-08T04:03:12.714884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T08:47:57.142694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085274+0000","last_change":"2023-06-08T04:03:11.071374+0000","last_active":"2023-06-08T04:03:13.085274+0000","last_peered":"2023-06-08T04:03:13.085274+0000","last_clean":"2023-06-08T04:03:13.085274+0000","last_became_active":"2023-06-08T04:03:11.071112+0000","last_became_peered":"2023-06-08T04:03:11.071112+0000","last_unstale":"2023-06-08T04:03:13.085274+0000","last_undegraded":"2023-06-08T04:03:13.085274+0000","last_fullsized":"2023-06-08T04:03:13.085274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:15:26.249900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085653+0000","last_change":"2023-06-08T04:01:51.000507+0000","last_active":"2023-06-08T04:03:13.085653+0000","last_peered":"2023-06-08T04:03:13.085653+0000","last_clean":"2023-06-08T04:03:13.085653+0000","last_became_active":"2023-06-08T04:01:51.000175+0000","last_became_peered":"2023-06-08T04:01:51.000175+0000","last_unstale":"2023-06-08T04:03:13.085653+0000","last_undegraded":"2023-06-08T04:03:13.085653+0000","last_fullsized":"2023-06-08T04:03:13.085653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:37:29.906379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.084569+0000","last_change":"2023-06-08T04:03:11.582974+0000","last_active":"2023-06-08T04:03:13.084569+0000","last_peered":"2023-06-08T04:03:13.084569+0000","last_clean":"2023-06-08T04:03:13.084569+0000","last_became_active":"2023-06-08T04:03:11.582677+0000","last_became_peered":"2023-06-08T04:03:11.582677+0000","last_unstale":"2023-06-08T04:03:13.084569+0000","last_undegraded":"2023-06-08T04:03:13.084569+0000","last_fullsized":"2023-06-08T04:03:13.084569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:11.043187+0000","last_clean_scrub_stamp":"2023-06-08T04:03:11.043187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T13:46:54.630663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085143+0000","last_change":"2023-06-08T04:03:11.070340+0000","last_active":"2023-06-08T04:03:13.085143+0000","last_peered":"2023-06-08T04:03:13.085143+0000","last_clean":"2023-06-08T04:03:13.085143+0000","last_became_active":"2023-06-08T04:03:11.070092+0000","last_became_peered":"2023-06-08T04:03:11.070092+0000","last_unstale":"2023-06-08T04:03:13.085143+0000","last_undegraded":"2023-06-08T04:03:13.085143+0000","last_fullsized":"2023-06-08T04:03:13.085143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:03:10.035471+0000","last_clean_scrub_stamp":"2023-06-08T04:03:10.035471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T09:34:23.165587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-06-08T04:03:13.085802+0000","last_change":"2023-06-08T04:01:50.734174+0000","last_active":"2023-06-08T04:03:13.085802+0000","last_peered":"2023-06-08T04:03:13.085802+0000","last_clean":"2023-06-08T04:03:13.085802+0000","last_became_active":"2023-06-08T04:01:50.733832+0000","last_became_peered":"2023-06-08T04:01:50.733832+0000","last_unstale":"2023-06-08T04:03:13.085802+0000","last_undegraded":"2023-06-08T04:03:13.085802+0000","last_fullsized":"2023-06-08T04:03:13.085802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-08T04:01:49.715387+0000","last_clean_scrub_stamp":"2023-06-08T04:01:49.715387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-09T07:23:14.130272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":757251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.751}]},{"osd":3,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.2189999999999999,"5min":3.2189999999999999,"15min":3.2189999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.0369999999999999,"5min":2.0369999999999999,"15min":2.0369999999999999},"last":0.83799999999999997}]},{"osd":4,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.85799999999999998}]},{"osd":6,"last update":"Thu Jun 8 04:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":165831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.1070000000000002,"5min":3.1070000000000002,"15min":3.1070000000000002},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":4.9669999999999996,"5min":4.9669999999999996,"15min":4.9669999999999996},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.747},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.88}]},{"osd":4,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jun 8 04:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.76600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":755707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.436}]},{"osd":2,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.62}]},{"osd":5,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Jun 8 04:02:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.018}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":164297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.496},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.873}]},{"osd":7,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.90600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":165319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.0679999999999996,"5min":8.0679999999999996,"15min":8.0679999999999996},"last":0.432}]},{"osd":1,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":8.1020000000000003,"5min":8.1020000000000003,"15min":8.1020000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":8.5199999999999996,"5min":8.5199999999999996,"15min":8.5199999999999996},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.631,"5min":1.631,"15min":1.631},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":18.933,"5min":18.933,"15min":18.933},"last":0.495}]},{"osd":4,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":8.0340000000000007,"5min":8.0340000000000007,"15min":8.0340000000000007},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":12.004,"5min":12.004,"15min":12.004},"last":0.755}]},{"osd":5,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.746,"5min":2.746,"15min":2.746},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":7.9880000000000004,"5min":7.9880000000000004,"15min":7.9880000000000004},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":11.927,"5min":11.927,"15min":11.927},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":7.9409999999999998,"5min":7.9409999999999998,"15min":7.9409999999999998},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":11.971,"5min":11.971,"15min":11.971},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.59399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":166847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.437}]},{"osd":1,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.75}]},{"osd":5,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":3.4489999999999998,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jun 8 04:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.71099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":405504,"data_stored":165853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jun 8 04:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.74099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":405504,"data_stored":165361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":3.7879999999999998,"5min":3.7879999999999998,"15min":3.7879999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.8959999999999999,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":0.625},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":3.0630000000000002,"5min":3.0630000000000002,"15min":3.0630000000000002},"last":0.875}]},{"osd":3,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.7000000000000002,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jun 8 04:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.91300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-08T04:03:16.486 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-08T04:03:16.486 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-08T04:03:16.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.724+0000 7fb359fff700 1 Processor -- start 2023-06-08T04:03:16.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.724+0000 7fb359fff700 1 -- start start 2023-06-08T04:03:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.725+0000 7fb359fff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb354160a60 0x7fb3540b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.725+0000 7fb359fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3540b4b50 0x7fb3540d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.725+0000 7fb359fff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3540d0800 con 0x7fb3540b83f0 2023-06-08T04:03:16.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.725+0000 7fb359fff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb354160ed0 con 0x7fb354160a60 2023-06-08T04:03:16.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.725+0000 7fb359fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540b4fd0 con 0x7fb3540b4b50 2023-06-08T04:03:16.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.726+0000 7fb353fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3540b4b50 0x7fb3540d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.726+0000 7fb352ffd700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb354160a60 0x7fb3540b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.726+0000 7fb353fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3540b4b50 0x7fb3540d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:51150/0 (socket says 172.21.15.16:51150) 2023-06-08T04:03:16.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.726+0000 7fb353fff700 1 -- 172.21.15.16:0/2440905970 learned_addr learned my addr 172.21.15.16:0/2440905970 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:16.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.726+0000 7fb3537fe700 1 --1- 172.21.15.16:0/2440905970 >> v1:172.21.15.169:6789/0 conn(0x7fb3540b83f0 0x7fb3540ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:44382/0 (socket says 172.21.15.16:44382) 2023-06-08T04:03:16.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.726+0000 7fb352ffd700 1 -- 172.21.15.16:0/2440905970 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3540b4b50 msgr2=0x7fb3540d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:16.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.726+0000 7fb352ffd700 1 --2- 172.21.15.16:0/2440905970 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3540b4b50 0x7fb3540d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.726+0000 7fb352ffd700 1 -- 172.21.15.16:0/2440905970 >> v1:172.21.15.169:6789/0 conn(0x7fb3540b83f0 legacy=0x7fb3540ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:16.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.726+0000 7fb352ffd700 1 -- 172.21.15.16:0/2440905970 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3540cd1e0 con 0x7fb354160a60 2023-06-08T04:03:16.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.726+0000 7fb3527fc700 1 -- 172.21.15.16:0/2440905970 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834565323 0 0) 0x7fb3540d0800 con 0x7fb3540b83f0 2023-06-08T04:03:16.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.726+0000 7fb353fff700 1 --2- 172.21.15.16:0/2440905970 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3540b4b50 0x7fb3540d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:03:16.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.727+0000 7fb352ffd700 1 --2- 172.21.15.16:0/2440905970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb354160a60 0x7fb3540b4610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb348009840 tx=0x7fb348009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b43f800998e2a553 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:16.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.727+0000 7fb3527fc700 1 -- 172.21.15.16:0/2440905970 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348011830 con 0x7fb354160a60 2023-06-08T04:03:16.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.727+0000 7fb3527fc700 1 -- 172.21.15.16:0/2440905970 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348011990 con 0x7fb354160a60 2023-06-08T04:03:16.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.727+0000 7fb3527fc700 1 -- 172.21.15.16:0/2440905970 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348011d20 con 0x7fb354160a60 2023-06-08T04:03:16.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.727+0000 7fb359fff700 1 -- 172.21.15.16:0/2440905970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb354160a60 msgr2=0x7fb3540b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:16.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.727+0000 7fb359fff700 1 --2- 172.21.15.16:0/2440905970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb354160a60 0x7fb3540b4610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb348009840 tx=0x7fb348009b50 comp rx=0 tx=0).stop 2023-06-08T04:03:16.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.728+0000 7fb359fff700 1 -- 172.21.15.16:0/2440905970 shutdown_connections 2023-06-08T04:03:16.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.728+0000 7fb359fff700 1 --2- 172.21.15.16:0/2440905970 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb3540b4b50 0x7fb3540d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.728+0000 7fb359fff700 1 --2- 172.21.15.16:0/2440905970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb354160a60 0x7fb3540b4610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.728+0000 7fb359fff700 1 -- 172.21.15.16:0/2440905970 >> 172.21.15.16:0/2440905970 conn(0x7fb3540cf610 msgr2=0x7fb3540cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:16.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.728+0000 7fb359fff700 1 -- 172.21.15.16:0/2440905970 shutdown_connections 2023-06-08T04:03:16.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.728+0000 7fb359fff700 1 -- 172.21.15.16:0/2440905970 wait complete. 2023-06-08T04:03:16.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.729+0000 7fb359fff700 1 Processor -- start 2023-06-08T04:03:16.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.730+0000 7fb359fff700 1 -- start start 2023-06-08T04:03:16.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb359fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3540b4b50 0x7fb3540c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb359fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3540b83f0 0x7fb35415f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb359fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb354160a60 0x7fb3540c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb359fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540cc370 con 0x7fb3540b83f0 2023-06-08T04:03:16.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb359fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540cb760 con 0x7fb3540b4b50 2023-06-08T04:03:16.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb359fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3540cba40 con 0x7fb354160a60 2023-06-08T04:03:16.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb352ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3540b83f0 0x7fb35415f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb352ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3540b83f0 0x7fb35415f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37756/0 (socket says 172.21.15.16:37756) 2023-06-08T04:03:16.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb352ffd700 1 -- 172.21.15.16:0/1284134169 learned_addr learned my addr 172.21.15.16:0/1284134169 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:16.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb3537fe700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3540b4b50 0x7fb3540c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb353fff700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb354160a60 0x7fb3540c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb352ffd700 1 -- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb354160a60 msgr2=0x7fb3540c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:16.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb352ffd700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb354160a60 0x7fb3540c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb352ffd700 1 -- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3540b4b50 msgr2=0x7fb3540c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:16.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb352ffd700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3540b4b50 0x7fb3540c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:16.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.731+0000 7fb352ffd700 1 -- 172.21.15.16:0/1284134169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c009b30 con 0x7fb3540b83f0 2023-06-08T04:03:16.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.732+0000 7fb352ffd700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3540b83f0 0x7fb35415f2a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb348009b90 tx=0x7fb348004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:16.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.732+0000 7fb33bfff700 1 -- 172.21.15.16:0/1284134169 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480036a0 con 0x7fb3540b83f0 2023-06-08T04:03:16.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.732+0000 7fb33bfff700 1 -- 172.21.15.16:0/1284134169 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34801e070 con 0x7fb3540b83f0 2023-06-08T04:03:16.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.732+0000 7fb359fff700 1 -- 172.21.15.16:0/1284134169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3480094a0 con 0x7fb3540b83f0 2023-06-08T04:03:16.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.732+0000 7fb33bfff700 1 -- 172.21.15.16:0/1284134169 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348003a20 con 0x7fb3540b83f0 2023-06-08T04:03:16.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.732+0000 7fb359fff700 1 -- 172.21.15.16:0/1284134169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3540cc000 con 0x7fb3540b83f0 2023-06-08T04:03:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.733+0000 7fb359fff700 1 -- 172.21.15.16:0/1284134169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3540cc4e0 con 0x7fb3540b83f0 2023-06-08T04:03:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.734+0000 7fb33bfff700 1 -- 172.21.15.16:0/1284134169 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb348003b80 con 0x7fb3540b83f0 2023-06-08T04:03:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.735+0000 7fb33bfff700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb34006ace0 0x7fb34006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:16.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.735+0000 7fb33bfff700 1 -- 172.21.15.16:0/1284134169 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb34808a4a0 con 0x7fb3540b83f0 2023-06-08T04:03:16.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.735+0000 7fb3537fe700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb34006ace0 0x7fb34006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:16.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.736+0000 7fb3537fe700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb34006ace0 0x7fb34006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb344007fd0 tx=0x7fb344007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:16.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:16.740+0000 7fb33bfff700 1 -- 172.21.15.16:0/1284134169 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb348055540 con 0x7fb3540b83f0 2023-06-08T04:03:17.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.029+0000 7fb359fff700 1 -- 172.21.15.16:0/1284134169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb3540740e0 con 0x7fb3540b83f0 2023-06-08T04:03:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.033+0000 7fb33bfff700 1 -- 172.21.15.16:0/1284134169 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb348058b60 con 0x7fb3540b83f0 2023-06-08T04:03:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 -- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb34006ace0 msgr2=0x7fb34006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb34006ace0 0x7fb34006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb344007fd0 tx=0x7fb344007de0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 -- 172.21.15.16:0/1284134169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3540b83f0 msgr2=0x7fb35415f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3540b83f0 0x7fb35415f2a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb348009b90 tx=0x7fb348004750 comp rx=0 tx=0).stop 2023-06-08T04:03:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 -- 172.21.15.16:0/1284134169 shutdown_connections 2023-06-08T04:03:17.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fb34006ace0 0x7fb34006d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb354160a60 0x7fb3540c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3540b4b50 0x7fb3540c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 --2- 172.21.15.16:0/1284134169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3540b83f0 0x7fb35415f2a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 -- 172.21.15.16:0/1284134169 >> 172.21.15.16:0/1284134169 conn(0x7fb3540cf610 msgr2=0x7fb3540b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 -- 172.21.15.16:0/1284134169 shutdown_connections 2023-06-08T04:03:17.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.036+0000 7fb359fff700 1 -- 172.21.15.16:0/1284134169 wait complete. 2023-06-08T04:03:17.042 INFO:teuthology.orchestra.run.smithi016.stderr:updated caps for client.0 2023-06-08T04:03:17.058 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-08T04:03:17.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.254+0000 7f1e1ffff700 1 Processor -- start 2023-06-08T04:03:17.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.254+0000 7f1e1ffff700 1 -- start start 2023-06-08T04:03:17.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.255+0000 7f1e1ffff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e180b83f0 0x7f1e18160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:17.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.255+0000 7f1e1ffff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e180d0800 con 0x7f1e180b4d20 2023-06-08T04:03:17.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.255+0000 7f1e1ffff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e180cd1e0 con 0x7f1e180ced40 2023-06-08T04:03:17.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.255+0000 7f1e1ffff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180cd4c0 con 0x7f1e180b83f0 2023-06-08T04:03:17.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.256+0000 7f1e1e59c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1e180b4d20 0x7f1e180d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51126/0 (socket says 172.21.15.16:51126) 2023-06-08T04:03:17.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.256+0000 7f1e1e59c700 1 -- 172.21.15.16:0/4106354822 learned_addr learned my addr 172.21.15.16:0/4106354822 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:17.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.256+0000 7f1e1dd9b700 1 --2- 172.21.15.16:0/4106354822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e180b83f0 0x7f1e18160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:17.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.256+0000 7f1e1cd99700 1 -- 172.21.15.16:0/4106354822 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072355141 0 0) 0x7f1e180d0800 con 0x7f1e180b4d20 2023-06-08T04:03:17.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.256+0000 7f1e1cd99700 1 -- 172.21.15.16:0/4106354822 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e040035b0 con 0x7f1e180b4d20 2023-06-08T04:03:17.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.256+0000 7f1e1cd99700 1 -- 172.21.15.16:0/4106354822 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952542487 0 0) 0x7f1e180cd1e0 con 0x7f1e180ced40 2023-06-08T04:03:17.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.256+0000 7f1e1cd99700 1 -- 172.21.15.16:0/4106354822 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e180d0800 con 0x7f1e180ced40 2023-06-08T04:03:17.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.256+0000 7f1e1dd9b700 1 -- 172.21.15.16:0/4106354822 >> v1:172.21.15.169:6789/0 conn(0x7f1e180ced40 legacy=0x7f1e180b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:17.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.256+0000 7f1e1dd9b700 1 -- 172.21.15.16:0/4106354822 >> v1:172.21.15.16:6789/0 conn(0x7f1e180b4d20 legacy=0x7f1e180d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:17.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.256+0000 7f1e1dd9b700 1 -- 172.21.15.16:0/4106354822 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180d0aa0 con 0x7f1e180b83f0 2023-06-08T04:03:17.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.257+0000 7f1e1dd9b700 1 --2- 172.21.15.16:0/4106354822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e180b83f0 0x7f1e18160a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009870 tx=0x7f1e14009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a378b17b83b83512 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:17.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.257+0000 7f1e1cd99700 1 -- 172.21.15.16:0/4106354822 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14004230 con 0x7f1e180b83f0 2023-06-08T04:03:17.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.257+0000 7f1e1cd99700 1 -- 172.21.15.16:0/4106354822 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e14004390 con 0x7f1e180b83f0 2023-06-08T04:03:17.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.257+0000 7f1e1cd99700 1 -- 172.21.15.16:0/4106354822 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e140036a0 con 0x7f1e180b83f0 2023-06-08T04:03:17.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.257+0000 7f1e1ffff700 1 -- 172.21.15.16:0/4106354822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e180b83f0 msgr2=0x7f1e18160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:17.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.257+0000 7f1e1ffff700 1 --2- 172.21.15.16:0/4106354822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e180b83f0 0x7f1e18160a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009870 tx=0x7f1e14009b80 comp rx=0 tx=0).stop 2023-06-08T04:03:17.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.257+0000 7f1e1ffff700 1 -- 172.21.15.16:0/4106354822 shutdown_connections 2023-06-08T04:03:17.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.257+0000 7f1e1ffff700 1 --2- 172.21.15.16:0/4106354822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e180b83f0 0x7f1e18160a60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.258+0000 7f1e1ffff700 1 -- 172.21.15.16:0/4106354822 >> 172.21.15.16:0/4106354822 conn(0x7f1e180cf610 msgr2=0x7f1e180cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:17.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.258+0000 7f1e1ffff700 1 -- 172.21.15.16:0/4106354822 shutdown_connections 2023-06-08T04:03:17.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.258+0000 7f1e1ffff700 1 -- 172.21.15.16:0/4106354822 wait complete. 2023-06-08T04:03:17.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.259+0000 7f1e1ffff700 1 Processor -- start 2023-06-08T04:03:17.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.259+0000 7f1e1ffff700 1 -- start start 2023-06-08T04:03:17.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.260+0000 7f1e1ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e180b4d20 0x7f1e18154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:17.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.260+0000 7f1e1ffff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e180b83f0 0x7f1e180b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:17.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.260+0000 7f1e1ffff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e180ced40 0x7f1e180b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:17.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.260+0000 7f1e1ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1815e550 con 0x7f1e180b4d20 2023-06-08T04:03:17.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.260+0000 7f1e1ffff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181549a0 con 0x7f1e180ced40 2023-06-08T04:03:17.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.260+0000 7f1e1ffff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1815cf30 con 0x7f1e180b83f0 2023-06-08T04:03:17.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.261+0000 7f1e1dd9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e180b4d20 0x7f1e18154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:17.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.261+0000 7f1e1dd9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e180b4d20 0x7f1e18154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37770/0 (socket says 172.21.15.16:37770) 2023-06-08T04:03:17.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.261+0000 7f1e1dd9b700 1 -- 172.21.15.16:0/2747910941 learned_addr learned my addr 172.21.15.16:0/2747910941 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:17.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.261+0000 7f1e1dd9b700 1 -- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e180b83f0 msgr2=0x7f1e180b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:17.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.261+0000 7f1e1dd9b700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e180b83f0 0x7f1e180b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.261+0000 7f1e1dd9b700 1 -- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e180ced40 msgr2=0x7f1e180b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:17.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.261+0000 7f1e1dd9b700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e180ced40 0x7f1e180b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.261+0000 7f1e1dd9b700 1 -- 172.21.15.16:0/2747910941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e140094a0 con 0x7f1e180b4d20 2023-06-08T04:03:17.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.261+0000 7f1e1dd9b700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e180b4d20 0x7f1e18154460 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1e140090b0 tx=0x7f1e14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:17.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.262+0000 7f1e0e7fc700 1 -- 172.21.15.16:0/2747910941 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14003ea0 con 0x7f1e180b4d20 2023-06-08T04:03:17.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.262+0000 7f1e1ffff700 1 -- 172.21.15.16:0/2747910941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1815d210 con 0x7f1e180b4d20 2023-06-08T04:03:17.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.262+0000 7f1e0e7fc700 1 -- 172.21.15.16:0/2747910941 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1401e070 con 0x7f1e180b4d20 2023-06-08T04:03:17.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.262+0000 7f1e0e7fc700 1 -- 172.21.15.16:0/2747910941 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14011870 con 0x7f1e180b4d20 2023-06-08T04:03:17.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.262+0000 7f1e1ffff700 1 -- 172.21.15.16:0/2747910941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1815d7d0 con 0x7f1e180b4d20 2023-06-08T04:03:17.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.263+0000 7f1e1ffff700 1 -- 172.21.15.16:0/2747910941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1815d9c0 con 0x7f1e180b4d20 2023-06-08T04:03:17.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.264+0000 7f1e0e7fc700 1 -- 172.21.15.16:0/2747910941 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e140119d0 con 0x7f1e180b4d20 2023-06-08T04:03:17.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.265+0000 7f1e0e7fc700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1dfc06ace0 0x7f1dfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:17.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.265+0000 7f1e0e7fc700 1 -- 172.21.15.16:0/2747910941 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e1408a660 con 0x7f1e180b4d20 2023-06-08T04:03:17.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.265+0000 7f1e1d59a700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1dfc06ace0 0x7f1dfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:17.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.266+0000 7f1e1d59a700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1dfc06ace0 0x7f1dfc06d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1e08000f60 tx=0x7f1e08007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:17.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.269+0000 7f1e0e7fc700 1 -- 172.21.15.16:0/2747910941 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e14055720 con 0x7f1e180b4d20 2023-06-08T04:03:17.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.518+0000 7f1e1ffff700 1 -- 172.21.15.16:0/2747910941 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e180740e0 con 0x7f1e180b4d20 2023-06-08T04:03:17.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.519+0000 7f1e0e7fc700 1 -- 172.21.15.16:0/2747910941 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4677 (secure 0 0 0) 0x7f1e14058d40 con 0x7f1e180b4d20 2023-06-08T04:03:17.523 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:17.523 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6836/2291587896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":2291587896},{"type":"v1","addr":"172.21.15.169:6836","nonce":2291587896}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4838,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4137260434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6834","nonce":4137260434},{"type":"v1","addr":"172.21.15.16:6835","nonce":4137260434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5059,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1096417178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6835","nonce":1096417178},{"type":"v1","addr":"172.21.15.169:6837","nonce":1096417178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-08T04:03:11.563705+0000","modified":"2023-06-08T04:03:14.570288+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5127},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5127":{"gid":5127,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.16:6833/3183010605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3183010605},{"type":"v1","addr":"172.21.15.16:6833","nonce":3183010605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-08T04:03:17.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.521+0000 7f1e1ffff700 1 -- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1dfc06ace0 msgr2=0x7f1dfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:17.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.521+0000 7f1e1ffff700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1dfc06ace0 0x7f1dfc06d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1e08000f60 tx=0x7f1e08007a40 comp rx=0 tx=0).stop 2023-06-08T04:03:17.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.521+0000 7f1e1ffff700 1 -- 172.21.15.16:0/2747910941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e180b4d20 msgr2=0x7f1e18154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:17.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.521+0000 7f1e1ffff700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e180b4d20 0x7f1e18154460 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1e140090b0 tx=0x7f1e14004750 comp rx=0 tx=0).stop 2023-06-08T04:03:17.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.521+0000 7f1e1ffff700 1 -- 172.21.15.16:0/2747910941 shutdown_connections 2023-06-08T04:03:17.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.521+0000 7f1e1ffff700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f1dfc06ace0 0x7f1dfc06d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.521+0000 7f1e1ffff700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e180ced40 0x7f1e180b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.521+0000 7f1e1ffff700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e180b4d20 0x7f1e18154460 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.521+0000 7f1e1ffff700 1 --2- 172.21.15.16:0/2747910941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1e180b83f0 0x7f1e180b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:17.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.521+0000 7f1e1ffff700 1 -- 172.21.15.16:0/2747910941 >> 172.21.15.16:0/2747910941 conn(0x7f1e180cf610 msgr2=0x7f1e180d1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:17.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.522+0000 7f1e1ffff700 1 -- 172.21.15.16:0/2747910941 shutdown_connections 2023-06-08T04:03:17.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:17.522+0000 7f1e1ffff700 1 -- 172.21.15.16:0/2747910941 wait complete. 2023-06-08T04:03:17.527 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 15 2023-06-08T04:03:17.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-08T04:03:11.563705+0000', 'modified': '2023-06-08T04:03:14.570288+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5127}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5127': {'gid': 5127, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.16:6833/3183010605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 3183010605}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 3183010605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-08T04:03:17.946 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-08T04:03:17.946 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-06-08T04:03:18.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.147+0000 7f872f7ff700 1 Processor -- start 2023-06-08T04:03:18.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.147+0000 7f872f7ff700 1 -- start start 2023-06-08T04:03:18.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.148+0000 7f872f7ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f87280b83f0 0x7f8728160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.148+0000 7f872f7ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87280d0800 con 0x7f87280b4d20 2023-06-08T04:03:18.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.148+0000 7f872f7ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87280cd1e0 con 0x7f87280ced40 2023-06-08T04:03:18.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.148+0000 7f872f7ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87280cd4c0 con 0x7f87280b83f0 2023-06-08T04:03:18.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.148+0000 7f872d59b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f87280b83f0 0x7f8728160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.148+0000 7f872dd9c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f87280b4d20 0x7f87280d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51130/0 (socket says 172.21.15.16:51130) 2023-06-08T04:03:18.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.148+0000 7f872dd9c700 1 -- 172.21.15.16:0/1114433592 learned_addr learned my addr 172.21.15.16:0/1114433592 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:03:18.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.149+0000 7f872d59b700 1 -- 172.21.15.16:0/1114433592 >> v1:172.21.15.169:6789/0 conn(0x7f87280ced40 legacy=0x7f87280b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:18.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.149+0000 7f872d59b700 1 -- 172.21.15.16:0/1114433592 >> v1:172.21.15.16:6789/0 conn(0x7f87280b4d20 legacy=0x7f87280d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.149+0000 7f871ffff700 1 -- 172.21.15.16:0/1114433592 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998317687 0 0) 0x7f87280d0800 con 0x7f87280b4d20 2023-06-08T04:03:18.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.149+0000 7f872d59b700 1 -- 172.21.15.16:0/1114433592 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280d0aa0 con 0x7f87280b83f0 2023-06-08T04:03:18.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.149+0000 7f872d59b700 1 --2- 172.21.15.16:0/1114433592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87280b83f0 0x7f8728160a60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8724009840 tx=0x7f8724009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7207451eb124f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:18.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.149+0000 7f871ffff700 1 -- 172.21.15.16:0/1114433592 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724011830 con 0x7f87280b83f0 2023-06-08T04:03:18.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.149+0000 7f871ffff700 1 -- 172.21.15.16:0/1114433592 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8724011990 con 0x7f87280b83f0 2023-06-08T04:03:18.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.149+0000 7f871ffff700 1 -- 172.21.15.16:0/1114433592 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724011d20 con 0x7f87280b83f0 2023-06-08T04:03:18.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.150+0000 7f872f7ff700 1 -- 172.21.15.16:0/1114433592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87280b83f0 msgr2=0x7f8728160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.150+0000 7f872f7ff700 1 --2- 172.21.15.16:0/1114433592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87280b83f0 0x7f8728160a60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8724009840 tx=0x7f8724009b50 comp rx=0 tx=0).stop 2023-06-08T04:03:18.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.150+0000 7f872f7ff700 1 -- 172.21.15.16:0/1114433592 shutdown_connections 2023-06-08T04:03:18.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.150+0000 7f872f7ff700 1 --2- 172.21.15.16:0/1114433592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87280b83f0 0x7f8728160a60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.150+0000 7f872f7ff700 1 -- 172.21.15.16:0/1114433592 >> 172.21.15.16:0/1114433592 conn(0x7f87280cf610 msgr2=0x7f87280cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:18.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.150+0000 7f872f7ff700 1 -- 172.21.15.16:0/1114433592 shutdown_connections 2023-06-08T04:03:18.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.150+0000 7f872f7ff700 1 -- 172.21.15.16:0/1114433592 wait complete. 2023-06-08T04:03:18.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.152+0000 7f872f7ff700 1 Processor -- start 2023-06-08T04:03:18.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.152+0000 7f872f7ff700 1 -- start start 2023-06-08T04:03:18.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872f7ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87280b4d20 0x7f8728150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872f7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87280b83f0 0x7f87281e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872f7ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87280ced40 0x7f87280ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872f7ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872815e3d0 con 0x7f87280b4d20 2023-06-08T04:03:18.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872f7ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87281507b0 con 0x7f87280ced40 2023-06-08T04:03:18.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872f7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872815dae0 con 0x7f87280b83f0 2023-06-08T04:03:18.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872d59b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87280b4d20 0x7f8728150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872d59b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87280b4d20 0x7f8728150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37784/0 (socket says 172.21.15.16:37784) 2023-06-08T04:03:18.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872d59b700 1 -- 172.21.15.16:0/3848451726 learned_addr learned my addr 172.21.15.16:0/3848451726 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:18.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872d59b700 1 -- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87280b83f0 msgr2=0x7f87281e5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872d59b700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87280b83f0 0x7f87281e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872d59b700 1 -- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87280ced40 msgr2=0x7f87280ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872d59b700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87280ced40 0x7f87280ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.153+0000 7f872d59b700 1 -- 172.21.15.16:0/3848451726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240094a0 con 0x7f87280b4d20 2023-06-08T04:03:18.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.154+0000 7f872d59b700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87280b4d20 0x7f8728150270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f872806aca0 tx=0x7f8724004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:18.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.154+0000 7f871dffb700 1 -- 172.21.15.16:0/3848451726 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872401a940 con 0x7f87280b4d20 2023-06-08T04:03:18.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.154+0000 7f871dffb700 1 -- 172.21.15.16:0/3848451726 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872401aac0 con 0x7f87280b4d20 2023-06-08T04:03:18.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.154+0000 7f871dffb700 1 -- 172.21.15.16:0/3848451726 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872401ae70 con 0x7f87280b4d20 2023-06-08T04:03:18.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.154+0000 7f872f7ff700 1 -- 172.21.15.16:0/3848451726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872815dd80 con 0x7f87280b4d20 2023-06-08T04:03:18.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.154+0000 7f872f7ff700 1 -- 172.21.15.16:0/3848451726 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87281e6270 con 0x7f87280b4d20 2023-06-08T04:03:18.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.157+0000 7f871dffb700 1 -- 172.21.15.16:0/3848451726 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8724022070 con 0x7f87280b4d20 2023-06-08T04:03:18.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.158+0000 7f871dffb700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f870c06ace0 0x7f870c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.158+0000 7f871dffb700 1 -- 172.21.15.16:0/3848451726 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f872408a890 con 0x7f87280b4d20 2023-06-08T04:03:18.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.158+0000 7f872cd9a700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f870c06ace0 0x7f870c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.159+0000 7f872cd9a700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f870c06ace0 0x7f870c06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8718000f60 tx=0x7f8718007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:18.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.160+0000 7f8743069b80 1 Processor -- start 2023-06-08T04:03:18.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.160+0000 7f8743069b80 1 -- start start 2023-06-08T04:03:18.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.161+0000 7f8743069b80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7e96de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.161+0000 7f8743069b80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e6ddd0 0x55d2b7e9aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.161+0000 7f8743069b80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e6e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.161+0000 7f8743069b80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7d59600 con 0x55d2b7e9b010 2023-06-08T04:03:18.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.161+0000 7f8743069b80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7dc8490 con 0x55d2b7e8fb40 2023-06-08T04:03:18.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.161+0000 7f8743069b80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7dc1760 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.161+0000 7f872dd9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e6e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.161+0000 7f872dd9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e6e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37786/0 (socket says 172.21.15.16:37786) 2023-06-08T04:03:18.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.161+0000 7f872dd9c700 1 -- 172.21.15.16:0/2508269641 learned_addr learned my addr 172.21.15.16:0/2508269641 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:18.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.161+0000 7f872d59b700 1 --2- 172.21.15.16:0/2508269641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7e96de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.161+0000 7f872cd9a700 1 --2- 172.21.15.16:0/2508269641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e6ddd0 0x55d2b7e9aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.162+0000 7f872dd9c700 1 -- 172.21.15.16:0/2508269641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e6ddd0 msgr2=0x55d2b7e9aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:18.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.162+0000 7f872dd9c700 1 --2- 172.21.15.16:0/2508269641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e6ddd0 0x55d2b7e9aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.162+0000 7f872dd9c700 1 -- 172.21.15.16:0/2508269641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 msgr2=0x55d2b7e96de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:18.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.162+0000 7f872dd9c700 1 --2- 172.21.15.16:0/2508269641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7e96de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.162+0000 7f872dd9c700 1 -- 172.21.15.16:0/2508269641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2b7bb5790 con 0x55d2b7e9b010 2023-06-08T04:03:18.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.162+0000 7f872dd9c700 1 --2- 172.21.15.16:0/2508269641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e6e480 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8720002160 tx=0x7f872000c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93162039d6e5612f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:18.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.162+0000 7f870affd700 1 -- 172.21.15.16:0/2508269641 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87200070d0 con 0x55d2b7e9b010 2023-06-08T04:03:18.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.162+0000 7f870affd700 1 -- 172.21.15.16:0/2508269641 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8720007230 con 0x55d2b7e9b010 2023-06-08T04:03:18.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.162+0000 7f870affd700 1 -- 172.21.15.16:0/2508269641 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87200075c0 con 0x55d2b7e9b010 2023-06-08T04:03:18.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.163+0000 7f8743069b80 1 -- 172.21.15.16:0/2508269641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 msgr2=0x55d2b7e6e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.163+0000 7f8743069b80 1 --2- 172.21.15.16:0/2508269641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e6e480 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8720002160 tx=0x7f872000c3c0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.163+0000 7f8743069b80 1 -- 172.21.15.16:0/2508269641 shutdown_connections 2023-06-08T04:03:18.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.163+0000 7f8743069b80 1 --2- 172.21.15.16:0/2508269641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e6e480 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.163+0000 7f8743069b80 1 --2- 172.21.15.16:0/2508269641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7e96de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.163+0000 7f8743069b80 1 --2- 172.21.15.16:0/2508269641 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e6ddd0 0x55d2b7e9aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.163+0000 7f8743069b80 1 -- 172.21.15.16:0/2508269641 >> 172.21.15.16:0/2508269641 conn(0x55d2b7e65430 msgr2=0x55d2b7eb56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:18.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.163+0000 7f8743069b80 1 -- 172.21.15.16:0/2508269641 shutdown_connections 2023-06-08T04:03:18.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.163+0000 7f8743069b80 1 -- 172.21.15.16:0/2508269641 wait complete. 2023-06-08T04:03:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.164+0000 7f8743069b80 1 -- start start 2023-06-08T04:03:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.164+0000 7f8743069b80 1 Processor -- start 2023-06-08T04:03:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f8743069b80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e6ddd0 0x55d2b7e69ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f8743069b80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7eb3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f8743069b80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e8e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f8743069b80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7d7f5b0 con 0x55d2b7e9b010 2023-06-08T04:03:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f8743069b80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7d65910 con 0x55d2b7e8fb40 2023-06-08T04:03:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f8743069b80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7bb6390 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f8743069b80 10 client.0 _ll_register_callbacks cb 0x55d2b7dc9d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-08T04:03:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f872dd9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e8e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f872dd9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e8e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37788/0 (socket says 172.21.15.16:37788) 2023-06-08T04:03:18.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f872dd9c700 1 -- 172.21.15.16:0/3135205544 learned_addr learned my addr 172.21.15.16:0/3135205544 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:18.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f872d59b700 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e6ddd0 0x55d2b7e69ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.165+0000 7f872cd9a700 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7eb3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.166+0000 7f872dd9c700 1 -- 172.21.15.16:0/3135205544 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e6ddd0 msgr2=0x55d2b7e69ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:18.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.166+0000 7f872dd9c700 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e6ddd0 0x55d2b7e69ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.166+0000 7f872dd9c700 1 -- 172.21.15.16:0/3135205544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 msgr2=0x55d2b7eb3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:18.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.166+0000 7f872dd9c700 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7eb3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.166+0000 7f872dd9c700 1 -- 172.21.15.16:0/3135205544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8720001dc0 con 0x55d2b7e9b010 2023-06-08T04:03:18.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.166+0000 7f872dd9c700 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e8e4a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8720002230 tx=0x7f8720001470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c63468801cb60ad server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:18.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.166+0000 7f8703fff700 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2023-06-08T04:03:18.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.166+0000 7f8703fff700 1 -- 172.21.15.16:0/3135205544 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720007a40 con 0x55d2b7e9b010 2023-06-08T04:03:18.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.166+0000 7f8743069b80 1 -- 172.21.15.16:0/3135205544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2b7e62a40 con 0x55d2b7e9b010 2023-06-08T04:03:18.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.166+0000 7f8703fff700 1 -- 172.21.15.16:0/3135205544 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8720021c90 con 0x55d2b7e9b010 2023-06-08T04:03:18.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.166+0000 7f8703fff700 1 -- 172.21.15.16:0/3135205544 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8720021e50 con 0x55d2b7e9b010 2023-06-08T04:03:18.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.167+0000 7f8743069b80 10 client.5304 fetch_fsmap learned FSMap version 15 2023-06-08T04:03:18.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.167+0000 7f8743069b80 1 -- 172.21.15.16:0/3135205544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55d2b7ca20a0 con 0x55d2b7e9b010 2023-06-08T04:03:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.167+0000 7f8703fff700 1 -- 172.21.15.16:0/3135205544 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2b7e62a40 con 0x55d2b7e9b010 2023-06-08T04:03:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.167+0000 7f8703fff700 1 -- 172.21.15.16:0/3135205544 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8720029070 con 0x55d2b7e9b010 2023-06-08T04:03:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.167+0000 7f8743069b80 10 client.5304 fetch_fsmap finished waiting for FSMap version 15 2023-06-08T04:03:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.167+0000 7f8743069b80 10 client.5304 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-08T04:03:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.167+0000 7f8743069b80 20 client.5304 populate_metadata read hostname 'smithi016' 2023-06-08T04:03:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.167+0000 7f8743069b80 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.16:6832/3183010605,v1:172.21.15.16:6833/3183010605] conn(0x55d2b7e8eb00 0x55d2b7e99c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.167+0000 7f8743069b80 4 client.5304 mds_command: new command op to 5127 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-08T04:03:18.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.167+0000 7f8743069b80 1 -- 172.21.15.16:0/3135205544 --> [v2:172.21.15.16:6832/3183010605,v1:172.21.15.16:6833/3183010605] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2b7e3f460 con 0x55d2b7e8eb00 2023-06-08T04:03:18.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.167+0000 7f872d59b700 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.16:6832/3183010605,v1:172.21.15.16:6833/3183010605] conn(0x55d2b7e8eb00 0x55d2b7e99c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.168+0000 7f8703fff700 10 client.5304 ms_handle_connect on v2:172.21.15.16:6832/3183010605 2023-06-08T04:03:18.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.168+0000 7f872d59b700 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.16:6832/3183010605,v1:172.21.15.16:6833/3183010605] conn(0x55d2b7e8eb00 0x55d2b7e99c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ab68ecfc3ddfe6 server_cookie=4f9856c47670fa8b in_seq=0 out_seq=0 2023-06-08T04:03:18.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.168+0000 7f8703fff700 1 -- 172.21.15.16:0/3135205544 <== mds.0 v2:172.21.15.16:6832/3183010605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d2b7e3f460 con 0x55d2b7e8eb00 2023-06-08T04:03:18.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.168+0000 7f8703fff700 10 client.5304 handle_command_reply: tid=0 2023-06-08T04:03:18.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.168+0000 7f8743069b80 1 client.5304 shutdown 2023-06-08T04:03:18.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8743069b80 1 -- 172.21.15.16:0/3135205544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 msgr2=0x55d2b7e8e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8743069b80 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e8e4a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8720002230 tx=0x7f8720001470 comp rx=0 tx=0).stop 2023-06-08T04:03:18.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8743069b80 1 -- 172.21.15.16:0/3135205544 shutdown_connections 2023-06-08T04:03:18.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8743069b80 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.16:6832/3183010605,v1:172.21.15.16:6833/3183010605] conn(0x55d2b7e8eb00 0x55d2b7e99c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8743069b80 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e9b010 0x55d2b7e8e4a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8743069b80 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e6ddd0 0x55d2b7e69ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8743069b80 1 --2- 172.21.15.16:0/3135205544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7eb3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8743069b80 1 -- 172.21.15.16:0/3135205544 >> 172.21.15.16:0/3135205544 conn(0x55d2b7e65430 msgr2=0x55d2b7e6ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:18.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8703fff700 0 client.5304 ms_handle_reset on v2:172.21.15.16:6832/3183010605 2023-06-08T04:03:18.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8743069b80 1 -- 172.21.15.16:0/3135205544 shutdown_connections 2023-06-08T04:03:18.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8743069b80 1 -- 172.21.15.16:0/3135205544 wait complete. 2023-06-08T04:03:18.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.169+0000 7f8743069b80 20 client.5304 trim_cache size 0 max 16384 2023-06-08T04:03:18.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.187+0000 7f8743069b80 1 Processor -- start 2023-06-08T04:03:18.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.187+0000 7f8743069b80 1 -- start start 2023-06-08T04:03:18.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.188+0000 7f8743069b80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 0x55d2b7eb2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.188+0000 7f8743069b80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e6ddd0 0x55d2b7e98a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.188+0000 7f8743069b80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e8fb40 0x55d2b7eac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.188+0000 7f8743069b80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7eb5d20 con 0x55d2b7e8fb40 2023-06-08T04:03:18.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.188+0000 7f8743069b80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7e98f70 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.188+0000 7f8743069b80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7eb33f0 con 0x55d2b7e65430 2023-06-08T04:03:18.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.188+0000 7f872dd9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e8fb40 0x55d2b7eac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.188+0000 7f872dd9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e8fb40 0x55d2b7eac3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37798/0 (socket says 172.21.15.16:37798) 2023-06-08T04:03:18.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.188+0000 7f872dd9c700 1 -- 172.21.15.16:0/2575591255 learned_addr learned my addr 172.21.15.16:0/2575591255 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:18.194 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.188+0000 7f872d59b700 1 --2- 172.21.15.16:0/2575591255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 0x55d2b7eb2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.188+0000 7f872cd9a700 1 --2- 172.21.15.16:0/2575591255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e6ddd0 0x55d2b7e98a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.189+0000 7f872dd9c700 1 -- 172.21.15.16:0/2575591255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 msgr2=0x55d2b7eb2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:18.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.189+0000 7f872dd9c700 1 --2- 172.21.15.16:0/2575591255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 0x55d2b7eb2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.189+0000 7f872dd9c700 1 -- 172.21.15.16:0/2575591255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e6ddd0 msgr2=0x55d2b7e98a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:18.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.189+0000 7f872dd9c700 1 --2- 172.21.15.16:0/2575591255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e6ddd0 0x55d2b7e98a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.189+0000 7f872dd9c700 1 -- 172.21.15.16:0/2575591255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2b7e98070 con 0x55d2b7e8fb40 2023-06-08T04:03:18.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.189+0000 7f872d59b700 1 --2- 172.21.15.16:0/2575591255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 0x55d2b7eb2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:18.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.189+0000 7f872cd9a700 1 --2- 172.21.15.16:0/2575591255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e6ddd0 0x55d2b7e98a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:18.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.189+0000 7f872dd9c700 1 --2- 172.21.15.16:0/2575591255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e8fb40 0x55d2b7eac3b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8720001380 tx=0x7f872000c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c24db1efeca9fab server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:18.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.189+0000 7f870b7fe700 1 -- 172.21.15.16:0/2575591255 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720014e20 con 0x55d2b7e8fb40 2023-06-08T04:03:18.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.189+0000 7f870b7fe700 1 -- 172.21.15.16:0/2575591255 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8720014770 con 0x55d2b7e8fb40 2023-06-08T04:03:18.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.189+0000 7f870b7fe700 1 -- 172.21.15.16:0/2575591255 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720007680 con 0x55d2b7e8fb40 2023-06-08T04:03:18.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.190+0000 7f8743069b80 1 -- 172.21.15.16:0/2575591255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e8fb40 msgr2=0x55d2b7eac3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.190+0000 7f8743069b80 1 --2- 172.21.15.16:0/2575591255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e8fb40 0x55d2b7eac3b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8720001380 tx=0x7f872000c050 comp rx=0 tx=0).stop 2023-06-08T04:03:18.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.190+0000 7f8743069b80 1 -- 172.21.15.16:0/2575591255 shutdown_connections 2023-06-08T04:03:18.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.190+0000 7f8743069b80 1 --2- 172.21.15.16:0/2575591255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e8fb40 0x55d2b7eac3b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.190+0000 7f8743069b80 1 --2- 172.21.15.16:0/2575591255 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 0x55d2b7eb2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.190+0000 7f8743069b80 1 --2- 172.21.15.16:0/2575591255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e6ddd0 0x55d2b7e98a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.190+0000 7f8743069b80 1 -- 172.21.15.16:0/2575591255 >> 172.21.15.16:0/2575591255 conn(0x55d2b7e6bb80 msgr2=0x55d2b7e698d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:18.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.190+0000 7f8743069b80 1 -- 172.21.15.16:0/2575591255 shutdown_connections 2023-06-08T04:03:18.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.190+0000 7f8743069b80 1 -- 172.21.15.16:0/2575591255 wait complete. 2023-06-08T04:03:18.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.191+0000 7f8743069b80 1 -- start start 2023-06-08T04:03:18.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.191+0000 7f8743069b80 1 Processor -- start 2023-06-08T04:03:18.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f8743069b80 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 0x55d2b7f1c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f8743069b80 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e6ddd0 0x55d2b7e98240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f8743069b80 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7e98780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f8743069b80 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7eb5a30 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f8743069b80 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7e9e0a0 con 0x55d2b7e8fb40 2023-06-08T04:03:18.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f8743069b80 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2b7eb8b80 con 0x55d2b7e65430 2023-06-08T04:03:18.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f8743069b80 10 client.0 _ll_register_callbacks cb 0x7f8720001fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-08T04:03:18.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f872cd9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e6ddd0 0x55d2b7e98240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f872cd9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e6ddd0 0x55d2b7e98240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37808/0 (socket says 172.21.15.16:37808) 2023-06-08T04:03:18.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f872cd9a700 1 -- 172.21.15.16:0/3333595299 learned_addr learned my addr 172.21.15.16:0/3333595299 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:18.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f872dd9c700 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7e98780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.192+0000 7f872d59b700 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 0x55d2b7f1c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f872cd9a700 1 -- 172.21.15.16:0/3333595299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 msgr2=0x55d2b7f1c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:18.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f872cd9a700 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 0x55d2b7f1c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f872cd9a700 1 -- 172.21.15.16:0/3333595299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 msgr2=0x55d2b7e98780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:18.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f872cd9a700 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7e98780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f872cd9a700 1 -- 172.21.15.16:0/3333595299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2b7ca20a0 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f872d59b700 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 0x55d2b7f1c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:18.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f872cd9a700 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e6ddd0 0x55d2b7e98240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8728151400 tx=0x7f871800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ec2d79278ac98f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:18.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f8703fff700 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2023-06-08T04:03:18.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f8703fff700 1 -- 172.21.15.16:0/3333595299 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718005320 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f8743069b80 1 -- 172.21.15.16:0/3333595299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8720007230 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f8703fff700 1 -- 172.21.15.16:0/3333595299 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8718005480 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f8703fff700 1 -- 172.21.15.16:0/3333595299 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8718006860 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f8743069b80 10 client.5310 fetch_fsmap learned FSMap version 15 2023-06-08T04:03:18.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.193+0000 7f8743069b80 1 -- 172.21.15.16:0/3333595299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55d2b7d87b10 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.194+0000 7f8703fff700 1 -- 172.21.15.16:0/3333595299 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8720007230 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.194+0000 7f8703fff700 1 -- 172.21.15.16:0/3333595299 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 15) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f871802b070 con 0x55d2b7e6ddd0 2023-06-08T04:03:18.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.194+0000 7f8743069b80 10 client.5310 fetch_fsmap finished waiting for FSMap version 15 2023-06-08T04:03:18.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.194+0000 7f8743069b80 10 client.5310 resolve_mds: resolved name 'a' to daemon mds.a 2023-06-08T04:03:18.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.194+0000 7f8743069b80 20 client.5310 populate_metadata read hostname 'smithi016' 2023-06-08T04:03:18.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.194+0000 7f8743069b80 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.16:6832/3183010605,v1:172.21.15.16:6833/3183010605] conn(0x55d2b7e9b010 0x55d2b7f1d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.194+0000 7f8743069b80 4 client.5310 mds_command: new command op to 5127 tid=0[{"prefix": "status"}] 2023-06-08T04:03:18.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.194+0000 7f8743069b80 1 -- 172.21.15.16:0/3333595299 --> [v2:172.21.15.16:6832/3183010605,v1:172.21.15.16:6833/3183010605] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d2b7dba8a0 con 0x55d2b7e9b010 2023-06-08T04:03:18.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.194+0000 7f872d59b700 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.16:6832/3183010605,v1:172.21.15.16:6833/3183010605] conn(0x55d2b7e9b010 0x55d2b7f1d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f872d59b700 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.16:6832/3183010605,v1:172.21.15.16:6833/3183010605] conn(0x55d2b7e9b010 0x55d2b7f1d170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c19666a86c04fb9f server_cookie=c678e4993befbb4c in_seq=0 out_seq=0 2023-06-08T04:03:18.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8703fff700 10 client.5310 ms_handle_connect on v2:172.21.15.16:6832/3183010605 2023-06-08T04:03:18.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8703fff700 1 -- 172.21.15.16:0/3333595299 <== mds.0 v2:172.21.15.16:6832/3183010605 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x55d2b7dba8a0 con 0x55d2b7e9b010 2023-06-08T04:03:18.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8703fff700 10 client.5310 handle_command_reply: tid=0 2023-06-08T04:03:18.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 1 client.5310 shutdown 2023-06-08T04:03:18.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 1 -- 172.21.15.16:0/3333595299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e6ddd0 msgr2=0x55d2b7e98240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e6ddd0 0x55d2b7e98240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8728151400 tx=0x7f871800f000 comp rx=0 tx=0).stop 2023-06-08T04:03:18.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 1 -- 172.21.15.16:0/3333595299 shutdown_connections 2023-06-08T04:03:18.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2b7e8fb40 0x55d2b7e98780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55d2b7e65430 0x55d2b7f1c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.16:6832/3183010605,v1:172.21.15.16:6833/3183010605] conn(0x55d2b7e9b010 0x55d2b7f1d170 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 1 --2- 172.21.15.16:0/3333595299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d2b7e6ddd0 0x55d2b7e98240 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8703fff700 0 client.5310 ms_handle_reset on v2:172.21.15.16:6832/3183010605 2023-06-08T04:03:18.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 1 -- 172.21.15.16:0/3333595299 >> 172.21.15.16:0/3333595299 conn(0x55d2b7e6bb80 msgr2=0x55d2b7eac330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:18.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 1 -- 172.21.15.16:0/3333595299 shutdown_connections 2023-06-08T04:03:18.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 1 -- 172.21.15.16:0/3333595299 wait complete. 2023-06-08T04:03:18.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.195+0000 7f8743069b80 20 client.5310 trim_cache size 0 max 16384 2023-06-08T04:03:18.207 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-06-08T04:03:18.207 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "e063be5d-be19-46d2-af9e-e986de4a0b1c", 2023-06-08T04:03:18.208 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2023-06-08T04:03:18.208 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 5127, 2023-06-08T04:03:18.208 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2023-06-08T04:03:18.208 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2023-06-08T04:03:18.208 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2023-06-08T04:03:18.208 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 6.62941819, 2023-06-08T04:03:18.208 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 15, 2023-06-08T04:03:18.208 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 35, 2023-06-08T04:03:18.209 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 35, 2023-06-08T04:03:18.209 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 15.938530408 2023-06-08T04:03:18.209 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-06-08T04:03:18.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 -- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f870c06ace0 msgr2=0x7f870c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f870c06ace0 0x7f870c06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8718000f60 tx=0x7f8718007a40 comp rx=0 tx=0).stop 2023-06-08T04:03:18.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 -- 172.21.15.16:0/3848451726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87280b4d20 msgr2=0x7f8728150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87280b4d20 0x7f8728150270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f872806aca0 tx=0x7f8724004750 comp rx=0 tx=0).stop 2023-06-08T04:03:18.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 -- 172.21.15.16:0/3848451726 shutdown_connections 2023-06-08T04:03:18.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f870c06ace0 0x7f870c06d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87280ced40 0x7f87280ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87280b4d20 0x7f8728150270 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 --2- 172.21.15.16:0/3848451726 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f87280b83f0 0x7f87281e5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 -- 172.21.15.16:0/3848451726 >> 172.21.15.16:0/3848451726 conn(0x7f87280cf610 msgr2=0x7f872815b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:18.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 -- 172.21.15.16:0/3848451726 shutdown_connections 2023-06-08T04:03:18.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.196+0000 7f872f7ff700 1 -- 172.21.15.16:0/3848451726 wait complete. 2023-06-08T04:03:18.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-08T04:03:18.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.413+0000 7f05539ff700 1 Processor -- start 2023-06-08T04:03:18.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.414+0000 7f05539ff700 1 -- start start 2023-06-08T04:03:18.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.415+0000 7f05539ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b83f0 0x7f054c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.415+0000 7f05539ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f054c0ced40 0x7f054c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.415+0000 7f05539ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054c0d0800 con 0x7f054c0b4b50 2023-06-08T04:03:18.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.415+0000 7f05539ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054c0b4fd0 con 0x7f054c0ced40 2023-06-08T04:03:18.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.415+0000 7f05539ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c0cd1e0 con 0x7f054c0b83f0 2023-06-08T04:03:18.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.415+0000 7f055179b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b83f0 0x7f054c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.415+0000 7f0550f9a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f054c0ced40 0x7f054c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.415+0000 7f055179b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b83f0 0x7f054c160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:51238/0 (socket says 172.21.15.16:51238) 2023-06-08T04:03:18.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.415+0000 7f0550f9a700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f054c0ced40 0x7f054c0b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:33342/0 (socket says 172.21.15.16:33342) 2023-06-08T04:03:18.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.415+0000 7f055179b700 1 -- 172.21.15.16:0/1522952018 learned_addr learned my addr 172.21.15.16:0/1522952018 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:18.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.416+0000 7f055179b700 1 -- 172.21.15.16:0/1522952018 >> v2:172.21.15.169:3300/0 conn(0x7f054c0ced40 msgr2=0x7f054c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:18.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.416+0000 7f055179b700 1 --2- 172.21.15.16:0/1522952018 >> v2:172.21.15.169:3300/0 conn(0x7f054c0ced40 0x7f054c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.416+0000 7f055179b700 1 -- 172.21.15.16:0/1522952018 >> v1:172.21.15.169:6789/0 conn(0x7f054c0b4b50 legacy=0x7f054c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.416+0000 7f055179b700 1 -- 172.21.15.16:0/1522952018 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c0cd4c0 con 0x7f054c0b83f0 2023-06-08T04:03:18.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.416+0000 7f055179b700 1 --2- 172.21.15.16:0/1522952018 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b83f0 0x7f054c160a60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f05480098f0 tx=0x7f0548009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a48cf5ce328a2d86 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:18.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.416+0000 7f0543fff700 1 -- 172.21.15.16:0/1522952018 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548011830 con 0x7f054c0b83f0 2023-06-08T04:03:18.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.416+0000 7f0543fff700 1 -- 172.21.15.16:0/1522952018 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0548011990 con 0x7f054c0b83f0 2023-06-08T04:03:18.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.416+0000 7f0543fff700 1 -- 172.21.15.16:0/1522952018 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548011d20 con 0x7f054c0b83f0 2023-06-08T04:03:18.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.417+0000 7f05539ff700 1 -- 172.21.15.16:0/1522952018 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b83f0 msgr2=0x7f054c160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.417+0000 7f05539ff700 1 --2- 172.21.15.16:0/1522952018 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b83f0 0x7f054c160a60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f05480098f0 tx=0x7f0548009c00 comp rx=0 tx=0).stop 2023-06-08T04:03:18.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.417+0000 7f05539ff700 1 -- 172.21.15.16:0/1522952018 shutdown_connections 2023-06-08T04:03:18.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.417+0000 7f05539ff700 1 --2- 172.21.15.16:0/1522952018 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b83f0 0x7f054c160a60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.417+0000 7f05539ff700 1 --2- 172.21.15.16:0/1522952018 >> v2:172.21.15.169:3300/0 conn(0x7f054c0ced40 0x7f054c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.417+0000 7f05539ff700 1 -- 172.21.15.16:0/1522952018 >> 172.21.15.16:0/1522952018 conn(0x7f054c0cf610 msgr2=0x7f054c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:18.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.417+0000 7f05539ff700 1 -- 172.21.15.16:0/1522952018 shutdown_connections 2023-06-08T04:03:18.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.417+0000 7f05539ff700 1 -- 172.21.15.16:0/1522952018 wait complete. 2023-06-08T04:03:18.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.419+0000 7f05539ff700 1 Processor -- start 2023-06-08T04:03:18.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.419+0000 7f05539ff700 1 -- start start 2023-06-08T04:03:18.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.420+0000 7f05539ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b4b50 0x7f054c146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.420+0000 7f05539ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f054c0b83f0 0x7f054c154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.420+0000 7f05539ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054c0ced40 0x7f054c0b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.420+0000 7f05539ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c1474b0 con 0x7f054c0ced40 2023-06-08T04:03:18.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.420+0000 7f05539ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c155160 con 0x7f054c0b83f0 2023-06-08T04:03:18.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.420+0000 7f05539ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c1e5eb0 con 0x7f054c0b4b50 2023-06-08T04:03:18.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.420+0000 7f055179b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b4b50 0x7f054c146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.420+0000 7f0550f9a700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f054c0b83f0 0x7f054c154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.420+0000 7f0551f9c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054c0ced40 0x7f054c0b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.420+0000 7f055179b700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b4b50 0x7f054c146f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:51250/0 (socket says 172.21.15.16:51250) 2023-06-08T04:03:18.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.420+0000 7f055179b700 1 -- 172.21.15.16:0/1032313873 learned_addr learned my addr 172.21.15.16:0/1032313873 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:18.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.421+0000 7f0551f9c700 1 -- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b4b50 msgr2=0x7f054c146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.421+0000 7f0551f9c700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b4b50 0x7f054c146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.421+0000 7f0551f9c700 1 -- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f054c0b83f0 msgr2=0x7f054c154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.421+0000 7f0551f9c700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f054c0b83f0 0x7f054c154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.421+0000 7f0551f9c700 1 -- 172.21.15.16:0/1032313873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548009550 con 0x7f054c0ced40 2023-06-08T04:03:18.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.421+0000 7f0551f9c700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054c0ced40 0x7f054c0b64b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f054400cb90 tx=0x7f054400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:18.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.421+0000 7f0541ffb700 1 -- 172.21.15.16:0/1032313873 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0544003c00 con 0x7f054c0ced40 2023-06-08T04:03:18.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.421+0000 7f0541ffb700 1 -- 172.21.15.16:0/1032313873 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0544003d60 con 0x7f054c0ced40 2023-06-08T04:03:18.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.421+0000 7f0541ffb700 1 -- 172.21.15.16:0/1032313873 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400aa80 con 0x7f054c0ced40 2023-06-08T04:03:18.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.421+0000 7f05539ff700 1 -- 172.21.15.16:0/1032313873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054c1e6190 con 0x7f054c0ced40 2023-06-08T04:03:18.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.422+0000 7f05539ff700 1 -- 172.21.15.16:0/1032313873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054c1e6750 con 0x7f054c0ced40 2023-06-08T04:03:18.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.423+0000 7f05539ff700 1 -- 172.21.15.16:0/1032313873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054c1e6910 con 0x7f054c0ced40 2023-06-08T04:03:18.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.424+0000 7f0541ffb700 1 -- 172.21.15.16:0/1032313873 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f054400abe0 con 0x7f054c0ced40 2023-06-08T04:03:18.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.425+0000 7f0541ffb700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f053006ace0 0x7f053006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:18.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.425+0000 7f0541ffb700 1 -- 172.21.15.16:0/1032313873 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0544089480 con 0x7f054c0ced40 2023-06-08T04:03:18.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.425+0000 7f055179b700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f053006ace0 0x7f053006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:18.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.426+0000 7f055179b700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f053006ace0 0x7f053006d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0548009130 tx=0x7f0548008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:18.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.429+0000 7f0541ffb700 1 -- 172.21.15.16:0/1032313873 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f05440544b0 con 0x7f054c0ced40 2023-06-08T04:03:18.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.681+0000 7f05539ff700 1 -- 172.21.15.16:0/1032313873 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f054c0739d0 con 0x7f054c0ced40 2023-06-08T04:03:18.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.682+0000 7f0541ffb700 1 -- 172.21.15.16:0/1032313873 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0544057ad0 con 0x7f054c0ced40 2023-06-08T04:03:18.686 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-08T04:03:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 -- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f053006ace0 msgr2=0x7f053006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f053006ace0 0x7f053006d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0548009130 tx=0x7f0548008030 comp rx=0 tx=0).stop 2023-06-08T04:03:18.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 -- 172.21.15.16:0/1032313873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054c0ced40 msgr2=0x7f054c0b64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:18.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054c0ced40 0x7f054c0b64b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f054400cb90 tx=0x7f054400cea0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 -- 172.21.15.16:0/1032313873 shutdown_connections 2023-06-08T04:03:18.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f053006ace0 0x7f053006d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f054c0ced40 0x7f054c0b64b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f054c0b4b50 0x7f054c146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 --2- 172.21.15.16:0/1032313873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f054c0b83f0 0x7f054c154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:18.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 -- 172.21.15.16:0/1032313873 >> 172.21.15.16:0/1032313873 conn(0x7f054c0cf610 msgr2=0x7f054c15c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:18.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 -- 172.21.15.16:0/1032313873 shutdown_connections 2023-06-08T04:03:18.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:18.684+0000 7f05539ff700 1 -- 172.21.15.16:0/1032313873 wait complete. 2023-06-08T04:03:18.706 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-08T04:03:18.706 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-08T04:03:18.707 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2023-06-08T04:03:18.707 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-08T04:03:18.707 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-08T04:03:18.707 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-08T04:03:18.708 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-06-08T04:03:18.708 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-08T04:03:18.708 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-08T04:03:18.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:18.709 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2023-06-08T04:03:18.755 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-08T04:03:18.755 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-08T04:03:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-06-08T04:03:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:03:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-06-08T04:03:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:03:18.756 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:03:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:03:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2023-06-08T04:03:18.757 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:03:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:03:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2023-06-08T04:03:18.757 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-08T04:03:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:03:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2023-06-08T04:03:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-08T04:03:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 41909sec preferred_lft 41909sec 2023-06-08T04:03:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2023-06-08T04:03:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:03:18.758 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-08T04:03:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2023-06-08T04:03:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2023-06-08T04:03:18.758 INFO:teuthology.orchestra.run.smithi016.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-08T04:03:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 2a:04:3a:2a:60:6c brd ff:ff:ff:ff:ff:ff 2023-06-08T04:03:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-08T04:03:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:03:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::868:a5ff:febc:6f06/64 scope link 2023-06-08T04:03:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:03:18.759 INFO:teuthology.orchestra.run.smithi016.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-08T04:03:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 7a:5e:3d:99:68:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-08T04:03:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::785e:3dff:fe99:68e0/64 scope link 2023-06-08T04:03:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:03:18.760 INFO:teuthology.orchestra.run.smithi016.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-08T04:03:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 2a:04:3a:2a:60:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-08T04:03:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::2804:3aff:fe2a:606c/64 scope link 2023-06-08T04:03:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-06-08T04:03:18.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:18.761 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-08T04:03:18.828 INFO:teuthology.orchestra.run.smithi016.stdout:1 2023-06-08T04:03:18.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:18.831 DEBUG:teuthology.orchestra.run.smithi016:> route 2023-06-08T04:03:18.879 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2023-06-08T04:03:18.879 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-08T04:03:18.880 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-08T04:03:18.880 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-08T04:03:18.880 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-08T04:03:18.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:18.881 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-06-08T04:03:18.881 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-06-08T04:03:18.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-08T04:03:18.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-08T04:03:18.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-08T04:03:18.883 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-06-08T04:03:19.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:19.053 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-06-08T04:03:19.100 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-08T04:03:19.101 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-08T04:03:19.101 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-08T04:03:19.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:19.102 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2023-06-08T04:03:19.172 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T04:03:19.173 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-08T04:03:19.218 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-08T04:03:19.219 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-08T04:03:19.219 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-08T04:03:19.303 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-08T04:03:19.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:19.304 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-08T04:03:19.449 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-08T04:03:19.449 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-08T04:03:19.449 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-06-08T04:03:19.465 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-08T04:03:19.465 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-08T04:03:19.465 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-06-08T04:03:19.465 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.169:3300,172.21.15.169:3301" 2023-06-08T04:03:19.465 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T04:03:19.487 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-08T04:03:19.487 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-08T04:03:19.487 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-06-08T04:03:19.487 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.169:3300,172.21.15.169:3301" 2023-06-08T04:03:19.487 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-08T04:03:19.488 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.169:6789,172.21.15.169:6790" 2023-06-08T04:03:19.488 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.169:6789,172.21.15.169:6790:/ 2023-06-08T04:03:19.488 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e063be5d-be19-46d2-af9e-e986de4a0b1c" will pass to kernel 2023-06-08T04:03:19.492 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-08T04:03:19.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:19.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-08T04:03:19.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:19.563 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-08T04:03:19.671 INFO:teuthology.orchestra.run.smithi016.stdout:client5316 2023-06-08T04:03:19.672 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:03:19.672 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:03:19.718 DEBUG:teuthology.orchestra.run.smithi016:> mktemp -d --suffix=xfstests-dev 2023-06-08T04:03:19.802 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.KjWTKBMgZ7xfstests-dev 2023-06-08T04:03:19.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:19.803 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.KjWTKBMgZ7xfstests-dev) 2023-06-08T04:03:19.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:19.914 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.KjWTKBMgZ7xfstests-dev) 2023-06-08T04:03:19.964 INFO:teuthology.orchestra.run.smithi016.stderr:Cloning into '/tmp/tmp.KjWTKBMgZ7xfstests-dev'... 2023-06-08T04:03:20.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:20.873 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-08T04:03:20.926 DEBUG:teuthology.orchestra.run.smithi016:> mktemp -d --suffix=test 2023-06-08T04:03:20.970 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.LAsb5LIhsgtest 2023-06-08T04:03:20.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:03:20.971 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-08T04:03:21.058 DEBUG:teuthology.orchestra.run.smithi016:> mktemp -d --suffix=scratch 2023-06-08T04:03:21.103 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:03:21.103 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-06-08T04:03:21.103 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-06-08T04:03:22.215 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:10:53 ago on Thu 08 Jun 2023 03:52:29 AM UTC. 2023-06-08T04:03:23.469 INFO:teuthology.orchestra.run.smithi016.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-06-08T04:03:23.469 INFO:teuthology.orchestra.run.smithi016.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-06-08T04:03:23.471 INFO:teuthology.orchestra.run.smithi016.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-06-08T04:03:23.472 INFO:teuthology.orchestra.run.smithi016.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-06-08T04:03:23.473 INFO:teuthology.orchestra.run.smithi016.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-06-08T04:03:23.475 INFO:teuthology.orchestra.run.smithi016.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-06-08T04:03:23.477 INFO:teuthology.orchestra.run.smithi016.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-06-08T04:03:23.478 INFO:teuthology.orchestra.run.smithi016.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-06-08T04:03:23.480 INFO:teuthology.orchestra.run.smithi016.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-06-08T04:03:23.481 INFO:teuthology.orchestra.run.smithi016.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-06-08T04:03:23.482 INFO:teuthology.orchestra.run.smithi016.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-06-08T04:03:23.483 INFO:teuthology.orchestra.run.smithi016.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-06-08T04:03:23.484 INFO:teuthology.orchestra.run.smithi016.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-06-08T04:03:23.485 INFO:teuthology.orchestra.run.smithi016.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-06-08T04:03:23.486 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-08T04:03:23.487 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsprogs-5.0.0-11.el8.x86_64 is already installed. 2023-06-08T04:03:23.488 INFO:teuthology.orchestra.run.smithi016.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-08T04:03:23.489 INFO:teuthology.orchestra.run.smithi016.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-08T04:03:23.490 INFO:teuthology.orchestra.run.smithi016.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-06-08T04:03:23.492 INFO:teuthology.orchestra.run.smithi016.stdout:Package libuuid-devel-2.32.1-42.el8.x86_64 is already installed. 2023-06-08T04:03:23.493 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsprogs-devel-5.0.0-11.el8.x86_64 is already installed. 2023-06-08T04:03:23.495 INFO:teuthology.orchestra.run.smithi016.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-06-08T04:03:23.499 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsprogs-5.0.0-11.el8.x86_64 is already installed. 2023-06-08T04:03:23.676 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2023-06-08T04:03:23.678 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2023-06-08T04:03:23.678 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repo Size 2023-06-08T04:03:23.679 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2023-06-08T04:03:23.679 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2023-06-08T04:03:23.679 INFO:teuthology.orchestra.run.smithi016.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-06-08T04:03:23.679 INFO:teuthology.orchestra.run.smithi016.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-06-08T04:03:23.679 INFO:teuthology.orchestra.run.smithi016.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-06-08T04:03:23.679 INFO:teuthology.orchestra.run.smithi016.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-06-08T04:03:23.680 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrading: 2023-06-08T04:03:23.680 INFO:teuthology.orchestra.run.smithi016.stdout: sqlite x86_64 3.26.0-18.el8 baseos 668 k 2023-06-08T04:03:23.680 INFO:teuthology.orchestra.run.smithi016.stdout: sqlite-libs x86_64 3.26.0-18.el8 baseos 581 k 2023-06-08T04:03:23.680 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2023-06-08T04:03:23.680 INFO:teuthology.orchestra.run.smithi016.stdout: daxctl-libs x86_64 71.1-4.el8 baseos 42 k 2023-06-08T04:03:23.680 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-06-08T04:03:23.680 INFO:teuthology.orchestra.run.smithi016.stdout: ndctl-libs x86_64 71.1-4.el8 baseos 80 k 2023-06-08T04:03:23.681 INFO:teuthology.orchestra.run.smithi016.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-06-08T04:03:23.681 INFO:teuthology.orchestra.run.smithi016.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-06-08T04:03:23.681 INFO:teuthology.orchestra.run.smithi016.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-06-08T04:03:23.681 INFO:teuthology.orchestra.run.smithi016.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-06-08T04:03:23.681 INFO:teuthology.orchestra.run.smithi016.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-06-08T04:03:23.681 INFO:teuthology.orchestra.run.smithi016.stdout:Installing weak dependencies: 2023-06-08T04:03:23.681 INFO:teuthology.orchestra.run.smithi016.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-06-08T04:03:23.682 INFO:teuthology.orchestra.run.smithi016.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-06-08T04:03:23.682 INFO:teuthology.orchestra.run.smithi016.stdout:Enabling module streams: 2023-06-08T04:03:23.682 INFO:teuthology.orchestra.run.smithi016.stdout: python27 2.7 2023-06-08T04:03:23.682 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:23.682 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2023-06-08T04:03:23.682 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2023-06-08T04:03:23.682 INFO:teuthology.orchestra.run.smithi016.stdout:Install 14 Packages 2023-06-08T04:03:23.683 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 2 Packages 2023-06-08T04:03:23.683 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:23.683 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 13 M 2023-06-08T04:03:23.683 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2023-06-08T04:03:24.667 INFO:teuthology.orchestra.run.smithi016.stdout:(1/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 213 kB/s | 92 kB 00:00 2023-06-08T04:03:24.799 INFO:teuthology.orchestra.run.smithi016.stdout:(2/16): python2-2.7.18-12.module_el8+299+aa6e9a 196 kB/s | 110 kB 00:00 2023-06-08T04:03:25.016 INFO:teuthology.orchestra.run.smithi016.stdout:(3/16): fio-3.19-4.el8.x86_64.rpm 690 kB/s | 538 kB 00:00 2023-06-08T04:03:25.233 INFO:teuthology.orchestra.run.smithi016.stdout:(4/16): python2-pip-wheel-9.0.3-19.module_el8+2 4.0 MB/s | 892 kB 00:00 2023-06-08T04:03:25.275 INFO:teuthology.orchestra.run.smithi016.stdout:(5/16): python2-pip-9.0.3-19.module_el8+299+aa6 3.8 MB/s | 1.8 MB 00:00 2023-06-08T04:03:25.358 INFO:teuthology.orchestra.run.smithi016.stdout:(6/16): python2-setuptools-39.0.1-13.module_el8 5.5 MB/s | 702 kB 00:00 2023-06-08T04:03:25.392 INFO:teuthology.orchestra.run.smithi016.stdout:(7/16): python2-setuptools-wheel-39.0.1-13.modu 2.4 MB/s | 287 kB 00:00 2023-06-08T04:03:25.475 INFO:teuthology.orchestra.run.smithi016.stdout:(8/16): python2-wheel-wheel-0.31.1-3.module_el8 382 kB/s | 44 kB 00:00 2023-06-08T04:03:25.609 INFO:teuthology.orchestra.run.smithi016.stdout:(9/16): python2-libs-2.7.18-12.module_el8+299+a 6.9 MB/s | 6.5 MB 00:00 2023-06-08T04:03:25.760 INFO:teuthology.orchestra.run.smithi016.stdout:(10/16): daxctl-libs-71.1-4.el8.x86_64.rpm 114 kB/s | 42 kB 00:00 2023-06-08T04:03:25.927 INFO:teuthology.orchestra.run.smithi016.stdout:(11/16): rmt-1.5.3-13.el8.x86_64.rpm 309 kB/s | 51 kB 00:00 2023-06-08T04:03:26.035 INFO:teuthology.orchestra.run.smithi016.stdout:(12/16): ndctl-libs-71.1-4.el8.x86_64.rpm 188 kB/s | 80 kB 00:00 2023-06-08T04:03:26.069 INFO:teuthology.orchestra.run.smithi016.stdout:(13/16): dump-0.4-0.36.b46.el8.x86_64.rpm 277 kB/s | 164 kB 00:00 2023-06-08T04:03:26.328 INFO:teuthology.orchestra.run.smithi016.stdout:(14/16): indent-2.2.13-2.el8.x86_64.rpm 466 kB/s | 187 kB 00:00 2023-06-08T04:03:26.444 INFO:teuthology.orchestra.run.smithi016.stdout:(15/16): sqlite-libs-3.26.0-18.el8.x86_64.rpm 1.5 MB/s | 581 kB 00:00 2023-06-08T04:03:26.478 INFO:teuthology.orchestra.run.smithi016.stdout:(16/16): sqlite-3.26.0-18.el8.x86_64.rpm 1.5 MB/s | 668 kB 00:00 2023-06-08T04:03:26.479 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2023-06-08T04:03:26.480 INFO:teuthology.orchestra.run.smithi016.stdout:Total 4.5 MB/s | 13 MB 00:02 2023-06-08T04:03:26.866 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2023-06-08T04:03:26.910 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2023-06-08T04:03:26.911 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2023-06-08T04:03:27.149 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2023-06-08T04:03:27.154 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2023-06-08T04:03:27.912 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2023-06-08T04:03:28.091 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : sqlite-libs-3.26.0-18.el8.x86_64 1/18 2023-06-08T04:03:28.241 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : daxctl-libs-71.1-4.el8.x86_64 2/18 2023-06-08T04:03:28.335 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: daxctl-libs-71.1-4.el8.x86_64 2/18 2023-06-08T04:03:28.392 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:03:28.396 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:03:28.533 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ndctl-libs-71.1-4.el8.x86_64 3/18 2023-06-08T04:03:28.720 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ndctl-libs-71.1-4.el8.x86_64 3/18 2023-06-08T04:03:28.833 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-08T04:03:28.927 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-08T04:03:29.064 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/18 2023-06-08T04:03:29.200 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 6/18 2023-06-08T04:03:30.756 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 7/18 2023-06-08T04:03:31.522 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 8/18 2023-06-08T04:03:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 9/18 2023-06-08T04:03:32.099 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 10/18 2023-06-08T04:03:32.249 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 11/18 2023-06-08T04:03:32.296 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 11/18 2023-06-08T04:03:32.571 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-06-08T04:03:32.778 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : fio-3.19-4.el8.x86_64 13/18 2023-06-08T04:03:32.953 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : sqlite-3.26.0-18.el8.x86_64 14/18 2023-06-08T04:03:33.204 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : indent-2.2.13-2.el8.x86_64 15/18 2023-06-08T04:03:33.317 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 16/18 2023-06-08T04:03:33.433 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : sqlite-3.26.0-17.el8.x86_64 17/18 2023-06-08T04:03:33.591 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : sqlite-libs-3.26.0-17.el8.x86_64 18/18 2023-06-08T04:03:34.117 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: sqlite-libs-3.26.0-17.el8.x86_64 18/18 2023-06-08T04:03:34.118 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : fio-3.19-4.el8.x86_64 1/18 2023-06-08T04:03:34.118 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/18 2023-06-08T04:03:34.118 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/18 2023-06-08T04:03:34.118 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/18 2023-06-08T04:03:34.118 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/18 2023-06-08T04:03:34.118 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/18 2023-06-08T04:03:34.118 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/18 2023-06-08T04:03:34.119 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/18 2023-06-08T04:03:34.119 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/18 2023-06-08T04:03:34.119 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : daxctl-libs-71.1-4.el8.x86_64 10/18 2023-06-08T04:03:34.119 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/18 2023-06-08T04:03:34.119 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ndctl-libs-71.1-4.el8.x86_64 12/18 2023-06-08T04:03:34.119 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 13/18 2023-06-08T04:03:34.119 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : indent-2.2.13-2.el8.x86_64 14/18 2023-06-08T04:03:34.120 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : sqlite-3.26.0-18.el8.x86_64 15/18 2023-06-08T04:03:34.120 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 16/18 2023-06-08T04:03:34.120 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : sqlite-libs-3.26.0-18.el8.x86_64 17/18 2023-06-08T04:03:34.922 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 18/18 2023-06-08T04:03:34.923 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:34.923 INFO:teuthology.orchestra.run.smithi016.stdout:Upgraded: 2023-06-08T04:03:34.923 INFO:teuthology.orchestra.run.smithi016.stdout: sqlite-3.26.0-18.el8.x86_64 sqlite-libs-3.26.0-18.el8.x86_64 2023-06-08T04:03:34.923 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2023-06-08T04:03:34.923 INFO:teuthology.orchestra.run.smithi016.stdout: daxctl-libs-71.1-4.el8.x86_64 2023-06-08T04:03:34.923 INFO:teuthology.orchestra.run.smithi016.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-06-08T04:03:34.923 INFO:teuthology.orchestra.run.smithi016.stdout: fio-3.19-4.el8.x86_64 2023-06-08T04:03:34.924 INFO:teuthology.orchestra.run.smithi016.stdout: indent-2.2.13-2.el8.x86_64 2023-06-08T04:03:34.924 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-06-08T04:03:34.924 INFO:teuthology.orchestra.run.smithi016.stdout: ndctl-libs-71.1-4.el8.x86_64 2023-06-08T04:03:34.924 INFO:teuthology.orchestra.run.smithi016.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-06-08T04:03:34.924 INFO:teuthology.orchestra.run.smithi016.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-06-08T04:03:34.924 INFO:teuthology.orchestra.run.smithi016.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-06-08T04:03:34.924 INFO:teuthology.orchestra.run.smithi016.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-06-08T04:03:34.925 INFO:teuthology.orchestra.run.smithi016.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-06-08T04:03:34.925 INFO:teuthology.orchestra.run.smithi016.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-06-08T04:03:34.925 INFO:teuthology.orchestra.run.smithi016.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-06-08T04:03:34.925 INFO:teuthology.orchestra.run.smithi016.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-06-08T04:03:34.925 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:34.925 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2023-06-08T04:03:35.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo useradd -m fsgqa 2023-06-08T04:03:35.430 INFO:teuthology.orchestra.run.smithi016.stderr:useradd: user 'fsgqa' already exists 2023-06-08T04:03:35.433 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-08T04:03:35.434 DEBUG:teuthology.orchestra.run.smithi016:> sudo groupadd fsgqa 2023-06-08T04:03:35.501 INFO:teuthology.orchestra.run.smithi016.stderr:groupadd: group 'fsgqa' already exists 2023-06-08T04:03:35.503 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-08T04:03:35.504 DEBUG:teuthology.orchestra.run.smithi016:> sudo useradd fsgqa2 2023-06-08T04:03:36.314 DEBUG:teuthology.orchestra.run.smithi016:> sudo useradd 123456-fsgqa 2023-06-08T04:03:36.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-08T04:03:37.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.131+0000 7ff3441ff700 1 Processor -- start 2023-06-08T04:03:37.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.131+0000 7ff3441ff700 1 -- start start 2023-06-08T04:03:37.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.132+0000 7ff3441ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c159200 0x7ff33c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.132+0000 7ff3441ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff33c15d660 0x7ff33c070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.132+0000 7ff3441ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff33c0707c0 0x7ff33c06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.132+0000 7ff3441ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c1595d0 con 0x7ff33c0707c0 2023-06-08T04:03:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.132+0000 7ff3441ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c070c10 con 0x7ff33c15d660 2023-06-08T04:03:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.132+0000 7ff3441ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0c9b60 con 0x7ff33c159200 2023-06-08T04:03:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff34279c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff33c0707c0 0x7ff33c06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff34279c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff33c0707c0 0x7ff33c06c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46280/0 (socket says 172.21.15.16:46280) 2023-06-08T04:03:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff34279c700 1 -- 172.21.15.16:0/128656955 learned_addr learned my addr 172.21.15.16:0/128656955 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff34179a700 1 --2- 172.21.15.16:0/128656955 >> v2:172.21.15.169:3300/0 conn(0x7ff33c15d660 0x7ff33c070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff341f9b700 1 --2- 172.21.15.16:0/128656955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c159200 0x7ff33c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff34279c700 1 -- 172.21.15.16:0/128656955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c159200 msgr2=0x7ff33c0adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff34279c700 1 --2- 172.21.15.16:0/128656955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c159200 0x7ff33c0adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff34279c700 1 -- 172.21.15.16:0/128656955 >> v2:172.21.15.169:3300/0 conn(0x7ff33c15d660 msgr2=0x7ff33c070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff34279c700 1 --2- 172.21.15.16:0/128656955 >> v2:172.21.15.169:3300/0 conn(0x7ff33c15d660 0x7ff33c070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff34279c700 1 -- 172.21.15.16:0/128656955 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c06d660 con 0x7ff33c0707c0 2023-06-08T04:03:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff341f9b700 1 --2- 172.21.15.16:0/128656955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c159200 0x7ff33c0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff34179a700 1 --2- 172.21.15.16:0/128656955 >> v2:172.21.15.169:3300/0 conn(0x7ff33c15d660 0x7ff33c070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.133+0000 7ff34279c700 1 --2- 172.21.15.16:0/128656955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff33c0707c0 0x7ff33c06c000 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06e790 tx=0x7ff33400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e0cd973031b781 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:37.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.134+0000 7ff340f99700 1 -- 172.21.15.16:0/128656955 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400e070 con 0x7ff33c0707c0 2023-06-08T04:03:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.134+0000 7ff340f99700 1 -- 172.21.15.16:0/128656955 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33400b9c0 con 0x7ff33c0707c0 2023-06-08T04:03:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.134+0000 7ff340f99700 1 -- 172.21.15.16:0/128656955 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400bd70 con 0x7ff33c0707c0 2023-06-08T04:03:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.134+0000 7ff3441ff700 1 -- 172.21.15.16:0/128656955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff33c0707c0 msgr2=0x7ff33c06c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.134+0000 7ff3441ff700 1 --2- 172.21.15.16:0/128656955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff33c0707c0 0x7ff33c06c000 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06e790 tx=0x7ff33400b330 comp rx=0 tx=0).stop 2023-06-08T04:03:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.134+0000 7ff3441ff700 1 -- 172.21.15.16:0/128656955 shutdown_connections 2023-06-08T04:03:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.134+0000 7ff3441ff700 1 --2- 172.21.15.16:0/128656955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff33c0707c0 0x7ff33c06c000 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.134+0000 7ff3441ff700 1 --2- 172.21.15.16:0/128656955 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c159200 0x7ff33c0adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.134+0000 7ff3441ff700 1 --2- 172.21.15.16:0/128656955 >> v2:172.21.15.169:3300/0 conn(0x7ff33c15d660 0x7ff33c070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.134+0000 7ff3441ff700 1 -- 172.21.15.16:0/128656955 >> 172.21.15.16:0/128656955 conn(0x7ff33c06aa40 msgr2=0x7ff33c0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.135+0000 7ff3441ff700 1 -- 172.21.15.16:0/128656955 shutdown_connections 2023-06-08T04:03:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.135+0000 7ff3441ff700 1 -- 172.21.15.16:0/128656955 wait complete. 2023-06-08T04:03:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.136+0000 7ff3441ff700 1 Processor -- start 2023-06-08T04:03:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.137+0000 7ff3441ff700 1 -- start start 2023-06-08T04:03:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.137+0000 7ff3441ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff33c0707c0 0x7ff33c144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff3441ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33c159200 0x7ff33c0c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff3441ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c15d660 0x7ff33c0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff3441ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0c5970 con 0x7ff33c0707c0 2023-06-08T04:03:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff3441ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0c5c50 con 0x7ff33c159200 2023-06-08T04:03:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff3441ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0c5f30 con 0x7ff33c15d660 2023-06-08T04:03:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff341f9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff33c0707c0 0x7ff33c144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff341f9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff33c0707c0 0x7ff33c144490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46296/0 (socket says 172.21.15.16:46296) 2023-06-08T04:03:37.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff341f9b700 1 -- 172.21.15.16:0/910954509 learned_addr learned my addr 172.21.15.16:0/910954509 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:37.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff341f9b700 1 -- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c15d660 msgr2=0x7ff33c0b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:37.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff341f9b700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c15d660 0x7ff33c0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff341f9b700 1 -- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33c159200 msgr2=0x7ff33c0c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:37.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff341f9b700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33c159200 0x7ff33c0c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff341f9b700 1 -- 172.21.15.16:0/910954509 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff334009b30 con 0x7ff33c0707c0 2023-06-08T04:03:37.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.138+0000 7ff341f9b700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff33c0707c0 0x7ff33c144490 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff33800d800 tx=0x7ff33800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:37.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.139+0000 7ff3327fc700 1 -- 172.21.15.16:0/910954509 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338004030 con 0x7ff33c0707c0 2023-06-08T04:03:37.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.139+0000 7ff3327fc700 1 -- 172.21.15.16:0/910954509 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff338004190 con 0x7ff33c0707c0 2023-06-08T04:03:37.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.139+0000 7ff3327fc700 1 -- 172.21.15.16:0/910954509 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338004520 con 0x7ff33c0707c0 2023-06-08T04:03:37.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.139+0000 7ff3441ff700 1 -- 172.21.15.16:0/910954509 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c0c6210 con 0x7ff33c0707c0 2023-06-08T04:03:37.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.139+0000 7ff3441ff700 1 -- 172.21.15.16:0/910954509 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c154880 con 0x7ff33c0707c0 2023-06-08T04:03:37.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.140+0000 7ff3441ff700 1 -- 172.21.15.16:0/910954509 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c0740e0 con 0x7ff33c0707c0 2023-06-08T04:03:37.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.141+0000 7ff3327fc700 1 -- 172.21.15.16:0/910954509 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3380036a0 con 0x7ff33c0707c0 2023-06-08T04:03:37.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.142+0000 7ff3327fc700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff32006ace0 0x7ff32006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.142+0000 7ff3327fc700 1 -- 172.21.15.16:0/910954509 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff338089ac0 con 0x7ff33c0707c0 2023-06-08T04:03:37.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.142+0000 7ff34179a700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff32006ace0 0x7ff32006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:37.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.143+0000 7ff34179a700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff32006ace0 0x7ff32006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff32c006fd0 tx=0x7ff32c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:37.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.146+0000 7ff3327fc700 1 -- 172.21.15.16:0/910954509 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff3380585f0 con 0x7ff33c0707c0 2023-06-08T04:03:37.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.439+0000 7ff3441ff700 1 -- 172.21.15.16:0/910954509 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff33c0c6730 con 0x7ff33c0707c0 2023-06-08T04:03:37.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.439+0000 7ff3327fc700 1 -- 172.21.15.16:0/910954509 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7ff33c0c6730 con 0x7ff33c0707c0 2023-06-08T04:03:37.443 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:03:37.444 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":1,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","modified":"2023-06-08T04:01:00.066076Z","created":"2023-06-08T04:01:00.066076Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3301","nonce":0},{"type":"v1","addr":"172.21.15.169:6790","nonce":0}]},"addr":"172.21.15.169:6790/0","public_addr":"172.21.15.169:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-08T04:03:37.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.441+0000 7ff3441ff700 1 -- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff32006ace0 msgr2=0x7ff32006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:37.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.441+0000 7ff3441ff700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff32006ace0 0x7ff32006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff32c006fd0 tx=0x7ff32c008040 comp rx=0 tx=0).stop 2023-06-08T04:03:37.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.441+0000 7ff3441ff700 1 -- 172.21.15.16:0/910954509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff33c0707c0 msgr2=0x7ff33c144490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:37.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.441+0000 7ff3441ff700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff33c0707c0 0x7ff33c144490 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff33800d800 tx=0x7ff33800dbc0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.441+0000 7ff3441ff700 1 -- 172.21.15.16:0/910954509 shutdown_connections 2023-06-08T04:03:37.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.441+0000 7ff3441ff700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7ff32006ace0 0x7ff32006d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.441+0000 7ff3441ff700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff33c15d660 0x7ff33c0b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.441+0000 7ff3441ff700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff33c0707c0 0x7ff33c144490 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.441+0000 7ff3441ff700 1 --2- 172.21.15.16:0/910954509 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff33c159200 0x7ff33c0c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.441+0000 7ff3441ff700 1 -- 172.21.15.16:0/910954509 >> 172.21.15.16:0/910954509 conn(0x7ff33c06aa40 msgr2=0x7ff33c0ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:37.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.441+0000 7ff3441ff700 1 -- 172.21.15.16:0/910954509 shutdown_connections 2023-06-08T04:03:37.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.442+0000 7ff3441ff700 1 -- 172.21.15.16:0/910954509 wait complete. 2023-06-08T04:03:37.447 INFO:teuthology.orchestra.run.smithi016.stderr:dumped monmap epoch 1 2023-06-08T04:03:37.463 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-06-08T04:03:37.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.660+0000 7f768f3ff700 1 Processor -- start 2023-06-08T04:03:37.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.660+0000 7f768f3ff700 1 -- start start 2023-06-08T04:03:37.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.661+0000 7f768f3ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f76880b0940 0x7f7688069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768f3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76880af9e0 0x7f768806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768f3ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76880af3f0 con 0x7f768815fb60 2023-06-08T04:03:37.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768f3ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76880b0e40 con 0x7f76880b0940 2023-06-08T04:03:37.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768f3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76880af1e0 con 0x7f76880af9e0 2023-06-08T04:03:37.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768c99a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f76880b0940 0x7f7688069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:37.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768c99a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f76880b0940 0x7f7688069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46298/0 (socket says 172.21.15.16:46298) 2023-06-08T04:03:37.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768c99a700 1 -- 172.21.15.16:0/405179424 learned_addr learned my addr 172.21.15.16:0/405179424 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:37.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768d99c700 1 --2- 172.21.15.16:0/405179424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76880af9e0 0x7f768806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:37.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768c99a700 1 -- 172.21.15.16:0/405179424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76880af9e0 msgr2=0x7f768806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:37.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768c99a700 1 --2- 172.21.15.16:0/405179424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76880af9e0 0x7f768806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768c99a700 1 -- 172.21.15.16:0/405179424 >> v1:172.21.15.169:6789/0 conn(0x7f768815fb60 legacy=0x7f76880c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:03:37.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768c99a700 1 -- 172.21.15.16:0/405179424 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76880af6d0 con 0x7f76880b0940 2023-06-08T04:03:37.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.662+0000 7f768d99c700 1 --2- 172.21.15.16:0/405179424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76880af9e0 0x7f768806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-08T04:03:37.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.663+0000 7f768c99a700 1 --2- 172.21.15.16:0/405179424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76880b0940 0x7f7688069db0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f76780098f0 tx=0x7f7678009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6387fa555a6989e8 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:37.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.663+0000 7f767ffff700 1 -- 172.21.15.16:0/405179424 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678004230 con 0x7f76880b0940 2023-06-08T04:03:37.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.663+0000 7f767ffff700 1 -- 172.21.15.16:0/405179424 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7678004390 con 0x7f76880b0940 2023-06-08T04:03:37.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.663+0000 7f767ffff700 1 -- 172.21.15.16:0/405179424 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76780036a0 con 0x7f76880b0940 2023-06-08T04:03:37.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.663+0000 7f768f3ff700 1 -- 172.21.15.16:0/405179424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76880b0940 msgr2=0x7f7688069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:37.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.663+0000 7f768f3ff700 1 --2- 172.21.15.16:0/405179424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76880b0940 0x7f7688069db0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f76780098f0 tx=0x7f7678009c00 comp rx=0 tx=0).stop 2023-06-08T04:03:37.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.664+0000 7f768f3ff700 1 -- 172.21.15.16:0/405179424 shutdown_connections 2023-06-08T04:03:37.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.664+0000 7f768f3ff700 1 --2- 172.21.15.16:0/405179424 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76880af9e0 0x7f768806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.664+0000 7f768f3ff700 1 --2- 172.21.15.16:0/405179424 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76880b0940 0x7f7688069db0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.664+0000 7f768f3ff700 1 -- 172.21.15.16:0/405179424 >> 172.21.15.16:0/405179424 conn(0x7f7688098a50 msgr2=0x7f76880cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:37.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.664+0000 7f768f3ff700 1 -- 172.21.15.16:0/405179424 shutdown_connections 2023-06-08T04:03:37.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.664+0000 7f768f3ff700 1 -- 172.21.15.16:0/405179424 wait complete. 2023-06-08T04:03:37.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.666+0000 7f768f3ff700 1 Processor -- start 2023-06-08T04:03:37.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.666+0000 7f768f3ff700 1 -- start start 2023-06-08T04:03:37.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.667+0000 7f768f3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76880af9e0 0x7f76880b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.667+0000 7f768f3ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76880b0940 0x7f76880b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768f3ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f768815fb60 0x7f768814f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768f3ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880b38a0 con 0x7f768815fb60 2023-06-08T04:03:37.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768f3ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880b4200 con 0x7f76880b0940 2023-06-08T04:03:37.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768f3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76881590c0 con 0x7f76880af9e0 2023-06-08T04:03:37.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768d99c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f768815fb60 0x7f768814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:37.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768d99c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f768815fb60 0x7f768814f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46306/0 (socket says 172.21.15.16:46306) 2023-06-08T04:03:37.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768d99c700 1 -- 172.21.15.16:0/1820994709 learned_addr learned my addr 172.21.15.16:0/1820994709 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:03:37.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768c99a700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76880b0940 0x7f76880b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:37.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768d19b700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76880af9e0 0x7f76880b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:37.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768d99c700 1 -- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76880af9e0 msgr2=0x7f76880b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:37.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768d99c700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76880af9e0 0x7f76880b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768d99c700 1 -- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76880b0940 msgr2=0x7f76880b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:37.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768d99c700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76880b0940 0x7f76880b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768d99c700 1 -- 172.21.15.16:0/1820994709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678009550 con 0x7f768815fb60 2023-06-08T04:03:37.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768c99a700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76880b0940 0x7f76880b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:03:37.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.668+0000 7f768d99c700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f768815fb60 0x7f768814f810 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f768000cd80 tx=0x7f768000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:37.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.669+0000 7f767dffb700 1 -- 172.21.15.16:0/1820994709 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000f480 con 0x7f768815fb60 2023-06-08T04:03:37.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.669+0000 7f767dffb700 1 -- 172.21.15.16:0/1820994709 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768000f600 con 0x7f768815fb60 2023-06-08T04:03:37.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.669+0000 7f767dffb700 1 -- 172.21.15.16:0/1820994709 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000f9b0 con 0x7f768815fb60 2023-06-08T04:03:37.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.669+0000 7f768f3ff700 1 -- 172.21.15.16:0/1820994709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76880b2c20 con 0x7f768815fb60 2023-06-08T04:03:37.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.669+0000 7f768f3ff700 1 -- 172.21.15.16:0/1820994709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76880b31e0 con 0x7f768815fb60 2023-06-08T04:03:37.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.670+0000 7f768f3ff700 1 -- 172.21.15.16:0/1820994709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76880b1060 con 0x7f768815fb60 2023-06-08T04:03:37.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.671+0000 7f767dffb700 1 -- 172.21.15.16:0/1820994709 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f768000b040 con 0x7f768815fb60 2023-06-08T04:03:37.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.672+0000 7f767dffb700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f766c06ace0 0x7f766c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:03:37.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.672+0000 7f767dffb700 1 -- 172.21.15.16:0/1820994709 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7680089d80 con 0x7f768815fb60 2023-06-08T04:03:37.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.672+0000 7f768d19b700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f766c06ace0 0x7f766c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:03:37.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.673+0000 7f768d19b700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f766c06ace0 0x7f766c06d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7684004f30 tx=0x7f7684009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:03:37.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.676+0000 7f767dffb700 1 -- 172.21.15.16:0/1820994709 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7680054d90 con 0x7f768815fb60 2023-06-08T04:03:37.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.966+0000 7f768f3ff700 1 -- 172.21.15.16:0/1820994709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f76880b39e0 con 0x7f768815fb60 2023-06-08T04:03:37.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.966+0000 7f767dffb700 1 -- 172.21.15.16:0/1820994709 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v9) v1 ==== 92+0+63 (secure 0 0 0) 0x7f76880b39e0 con 0x7f768815fb60 2023-06-08T04:03:37.970 INFO:teuthology.orchestra.run.smithi016.stdout:[client.admin] 2023-06-08T04:03:37.970 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== 2023-06-08T04:03:37.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 -- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f766c06ace0 msgr2=0x7f766c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:37.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f766c06ace0 0x7f766c06d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7684004f30 tx=0x7f7684009040 comp rx=0 tx=0).stop 2023-06-08T04:03:37.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 -- 172.21.15.16:0/1820994709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f768815fb60 msgr2=0x7f768814f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:03:37.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f768815fb60 0x7f768814f810 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f768000cd80 tx=0x7f768000a560 comp rx=0 tx=0).stop 2023-06-08T04:03:37.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 -- 172.21.15.16:0/1820994709 shutdown_connections 2023-06-08T04:03:37.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f766c06ace0 0x7f766c06d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f768815fb60 0x7f768814f810 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f76880af9e0 0x7f76880b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 --2- 172.21.15.16:0/1820994709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f76880b0940 0x7f76880b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:03:37.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 -- 172.21.15.16:0/1820994709 >> 172.21.15.16:0/1820994709 conn(0x7f7688098a50 msgr2=0x7f76880cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:03:37.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 -- 172.21.15.16:0/1820994709 shutdown_connections 2023-06-08T04:03:37.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:03:37.969+0000 7f768f3ff700 1 -- 172.21.15.16:0/1820994709 wait complete. 2023-06-08T04:03:37.991 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:03:37.991 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/tmp/tmp.KjWTKBMgZ7xfstests-dev/local.config 2023-06-08T04:03:38.060 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.16:6789:/test export TEST_DIR=/tmp/tmp.LAsb5LIhsgtest export SCRATCH_DEV=172.21.15.16:6789:/scratch export SCRATCH_MNT=/tmp/tmp.K0myYlkvcNscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ==" 2023-06-08T04:03:38.061 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:03:38.061 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/tmp/tmp.KjWTKBMgZ7xfstests-dev/ceph.exclude 2023-06-08T04:03:38.169 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo make) 2023-06-08T04:03:38.305 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize -cfi 2023-06-08T04:03:38.794 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-08T04:03:38.795 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file './config.guess' 2023-06-08T04:03:38.804 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file './config.sub' 2023-06-08T04:03:38.815 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file './install-sh' 2023-06-08T04:03:38.826 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file './ltmain.sh' 2023-06-08T04:03:38.887 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-08T04:03:38.887 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-08T04:03:38.900 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-08T04:03:38.913 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-08T04:03:38.925 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-08T04:03:38.938 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-08T04:03:38.954 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-08T04:03:38.957 INFO:teuthology.orchestra.run.smithi016.stdout:cp include/install-sh . 2023-06-08T04:03:38.960 INFO:teuthology.orchestra.run.smithi016.stdout:aclocal -I m4 2023-06-08T04:03:40.247 INFO:teuthology.orchestra.run.smithi016.stdout:autoheader 2023-06-08T04:03:40.619 INFO:teuthology.orchestra.run.smithi016.stdout:autoconf 2023-06-08T04:03:40.835 INFO:teuthology.orchestra.run.smithi016.stdout:./configure \ 2023-06-08T04:03:40.835 INFO:teuthology.orchestra.run.smithi016.stdout: --libexecdir=/usr/lib \ 2023-06-08T04:03:40.835 INFO:teuthology.orchestra.run.smithi016.stdout: --exec_prefix=/var/lib 2023-06-08T04:03:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-08T04:03:41.435 INFO:teuthology.orchestra.run.smithi016.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-08T04:03:41.438 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to print strings... printf 2023-06-08T04:03:41.439 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gcc... gcc 2023-06-08T04:03:41.609 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether the C compiler works... yes 2023-06-08T04:03:41.610 INFO:teuthology.orchestra.run.smithi016.stdout:checking for C compiler default output file name... a.out 2023-06-08T04:03:41.661 INFO:teuthology.orchestra.run.smithi016.stdout:checking for suffix of executables... 2023-06-08T04:03:41.741 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether we are cross compiling... no 2023-06-08T04:03:41.779 INFO:teuthology.orchestra.run.smithi016.stdout:checking for suffix of object files... o 2023-06-08T04:03:41.813 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether we are using the GNU C compiler... yes 2023-06-08T04:03:41.848 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether gcc accepts -g... yes 2023-06-08T04:03:41.896 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-08T04:03:41.903 INFO:teuthology.orchestra.run.smithi016.stdout:checking for a sed that does not truncate output... /bin/sed 2023-06-08T04:03:41.908 INFO:teuthology.orchestra.run.smithi016.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-06-08T04:03:41.911 INFO:teuthology.orchestra.run.smithi016.stdout:checking for egrep... /bin/grep -E 2023-06-08T04:03:41.914 INFO:teuthology.orchestra.run.smithi016.stdout:checking for fgrep... /bin/grep -F 2023-06-08T04:03:41.922 INFO:teuthology.orchestra.run.smithi016.stdout:checking for ld used by gcc... /bin/ld 2023-06-08T04:03:41.926 INFO:teuthology.orchestra.run.smithi016.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-06-08T04:03:41.937 INFO:teuthology.orchestra.run.smithi016.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-06-08T04:03:41.981 INFO:teuthology.orchestra.run.smithi016.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-06-08T04:03:41.981 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether ln -s works... yes 2023-06-08T04:03:42.001 INFO:teuthology.orchestra.run.smithi016.stdout:checking the maximum length of command line arguments... 1572864 2023-06-08T04:03:42.007 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-08T04:03:42.008 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-08T04:03:42.008 INFO:teuthology.orchestra.run.smithi016.stdout:checking for /bin/ld option to reload object files... -r 2023-06-08T04:03:42.008 INFO:teuthology.orchestra.run.smithi016.stdout:checking for objdump... objdump 2023-06-08T04:03:42.009 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to recognize dependent libraries... pass_all 2023-06-08T04:03:42.009 INFO:teuthology.orchestra.run.smithi016.stdout:checking for dlltool... no 2023-06-08T04:03:42.009 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-08T04:03:42.010 INFO:teuthology.orchestra.run.smithi016.stdout:checking for ar... ar 2023-06-08T04:03:42.062 INFO:teuthology.orchestra.run.smithi016.stdout:checking for archiver @FILE support... @ 2023-06-08T04:03:42.063 INFO:teuthology.orchestra.run.smithi016.stdout:checking for strip... strip 2023-06-08T04:03:42.063 INFO:teuthology.orchestra.run.smithi016.stdout:checking for ranlib... ranlib 2023-06-08T04:03:42.063 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gawk... gawk 2023-06-08T04:03:42.173 INFO:teuthology.orchestra.run.smithi016.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-06-08T04:03:42.176 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sysroot... no 2023-06-08T04:03:42.183 INFO:teuthology.orchestra.run.smithi016.stdout:checking for a working dd... /bin/dd 2023-06-08T04:03:42.190 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-06-08T04:03:42.219 INFO:teuthology.orchestra.run.smithi016.stdout:checking for mt... no 2023-06-08T04:03:42.225 INFO:teuthology.orchestra.run.smithi016.stdout:checking if : is a manifest tool... no 2023-06-08T04:03:42.285 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to run the C preprocessor... gcc -E 2023-06-08T04:03:42.536 INFO:teuthology.orchestra.run.smithi016.stdout:checking for ANSI C header files... yes 2023-06-08T04:03:42.580 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/types.h... yes 2023-06-08T04:03:42.641 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/stat.h... yes 2023-06-08T04:03:42.694 INFO:teuthology.orchestra.run.smithi016.stdout:checking for stdlib.h... yes 2023-06-08T04:03:42.747 INFO:teuthology.orchestra.run.smithi016.stdout:checking for string.h... yes 2023-06-08T04:03:42.801 INFO:teuthology.orchestra.run.smithi016.stdout:checking for memory.h... yes 2023-06-08T04:03:42.854 INFO:teuthology.orchestra.run.smithi016.stdout:checking for strings.h... yes 2023-06-08T04:03:42.919 INFO:teuthology.orchestra.run.smithi016.stdout:checking for inttypes.h... yes 2023-06-08T04:03:42.974 INFO:teuthology.orchestra.run.smithi016.stdout:checking for stdint.h... yes 2023-06-08T04:03:43.033 INFO:teuthology.orchestra.run.smithi016.stdout:checking for unistd.h... yes 2023-06-08T04:03:43.094 INFO:teuthology.orchestra.run.smithi016.stdout:checking for dlfcn.h... yes 2023-06-08T04:03:43.103 INFO:teuthology.orchestra.run.smithi016.stdout:checking for objdir... .libs 2023-06-08T04:03:43.240 INFO:teuthology.orchestra.run.smithi016.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-08T04:03:43.240 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-08T04:03:43.279 INFO:teuthology.orchestra.run.smithi016.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-08T04:03:43.317 INFO:teuthology.orchestra.run.smithi016.stdout:checking if gcc static flag -static works... no 2023-06-08T04:03:43.370 INFO:teuthology.orchestra.run.smithi016.stdout:checking if gcc supports -c -o file.o... yes 2023-06-08T04:03:43.370 INFO:teuthology.orchestra.run.smithi016.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-08T04:03:43.385 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-08T04:03:43.434 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether -lc should be explicitly linked in... no 2023-06-08T04:03:43.530 INFO:teuthology.orchestra.run.smithi016.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-08T04:03:43.531 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to hardcode library paths into programs... immediate 2023-06-08T04:03:43.543 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether stripping libraries is possible... yes 2023-06-08T04:03:43.543 INFO:teuthology.orchestra.run.smithi016.stdout:checking if libtool supports shared libraries... yes 2023-06-08T04:03:43.544 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether to build shared libraries... yes 2023-06-08T04:03:43.544 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether to build static libraries... yes 2023-06-08T04:03:43.555 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gcc... (cached) gcc 2023-06-08T04:03:43.594 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-08T04:03:43.595 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-08T04:03:43.595 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-08T04:03:43.596 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gmake... /usr/bin/gmake 2023-06-08T04:03:43.597 INFO:teuthology.orchestra.run.smithi016.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-06-08T04:03:43.597 INFO:teuthology.orchestra.run.smithi016.stdout:checking for tar... /bin/tar 2023-06-08T04:03:43.597 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gzip... /bin/gzip 2023-06-08T04:03:43.614 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether gcc -MM is supported... yes 2023-06-08T04:03:43.615 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sort... /bin/sort 2023-06-08T04:03:43.615 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether ln -s works... yes 2023-06-08T04:03:43.615 INFO:teuthology.orchestra.run.smithi016.stdout:checking for rpm... /bin/rpm 2023-06-08T04:03:43.624 INFO:teuthology.orchestra.run.smithi016.stdout:checking for rpmbuild... no 2023-06-08T04:03:43.686 INFO:teuthology.orchestra.run.smithi016.stdout:checking assert.h usability... yes 2023-06-08T04:03:43.702 INFO:teuthology.orchestra.run.smithi016.stdout:checking assert.h presence... yes 2023-06-08T04:03:43.702 INFO:teuthology.orchestra.run.smithi016.stdout:checking for assert.h... yes 2023-06-08T04:03:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:checking bstring.h usability... no 2023-06-08T04:03:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:checking bstring.h presence... no 2023-06-08T04:03:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:checking for bstring.h... no 2023-06-08T04:03:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:checking libgen.h usability... yes 2023-06-08T04:03:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:checking libgen.h presence... yes 2023-06-08T04:03:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:checking for libgen.h... yes 2023-06-08T04:03:43.919 INFO:teuthology.orchestra.run.smithi016.stdout:checking dirent.h usability... yes 2023-06-08T04:03:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:checking dirent.h presence... yes 2023-06-08T04:03:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:checking for dirent.h... yes 2023-06-08T04:03:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:checking errno.h usability... yes 2023-06-08T04:03:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:checking errno.h presence... yes 2023-06-08T04:03:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:checking for errno.h... yes 2023-06-08T04:03:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:checking malloc.h usability... yes 2023-06-08T04:03:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:checking malloc.h presence... yes 2023-06-08T04:03:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:checking for malloc.h... yes 2023-06-08T04:03:44.162 INFO:teuthology.orchestra.run.smithi016.stdout:checking uuid.h usability... no 2023-06-08T04:03:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:checking uuid.h presence... no 2023-06-08T04:03:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:checking for uuid.h... no 2023-06-08T04:03:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:checking uuid/uuid.h usability... yes 2023-06-08T04:03:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:checking uuid/uuid.h presence... yes 2023-06-08T04:03:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:checking for uuid/uuid.h... yes 2023-06-08T04:03:44.328 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/uuid.h usability... no 2023-06-08T04:03:44.352 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/uuid.h presence... no 2023-06-08T04:03:44.352 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/uuid.h... no 2023-06-08T04:03:44.403 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/file.h usability... yes 2023-06-08T04:03:44.420 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/file.h presence... yes 2023-06-08T04:03:44.421 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/file.h... yes 2023-06-08T04:03:44.479 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/fcntl.h usability... yes 2023-06-08T04:03:44.496 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/fcntl.h presence... yes 2023-06-08T04:03:44.496 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/fcntl.h... yes 2023-06-08T04:03:44.553 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/syssgi.h usability... no 2023-06-08T04:03:44.578 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/syssgi.h presence... no 2023-06-08T04:03:44.578 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/syssgi.h... no 2023-06-08T04:03:44.647 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/param.h usability... yes 2023-06-08T04:03:44.668 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/param.h presence... yes 2023-06-08T04:03:44.669 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/param.h... yes 2023-06-08T04:03:44.683 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/stat.h... (cached) yes 2023-06-08T04:03:44.741 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/statvfs.h usability... yes 2023-06-08T04:03:44.758 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/statvfs.h presence... yes 2023-06-08T04:03:44.758 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/statvfs.h... yes 2023-06-08T04:03:44.816 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/time.h usability... yes 2023-06-08T04:03:44.833 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/time.h presence... yes 2023-06-08T04:03:44.833 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/time.h... yes 2023-06-08T04:03:44.906 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/ioctl.h usability... yes 2023-06-08T04:03:44.923 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/ioctl.h presence... yes 2023-06-08T04:03:44.923 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/ioctl.h... yes 2023-06-08T04:03:44.984 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/wait.h usability... yes 2023-06-08T04:03:45.003 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/wait.h presence... yes 2023-06-08T04:03:45.003 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/wait.h... yes 2023-06-08T04:03:45.017 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/types.h... (cached) yes 2023-06-08T04:03:45.031 INFO:teuthology.orchestra.run.smithi016.stdout:checking for strings.h... (cached) yes 2023-06-08T04:03:45.089 INFO:teuthology.orchestra.run.smithi016.stdout:checking err.h usability... yes 2023-06-08T04:03:45.105 INFO:teuthology.orchestra.run.smithi016.stdout:checking err.h presence... yes 2023-06-08T04:03:45.106 INFO:teuthology.orchestra.run.smithi016.stdout:checking for err.h... yes 2023-06-08T04:03:45.163 INFO:teuthology.orchestra.run.smithi016.stdout:checking linux/falloc.h usability... yes 2023-06-08T04:03:45.178 INFO:teuthology.orchestra.run.smithi016.stdout:checking linux/falloc.h presence... yes 2023-06-08T04:03:45.179 INFO:teuthology.orchestra.run.smithi016.stdout:checking for linux/falloc.h... yes 2023-06-08T04:03:45.236 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-06-08T04:03:45.260 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-06-08T04:03:45.260 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-08T04:03:45.309 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/fs/xfs_itable.h usability... no 2023-06-08T04:03:45.333 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/fs/xfs_itable.h presence... no 2023-06-08T04:03:45.333 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-08T04:03:45.381 INFO:teuthology.orchestra.run.smithi016.stdout:checking xfs/platform_defs.h usability... no 2023-06-08T04:03:45.406 INFO:teuthology.orchestra.run.smithi016.stdout:checking xfs/platform_defs.h presence... no 2023-06-08T04:03:45.406 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/platform_defs.h... no 2023-06-08T04:03:45.455 INFO:teuthology.orchestra.run.smithi016.stdout:checking btrfs/ioctl.h usability... no 2023-06-08T04:03:45.479 INFO:teuthology.orchestra.run.smithi016.stdout:checking btrfs/ioctl.h presence... no 2023-06-08T04:03:45.479 INFO:teuthology.orchestra.run.smithi016.stdout:checking for btrfs/ioctl.h... no 2023-06-08T04:03:45.528 INFO:teuthology.orchestra.run.smithi016.stdout:checking cifs/ioctl.h usability... no 2023-06-08T04:03:45.552 INFO:teuthology.orchestra.run.smithi016.stdout:checking cifs/ioctl.h presence... no 2023-06-08T04:03:45.553 INFO:teuthology.orchestra.run.smithi016.stdout:checking for cifs/ioctl.h... no 2023-06-08T04:03:45.603 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/mman.h usability... yes 2023-06-08T04:03:45.620 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/mman.h presence... yes 2023-06-08T04:03:45.620 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/mman.h... yes 2023-06-08T04:03:45.658 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/xfs_log_format.h... no 2023-06-08T04:03:45.728 INFO:teuthology.orchestra.run.smithi016.stdout:checking for uuid_compare... no 2023-06-08T04:03:45.786 INFO:teuthology.orchestra.run.smithi016.stdout:checking for uuid_compare in -luuid... yes 2023-06-08T04:03:45.864 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/xfs.h... yes 2023-06-08T04:03:45.896 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/libxfs.h... no 2023-06-08T04:03:45.935 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-08T04:03:45.988 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/xqm.h... yes 2023-06-08T04:03:46.070 INFO:teuthology.orchestra.run.smithi016.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-08T04:03:46.115 INFO:teuthology.orchestra.run.smithi016.stdout:checking xfs/handle.h usability... yes 2023-06-08T04:03:46.131 INFO:teuthology.orchestra.run.smithi016.stdout:checking xfs/handle.h presence... yes 2023-06-08T04:03:46.131 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/handle.h... yes 2023-06-08T04:03:46.190 INFO:teuthology.orchestra.run.smithi016.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-08T04:03:46.248 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/acl.h usability... yes 2023-06-08T04:03:46.266 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/acl.h presence... yes 2023-06-08T04:03:46.267 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/acl.h... yes 2023-06-08T04:03:46.325 INFO:teuthology.orchestra.run.smithi016.stdout:checking acl/libacl.h usability... yes 2023-06-08T04:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout:checking acl/libacl.h presence... yes 2023-06-08T04:03:46.344 INFO:teuthology.orchestra.run.smithi016.stdout:checking for acl/libacl.h... yes 2023-06-08T04:03:46.404 INFO:teuthology.orchestra.run.smithi016.stdout:checking for acl_init in -lacl... yes 2023-06-08T04:03:46.451 INFO:teuthology.orchestra.run.smithi016.stdout:checking gdbm-ndbm.h usability... no 2023-06-08T04:03:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:checking gdbm-ndbm.h presence... no 2023-06-08T04:03:46.476 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gdbm-ndbm.h... no 2023-06-08T04:03:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:checking gdbm/ndbm.h usability... no 2023-06-08T04:03:46.543 INFO:teuthology.orchestra.run.smithi016.stdout:checking gdbm/ndbm.h presence... no 2023-06-08T04:03:46.544 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gdbm/ndbm.h... no 2023-06-08T04:03:46.587 INFO:teuthology.orchestra.run.smithi016.stdout:checking ndbm.h usability... no 2023-06-08T04:03:46.611 INFO:teuthology.orchestra.run.smithi016.stdout:checking ndbm.h presence... no 2023-06-08T04:03:46.611 INFO:teuthology.orchestra.run.smithi016.stdout:checking for ndbm.h... no 2023-06-08T04:03:46.661 INFO:teuthology.orchestra.run.smithi016.stdout:checking libaio.h usability... yes 2023-06-08T04:03:46.683 INFO:teuthology.orchestra.run.smithi016.stdout:checking libaio.h presence... yes 2023-06-08T04:03:46.683 INFO:teuthology.orchestra.run.smithi016.stdout:checking for libaio.h... yes 2023-06-08T04:03:46.730 INFO:teuthology.orchestra.run.smithi016.stdout:checking liburing.h usability... no 2023-06-08T04:03:46.754 INFO:teuthology.orchestra.run.smithi016.stdout:checking liburing.h presence... no 2023-06-08T04:03:46.754 INFO:teuthology.orchestra.run.smithi016.stdout:checking for liburing.h... no 2023-06-08T04:03:46.798 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/capability.h usability... no 2023-06-08T04:03:46.822 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/capability.h presence... no 2023-06-08T04:03:46.822 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/capability.h... no 2023-06-08T04:03:46.867 INFO:teuthology.orchestra.run.smithi016.stdout:checking linux/fiemap.h usability... yes 2023-06-08T04:03:46.884 INFO:teuthology.orchestra.run.smithi016.stdout:checking linux/fiemap.h presence... yes 2023-06-08T04:03:46.884 INFO:teuthology.orchestra.run.smithi016.stdout:checking for linux/fiemap.h... yes 2023-06-08T04:03:46.948 INFO:teuthology.orchestra.run.smithi016.stdout:checking for fallocate... yes 2023-06-08T04:03:47.009 INFO:teuthology.orchestra.run.smithi016.stdout:checking for open_by_handle_at... yes 2023-06-08T04:03:47.056 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/prctl.h usability... yes 2023-06-08T04:03:47.073 INFO:teuthology.orchestra.run.smithi016.stdout:checking sys/prctl.h presence... yes 2023-06-08T04:03:47.074 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/prctl.h... yes 2023-06-08T04:03:47.121 INFO:teuthology.orchestra.run.smithi016.stdout:checking linux/fs.h usability... yes 2023-06-08T04:03:47.138 INFO:teuthology.orchestra.run.smithi016.stdout:checking linux/fs.h presence... yes 2023-06-08T04:03:47.138 INFO:teuthology.orchestra.run.smithi016.stdout:checking for linux/fs.h... yes 2023-06-08T04:03:47.181 INFO:teuthology.orchestra.run.smithi016.stdout:checking btrfsutil.h usability... no 2023-06-08T04:03:47.205 INFO:teuthology.orchestra.run.smithi016.stdout:checking btrfsutil.h presence... no 2023-06-08T04:03:47.205 INFO:teuthology.orchestra.run.smithi016.stdout:checking for btrfsutil.h... no 2023-06-08T04:03:47.268 INFO:teuthology.orchestra.run.smithi016.stdout:checking for copy_file_range... yes 2023-06-08T04:03:47.332 INFO:teuthology.orchestra.run.smithi016.stdout:checking for SEEK_DATA... yes 2023-06-08T04:03:47.413 INFO:teuthology.orchestra.run.smithi016.stdout:checking for BMV_OF_SHARED... yes 2023-06-08T04:03:47.478 INFO:teuthology.orchestra.run.smithi016.stdout:checking for nftw... yes 2023-06-08T04:03:47.540 INFO:teuthology.orchestra.run.smithi016.stdout:checking for RLIMIT_NOFILE... yes 2023-06-08T04:03:47.579 INFO:teuthology.orchestra.run.smithi016.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-08T04:03:47.641 INFO:teuthology.orchestra.run.smithi016.stdout:checking for renameat2... yes 2023-06-08T04:03:47.702 INFO:teuthology.orchestra.run.smithi016.stdout:checking for reallocarray... yes 2023-06-08T04:03:47.735 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct mount_attr... no 2023-06-08T04:03:47.810 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-08T04:03:47.884 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-08T04:03:47.957 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-08T04:03:48.031 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-08T04:03:48.104 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-08T04:03:48.179 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-08T04:03:48.262 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-08T04:03:48.318 INFO:teuthology.orchestra.run.smithi016.stdout:checking linux/btrfs.h usability... yes 2023-06-08T04:03:48.334 INFO:teuthology.orchestra.run.smithi016.stdout:checking linux/btrfs.h presence... yes 2023-06-08T04:03:48.335 INFO:teuthology.orchestra.run.smithi016.stdout:checking for linux/btrfs.h... yes 2023-06-08T04:03:48.396 INFO:teuthology.orchestra.run.smithi016.stdout:checking linux/btrfs_tree.h usability... yes 2023-06-08T04:03:48.413 INFO:teuthology.orchestra.run.smithi016.stdout:checking linux/btrfs_tree.h presence... yes 2023-06-08T04:03:48.413 INFO:teuthology.orchestra.run.smithi016.stdout:checking for linux/btrfs_tree.h... yes 2023-06-08T04:03:48.487 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-06-08T04:03:48.516 INFO:teuthology.orchestra.run.smithi016.stdout:configure: creating ./config.status 2023-06-08T04:03:49.423 INFO:teuthology.orchestra.run.smithi016.stdout:config.status: creating include/builddefs 2023-06-08T04:03:49.452 INFO:teuthology.orchestra.run.smithi016.stdout:config.status: creating include/config.h 2023-06-08T04:03:49.475 INFO:teuthology.orchestra.run.smithi016.stdout:config.status: executing libtool commands 2023-06-08T04:03:49.554 INFO:teuthology.orchestra.run.smithi016.stdout:Building include 2023-06-08T04:03:49.562 INFO:teuthology.orchestra.run.smithi016.stdout:Building lib 2023-06-08T04:03:49.568 INFO:teuthology.orchestra.run.smithi016.stdout: [LTDEP] 2023-06-08T04:03:49.773 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dataascii.lo 2023-06-08T04:03:49.979 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] databin.lo 2023-06-08T04:03:50.218 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] datapid.lo 2023-06-08T04:03:50.410 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] file_lock.lo 2023-06-08T04:03:50.651 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] forker.lo 2023-06-08T04:03:50.874 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] pattern.lo 2023-06-08T04:03:51.080 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] open_flags.lo 2023-06-08T04:03:51.315 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] random_range.lo 2023-06-08T04:03:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] string_to_tokens.lo 2023-06-08T04:03:51.821 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] str_to_bytes.lo 2023-06-08T04:03:52.039 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] tlibio.lo 2023-06-08T04:03:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] write_log.lo 2023-06-08T04:03:52.703 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] random.lo 2023-06-08T04:03:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: [LD] 2023-06-08T04:03:53.043 INFO:teuthology.orchestra.run.smithi016.stdout:Building ltp 2023-06-08T04:03:53.049 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-06-08T04:03:53.268 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] doio 2023-06-08T04:03:54.034 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fsstress 2023-06-08T04:03:55.488 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fsx 2023-06-08T04:03:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] growfiles 2023-06-08T04:03:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] iogen 2023-06-08T04:03:57.555 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-stress 2023-06-08T04:03:58.083 INFO:teuthology.orchestra.run.smithi016.stdout:Building src 2023-06-08T04:03:58.092 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-06-08T04:03:58.672 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:03:58.676 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:04:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-06-08T04:04:00.627 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-06-08T04:04:00.643 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-06-08T04:04:00.994 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-06-08T04:04:01.035 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dirstress 2023-06-08T04:04:01.381 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fill 2023-06-08T04:04:01.636 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fill2 2023-06-08T04:04:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] getpagesize 2023-06-08T04:04:02.209 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] holes 2023-06-08T04:04:02.509 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] lstat64 2023-06-08T04:04:02.795 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] nametest 2023-06-08T04:04:03.142 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] permname 2023-06-08T04:04:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] randholes 2023-06-08T04:04:03.805 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] runas 2023-06-08T04:04:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] truncfile 2023-06-08T04:04:04.372 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] usemem 2023-06-08T04:04:04.625 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] mmapcat 2023-06-08T04:04:04.877 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] append_reader 2023-06-08T04:04:05.132 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] append_writer 2023-06-08T04:04:05.386 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dirperf 2023-06-08T04:04:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] metaperf 2023-06-08T04:04:06.074 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] devzero 2023-06-08T04:04:06.359 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] feature 2023-06-08T04:04:06.682 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] alloc 2023-06-08T04:04:07.001 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fault 2023-06-08T04:04:07.273 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fstest 2023-06-08T04:04:07.619 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_access_root 2023-06-08T04:04:07.877 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] godown 2023-06-08T04:04:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] resvtest 2023-06-08T04:04:08.443 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] writemod 2023-06-08T04:04:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] writev_on_pagefault 2023-06-08T04:04:08.952 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] makeextents 2023-06-08T04:04:09.238 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] itrash 2023-06-08T04:04:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] rename 2023-06-08T04:04:09.735 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] multi_open_unlink 2023-06-08T04:04:10.005 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] unwritten_sync 2023-06-08T04:04:10.292 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] genhashnames 2023-06-08T04:04:10.581 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_holes 2023-06-08T04:04:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_writev 2023-06-08T04:04:11.081 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_truncate_cmtime 2023-06-08T04:04:11.342 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dirhash_collide 2023-06-08T04:04:11.627 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_rename_overwrite 2023-06-08T04:04:11.871 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] holetest 2023-06-08T04:04:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_truncate_self 2023-06-08T04:04:12.433 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] af_unix 2023-06-08T04:04:12.689 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_stale_pmd 2023-06-08T04:04:12.945 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_cow_race 2023-06-08T04:04:13.214 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_fallocate 2023-06-08T04:04:13.466 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fsync-err 2023-06-08T04:04:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_write_ro 2023-06-08T04:04:14.008 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-08T04:04:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-08T04:04:14.530 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_ofd_locks 2023-06-08T04:04:14.837 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_collision 2023-06-08T04:04:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] mmap-write-concurrent 2023-06-08T04:04:15.414 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_get_file_time 2023-06-08T04:04:15.665 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_create_short_dirs 2023-06-08T04:04:15.938 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_create_long_dirs 2023-06-08T04:04:16.204 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_enospc 2023-06-08T04:04:16.495 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_writev_overlap 2023-06-08T04:04:16.768 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] checkpoint_journal 2023-06-08T04:04:17.028 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] mmap-rw-fault 2023-06-08T04:04:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] allocstale 2023-06-08T04:04:17.588 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_cow_memory_failure 2023-06-08T04:04:17.865 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fake-dump-rootino 2023-06-08T04:04:18.117 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dio-buf-fault 2023-06-08T04:04:18.374 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] xfsctl 2023-06-08T04:04:18.670 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] bstat 2023-06-08T04:04:18.981 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mtab 2023-06-08T04:04:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] getdevicesize 2023-06-08T04:04:19.516 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] preallo_rw_pattern_reader 2023-06-08T04:04:19.783 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] preallo_rw_pattern_writer 2023-06-08T04:04:20.049 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] ftrunc 2023-06-08T04:04:20.300 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] trunc 2023-06-08T04:04:20.564 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fs_perms 2023-06-08T04:04:20.832 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] testx 2023-06-08T04:04:21.064 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] looptest 2023-06-08T04:04:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] locktest 2023-06-08T04:04:21.773 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] unwritten_mmap 2023-06-08T04:04:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] bulkstat_unlink_test 2023-06-08T04:04:22.351 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] deduperace 2023-06-08T04:04:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] bulkstat_unlink_test_modified 2023-06-08T04:04:22.957 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_dir_offset 2023-06-08T04:04:23.209 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_futimens 2023-06-08T04:04:23.451 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_immutable 2023-06-08T04:04:24.170 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] stale_handle 2023-06-08T04:04:24.448 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] pwrite_mmap_blocked 2023-06-08T04:04:24.706 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_dir_offset2 2023-06-08T04:04:25.002 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] seek_sanity_test 2023-06-08T04:04:25.526 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] seek_copy_test 2023-06-08T04:04:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_readdir_1 2023-06-08T04:04:26.059 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_readdir_2 2023-06-08T04:04:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fsync-tester 2023-06-08T04:04:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] nsexec 2023-06-08T04:04:26.950 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] cloner 2023-06-08T04:04:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] renameat2 2023-06-08T04:04:27.504 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_getcwd 2023-06-08T04:04:27.765 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] e4compact 2023-06-08T04:04:28.072 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] test-nextquota 2023-06-08T04:04:28.350 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] punch-alternating 2023-06-08T04:04:28.628 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-08T04:04:28.877 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:04:28.881 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:04:28.902 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] listxattr 2023-06-08T04:04:29.155 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dio-interleaved 2023-06-08T04:04:29.420 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_dir_type 2023-06-08T04:04:29.679 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dio-invalidate-cache 2023-06-08T04:04:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] stat_test 2023-06-08T04:04:30.393 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_encrypted_d_revalidate 2023-06-08T04:04:30.664 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] attr_replace_test 2023-06-08T04:04:30.933 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] swapon 2023-06-08T04:04:31.204 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] mkswap 2023-06-08T04:04:31.460 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_attr_corruption 2023-06-08T04:04:31.717 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_open_tmpfiles 2023-06-08T04:04:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fscrypt-crypt-util 2023-06-08T04:04:32.751 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] bulkstat_null_ocount 2023-06-08T04:04:33.017 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] splice-test 2023-06-08T04:04:33.305 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] chprojid_fail 2023-06-08T04:04:33.574 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] detached_mounts_propagation 2023-06-08T04:04:33.867 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] ext4_resize 2023-06-08T04:04:34.119 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_readdir_3 2023-06-08T04:04:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] splice2pipe 2023-06-08T04:04:34.687 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] uuid_ioctl 2023-06-08T04:04:34.949 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fiemap-tester 2023-06-08T04:04:35.321 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_stripealign 2023-06-08T04:04:35.579 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] open_by_handle 2023-06-08T04:04:35.939 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_dio 2023-06-08T04:04:36.205 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] xfsfind 2023-06-08T04:04:36.509 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fssum 2023-06-08T04:04:37.053 INFO:teuthology.orchestra.run.smithi016.stdout:Building log-writes 2023-06-08T04:04:37.063 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] replay-log 2023-06-08T04:04:37.487 INFO:teuthology.orchestra.run.smithi016.stdout:Building perf 2023-06-08T04:04:37.494 INFO:teuthology.orchestra.run.smithi016.stdout:Building aio-dio-regress 2023-06-08T04:04:37.505 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-08T04:04:37.787 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-fcntl-race 2023-06-08T04:04:38.061 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-subblock-eof-read 2023-06-08T04:04:38.312 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-append-write-read-race 2023-06-08T04:04:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-invalidate-readahead 2023-06-08T04:04:38.872 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-hole-filling-race 2023-06-08T04:04:39.132 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-08T04:04:39.374 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-last-ref-held-by-io 2023-06-08T04:04:39.659 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-cycle-write 2023-06-08T04:04:39.953 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-extend-stat 2023-06-08T04:04:40.227 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-08T04:04:40.467 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-invalidate-failure 2023-06-08T04:04:40.735 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aiodio_sparse2 2023-06-08T04:04:41.059 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aiocp 2023-06-08T04:04:41.392 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-cow-race 2023-06-08T04:04:41.655 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-write-verify 2023-06-08T04:04:41.956 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-eof-race 2023-06-08T04:04:42.248 INFO:teuthology.orchestra.run.smithi016.stdout:Building vfs 2023-06-08T04:04:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] vfstest 2023-06-08T04:04:44.351 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] mount-idmapped 2023-06-08T04:04:44.845 INFO:teuthology.orchestra.run.smithi016.stdout:Building m4 2023-06-08T04:04:44.852 INFO:teuthology.orchestra.run.smithi016.stdout:Building common 2023-06-08T04:04:44.859 INFO:teuthology.orchestra.run.smithi016.stdout:Building tests 2023-06-08T04:04:44.870 INFO:teuthology.orchestra.run.smithi016.stdout:Building perf 2023-06-08T04:04:44.880 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/perf/group.list 2023-06-08T04:04:44.909 INFO:teuthology.orchestra.run.smithi016.stdout:Building ext4 2023-06-08T04:04:44.920 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/ext4/group.list 2023-06-08T04:04:45.015 INFO:teuthology.orchestra.run.smithi016.stdout:Building ocfs2 2023-06-08T04:04:45.025 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/ocfs2/group.list 2023-06-08T04:04:45.059 INFO:teuthology.orchestra.run.smithi016.stdout:Building overlay 2023-06-08T04:04:45.069 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/overlay/group.list 2023-06-08T04:04:45.166 INFO:teuthology.orchestra.run.smithi016.stdout:Building cifs 2023-06-08T04:04:45.176 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/cifs/group.list 2023-06-08T04:04:45.208 INFO:teuthology.orchestra.run.smithi016.stdout:Building generic 2023-06-08T04:04:45.220 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/generic/group.list 2023-06-08T04:04:45.468 INFO:teuthology.orchestra.run.smithi016.stdout:Building shared 2023-06-08T04:04:45.478 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/shared/group.list 2023-06-08T04:04:45.522 INFO:teuthology.orchestra.run.smithi016.stdout:Building nfs 2023-06-08T04:04:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/nfs/group.list 2023-06-08T04:04:45.569 INFO:teuthology.orchestra.run.smithi016.stdout:Building f2fs 2023-06-08T04:04:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/f2fs/group.list 2023-06-08T04:04:45.623 INFO:teuthology.orchestra.run.smithi016.stdout:Building udf 2023-06-08T04:04:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/udf/group.list 2023-06-08T04:04:45.662 INFO:teuthology.orchestra.run.smithi016.stdout:Building ceph 2023-06-08T04:04:45.672 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/ceph/group.list 2023-06-08T04:04:45.709 INFO:teuthology.orchestra.run.smithi016.stdout:Building xfs 2023-06-08T04:04:45.721 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/xfs/group.list 2023-06-08T04:04:45.972 INFO:teuthology.orchestra.run.smithi016.stdout:Building btrfs 2023-06-08T04:04:45.983 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/btrfs/group.list 2023-06-08T04:04:46.131 INFO:teuthology.orchestra.run.smithi016.stdout:Building tmpfs 2023-06-08T04:04:46.141 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/tmpfs/group.list 2023-06-08T04:04:46.176 INFO:teuthology.orchestra.run.smithi016.stdout:Building selftest 2023-06-08T04:04:46.186 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/selftest/group.list 2023-06-08T04:04:46.221 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo make install) 2023-06-08T04:04:46.314 INFO:teuthology.orchestra.run.smithi016.stdout:Building include 2023-06-08T04:04:46.321 INFO:teuthology.orchestra.run.smithi016.stdout:Building lib 2023-06-08T04:04:46.329 INFO:teuthology.orchestra.run.smithi016.stdout:Building ltp 2023-06-08T04:04:46.337 INFO:teuthology.orchestra.run.smithi016.stdout:Building src 2023-06-08T04:04:46.399 INFO:teuthology.orchestra.run.smithi016.stdout:Building log-writes 2023-06-08T04:04:46.406 INFO:teuthology.orchestra.run.smithi016.stdout:Building perf 2023-06-08T04:04:46.414 INFO:teuthology.orchestra.run.smithi016.stdout:Building aio-dio-regress 2023-06-08T04:04:46.422 INFO:teuthology.orchestra.run.smithi016.stdout:Building vfs 2023-06-08T04:04:46.430 INFO:teuthology.orchestra.run.smithi016.stdout:Building m4 2023-06-08T04:04:46.437 INFO:teuthology.orchestra.run.smithi016.stdout:Building common 2023-06-08T04:04:46.445 INFO:teuthology.orchestra.run.smithi016.stdout:Building tests 2023-06-08T04:04:46.455 INFO:teuthology.orchestra.run.smithi016.stdout:Building perf 2023-06-08T04:04:46.465 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/perf/group.list 2023-06-08T04:04:46.494 INFO:teuthology.orchestra.run.smithi016.stdout:Building ext4 2023-06-08T04:04:46.505 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/ext4/group.list 2023-06-08T04:04:46.600 INFO:teuthology.orchestra.run.smithi016.stdout:Building ocfs2 2023-06-08T04:04:46.610 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/ocfs2/group.list 2023-06-08T04:04:46.644 INFO:teuthology.orchestra.run.smithi016.stdout:Building overlay 2023-06-08T04:04:46.655 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/overlay/group.list 2023-06-08T04:04:46.752 INFO:teuthology.orchestra.run.smithi016.stdout:Building cifs 2023-06-08T04:04:46.762 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/cifs/group.list 2023-06-08T04:04:46.794 INFO:teuthology.orchestra.run.smithi016.stdout:Building generic 2023-06-08T04:04:46.806 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/generic/group.list 2023-06-08T04:04:47.048 INFO:teuthology.orchestra.run.smithi016.stdout:Building shared 2023-06-08T04:04:47.058 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/shared/group.list 2023-06-08T04:04:47.103 INFO:teuthology.orchestra.run.smithi016.stdout:Building nfs 2023-06-08T04:04:47.113 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/nfs/group.list 2023-06-08T04:04:47.150 INFO:teuthology.orchestra.run.smithi016.stdout:Building f2fs 2023-06-08T04:04:47.160 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/f2fs/group.list 2023-06-08T04:04:47.204 INFO:teuthology.orchestra.run.smithi016.stdout:Building udf 2023-06-08T04:04:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/udf/group.list 2023-06-08T04:04:47.243 INFO:teuthology.orchestra.run.smithi016.stdout:Building ceph 2023-06-08T04:04:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/ceph/group.list 2023-06-08T04:04:47.290 INFO:teuthology.orchestra.run.smithi016.stdout:Building xfs 2023-06-08T04:04:47.302 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/xfs/group.list 2023-06-08T04:04:47.546 INFO:teuthology.orchestra.run.smithi016.stdout:Building btrfs 2023-06-08T04:04:47.556 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/btrfs/group.list 2023-06-08T04:04:47.705 INFO:teuthology.orchestra.run.smithi016.stdout:Building tmpfs 2023-06-08T04:04:47.715 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/tmpfs/group.list 2023-06-08T04:04:47.750 INFO:teuthology.orchestra.run.smithi016.stdout:Building selftest 2023-06-08T04:04:47.760 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/selftest/group.list 2023-06-08T04:04:47.791 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-06-08T04:04:47.793 INFO:teuthology.orchestra.run.smithi016.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-08T04:04:47.794 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-06-08T04:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-08T04:04:47.797 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-06-08T04:04:47.800 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-08T04:04:47.824 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-08T04:04:48.000 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-08T04:04:48.024 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-06-08T04:04:48.054 INFO:teuthology.orchestra.run.smithi016.stdout:Building log-writes 2023-06-08T04:04:48.061 INFO:teuthology.orchestra.run.smithi016.stdout:Building perf 2023-06-08T04:04:48.069 INFO:teuthology.orchestra.run.smithi016.stdout:Building aio-dio-regress 2023-06-08T04:04:48.077 INFO:teuthology.orchestra.run.smithi016.stdout:Building vfs 2023-06-08T04:04:48.082 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake -C log-writes install 2023-06-08T04:04:48.085 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-08T04:04:48.108 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-08T04:04:48.132 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake -C perf install 2023-06-08T04:04:48.135 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-08T04:04:48.158 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-08T04:04:48.218 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-06-08T04:04:48.221 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-08T04:04:48.244 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-06-08T04:04:48.386 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake -C vfs install 2023-06-08T04:04:48.389 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-08T04:04:48.412 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-08T04:04:48.444 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-08T04:04:48.468 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-08T04:04:51.464 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-08T04:04:51.685 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-08T04:04:51.741 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-06-08T04:04:51.744 INFO:teuthology.orchestra.run.smithi016.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-08T04:04:51.744 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-06-08T04:04:51.747 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-08T04:04:51.770 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-08T04:04:52.126 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-06-08T04:04:52.129 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/btrfs/ install 2023-06-08T04:04:52.133 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-08T04:04:52.156 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-08T04:04:54.298 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-08T04:04:54.322 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 014.out 036.out 016.out 175.out 193.out 240.out 069.out 282.out 015.out 280.out 140.out 258.out 008.out 004.out 199.out 233.out 194.out 234.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 137.out 125.out 078.out 152.out 103.out 264.out 243.out 192.out 148.out 075.out 077.out 178.out 284.out 052.out 256.out 207.out 228.out 028.out 183.out 094.out 046.out 273.out 251.out 209.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 128.out 232.out 021.out 275.out 221.out 087.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 242.out 187.out 220.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 073.out 084.out 129.out 241.out 029.out 229.out 254.out 111.out 011.out 155.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 276.out 114.out 138.out 095.out 038.out 145.out 160.out 091.out 081.out 071.out 061.out 085.out 265.out 200.out 100.out 025.out 286.out 269.out 039.out 196.out 098.out 090.out 080.out 070.out 060.out 208.out 009.out 167.out 217.out 120.out 191.out 133.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 281.out 225.out 235.out 253.out 257.out 124.out 035.out 172.out 278.out 063.out 058.out 262.out 169.out 042.out 153.out 097.out 283.out 236.out 186.out 053.out 164.out 154.out 239.out 189.out 139.out 267.out 141.out 214.out 005.out 223.out 086.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 180.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 106.out 291.out 185.out 037.out 088.out 285.out 123.out 056.out 201.out 019.out 001.out 287.out 142.out 237.out 151.out 231.out 024.out 163.out 044.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 067.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 099.out 082.out 030.out 203.out 003.out 055.out 076.out 245.out 122.out 074.out 222.out 159.out 249.out 022.out 174.out 006.out 045.out 290.out 299.out 224.out 181.out 271.out 149.out 064.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 150.out 049.out 226.out 126.out 165.out 026.out /var/lib/xfstests/tests/btrfs 2023-06-08T04:04:56.478 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/ceph/ install 2023-06-08T04:04:56.481 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-08T04:04:56.504 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-08T04:04:56.557 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-08T04:04:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-06-08T04:04:56.633 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/cifs/ install 2023-06-08T04:04:56.636 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-08T04:04:56.659 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-08T04:04:56.684 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-08T04:04:56.707 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-08T04:04:56.731 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/ext4/ install 2023-06-08T04:04:56.734 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-08T04:04:56.757 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-08T04:04:57.270 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-08T04:04:57.293 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-06-08T04:04:57.832 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/f2fs/ install 2023-06-08T04:04:57.835 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-08T04:04:57.858 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-08T04:04:57.889 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-08T04:04:57.913 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-08T04:04:57.944 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/generic/ install 2023-06-08T04:04:57.950 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-08T04:04:57.973 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-06-08T04:04:59.007 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:04:59.012 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:05:03.334 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-08T04:05:03.357 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 531.out 243.out 592.out 282.out 272.out 472.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 622.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 566.out 295.out 390.out 497.out 160.out 291.out 274.out 061.out 239.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 030.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 667.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 280.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 433.out 704.out 108.out 504.out 404.out 104.out 655.out 021.out 452.out 457.out 297.out 393.out 333.out 599.out 476.out 535.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 436.out 485.out 120.out 175.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 167.out 724.out 206.out 352.out 663.out 394.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 715.out 279.out 544.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 075.out 684.out 674.out 550.out 052.out 062.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 688.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 244.out 385.out 005.out 336.out 150.out 579.out 236.out 505.out 405.out 342.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 691.out 305.out 105.out 263.out 144.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 634.out 560.out 581.out 166.out 707.out 461.out 381.out 445.out 307.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 613.out 326.out 082.out 480.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 487.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 378.out 004.out 458.out 534.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 173.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 376.out 431.out 635.out 288.out 722.out 331.out 128.out 377.out 713.out 513.out 554.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 310.out 427.out 259.out 210.out 449.out 327.out 330.out 110.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 643.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 245.out 522.out 422.out 624.out 322.out 222.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 565.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 141.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 012.out 195.out 388.out 682.out 483.out 397.out 070.out 596.out 720.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 142.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 301.out 010.out 001.out 096.out 495.out 048.out 665.out 589.out 095.out 697.out 145.out 641.out 464.out 491.out 081.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 169.out 090.out 080.out 708.out 608.out 508.out 409.out 309.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 304.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 548.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out /var/lib/xfstests/tests/generic 2023-06-08T04:05:08.774 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/nfs/ install 2023-06-08T04:05:08.776 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-08T04:05:08.799 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-08T04:05:08.822 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-08T04:05:08.846 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-08T04:05:08.870 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/ocfs2/ install 2023-06-08T04:05:08.873 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-08T04:05:08.896 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-08T04:05:08.919 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-08T04:05:08.943 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-08T04:05:08.966 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/overlay/ install 2023-06-08T04:05:08.970 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-08T04:05:08.993 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-08T04:05:09.714 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-08T04:05:09.737 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-06-08T04:05:10.460 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/perf/ install 2023-06-08T04:05:10.463 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-08T04:05:10.486 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-08T04:05:10.509 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-08T04:05:10.533 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-08T04:05:10.556 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/selftest/ install 2023-06-08T04:05:10.559 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-08T04:05:10.582 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-08T04:05:10.642 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-08T04:05:10.666 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-06-08T04:05:10.726 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/shared/ install 2023-06-08T04:05:10.729 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-08T04:05:10.752 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-08T04:05:10.790 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-08T04:05:10.813 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-06-08T04:05:10.852 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/tmpfs/ install 2023-06-08T04:05:10.855 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-08T04:05:10.878 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-08T04:05:10.902 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-08T04:05:10.925 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-08T04:05:10.949 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/udf/ install 2023-06-08T04:05:10.951 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-08T04:05:10.974 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-08T04:05:10.998 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-08T04:05:11.021 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-08T04:05:11.045 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KjWTKBMgZ7xfstests-dev/tests/xfs/ install 2023-06-08T04:05:11.051 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-08T04:05:11.074 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-08T04:05:16.150 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-08T04:05:16.173 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 262.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 388.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 363.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 219.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 725.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out 383.out /var/lib/xfstests/tests/xfs 2023-06-08T04:05:21.323 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-08T04:05:21.346 INFO:teuthology.orchestra.run.smithi016.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-08T04:05:21.369 INFO:teuthology.orchestra.run.smithi016.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-08T04:05:21.393 INFO:teuthology.orchestra.run.smithi016.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-08T04:05:21.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:05:21.420 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec ls tests/generic) 2023-06-08T04:05:21.468 INFO:teuthology.orchestra.run.smithi016.stdout:001 2023-06-08T04:05:21.468 INFO:teuthology.orchestra.run.smithi016.stdout:001.out 2023-06-08T04:05:21.468 INFO:teuthology.orchestra.run.smithi016.stdout:002 2023-06-08T04:05:21.468 INFO:teuthology.orchestra.run.smithi016.stdout:002.out 2023-06-08T04:05:21.468 INFO:teuthology.orchestra.run.smithi016.stdout:003 2023-06-08T04:05:21.468 INFO:teuthology.orchestra.run.smithi016.stdout:003.out 2023-06-08T04:05:21.469 INFO:teuthology.orchestra.run.smithi016.stdout:004 2023-06-08T04:05:21.469 INFO:teuthology.orchestra.run.smithi016.stdout:004.out 2023-06-08T04:05:21.469 INFO:teuthology.orchestra.run.smithi016.stdout:005 2023-06-08T04:05:21.469 INFO:teuthology.orchestra.run.smithi016.stdout:005.out 2023-06-08T04:05:21.469 INFO:teuthology.orchestra.run.smithi016.stdout:006 2023-06-08T04:05:21.469 INFO:teuthology.orchestra.run.smithi016.stdout:006.out 2023-06-08T04:05:21.469 INFO:teuthology.orchestra.run.smithi016.stdout:007 2023-06-08T04:05:21.469 INFO:teuthology.orchestra.run.smithi016.stdout:007.out 2023-06-08T04:05:21.470 INFO:teuthology.orchestra.run.smithi016.stdout:008 2023-06-08T04:05:21.470 INFO:teuthology.orchestra.run.smithi016.stdout:008.out 2023-06-08T04:05:21.470 INFO:teuthology.orchestra.run.smithi016.stdout:009 2023-06-08T04:05:21.470 INFO:teuthology.orchestra.run.smithi016.stdout:009.out 2023-06-08T04:05:21.470 INFO:teuthology.orchestra.run.smithi016.stdout:010 2023-06-08T04:05:21.470 INFO:teuthology.orchestra.run.smithi016.stdout:010.out 2023-06-08T04:05:21.470 INFO:teuthology.orchestra.run.smithi016.stdout:011 2023-06-08T04:05:21.470 INFO:teuthology.orchestra.run.smithi016.stdout:011.out 2023-06-08T04:05:21.471 INFO:teuthology.orchestra.run.smithi016.stdout:012 2023-06-08T04:05:21.471 INFO:teuthology.orchestra.run.smithi016.stdout:012.out 2023-06-08T04:05:21.471 INFO:teuthology.orchestra.run.smithi016.stdout:013 2023-06-08T04:05:21.471 INFO:teuthology.orchestra.run.smithi016.stdout:013.out 2023-06-08T04:05:21.471 INFO:teuthology.orchestra.run.smithi016.stdout:014 2023-06-08T04:05:21.471 INFO:teuthology.orchestra.run.smithi016.stdout:014.out 2023-06-08T04:05:21.471 INFO:teuthology.orchestra.run.smithi016.stdout:015 2023-06-08T04:05:21.472 INFO:teuthology.orchestra.run.smithi016.stdout:015.out 2023-06-08T04:05:21.472 INFO:teuthology.orchestra.run.smithi016.stdout:016 2023-06-08T04:05:21.472 INFO:teuthology.orchestra.run.smithi016.stdout:016.out 2023-06-08T04:05:21.472 INFO:teuthology.orchestra.run.smithi016.stdout:017 2023-06-08T04:05:21.472 INFO:teuthology.orchestra.run.smithi016.stdout:017.out 2023-06-08T04:05:21.472 INFO:teuthology.orchestra.run.smithi016.stdout:018 2023-06-08T04:05:21.472 INFO:teuthology.orchestra.run.smithi016.stdout:018.out 2023-06-08T04:05:21.472 INFO:teuthology.orchestra.run.smithi016.stdout:019 2023-06-08T04:05:21.473 INFO:teuthology.orchestra.run.smithi016.stdout:019.out 2023-06-08T04:05:21.473 INFO:teuthology.orchestra.run.smithi016.stdout:020 2023-06-08T04:05:21.473 INFO:teuthology.orchestra.run.smithi016.stdout:020.out 2023-06-08T04:05:21.473 INFO:teuthology.orchestra.run.smithi016.stdout:021 2023-06-08T04:05:21.473 INFO:teuthology.orchestra.run.smithi016.stdout:021.out 2023-06-08T04:05:21.473 INFO:teuthology.orchestra.run.smithi016.stdout:022 2023-06-08T04:05:21.473 INFO:teuthology.orchestra.run.smithi016.stdout:022.out 2023-06-08T04:05:21.473 INFO:teuthology.orchestra.run.smithi016.stdout:023 2023-06-08T04:05:21.474 INFO:teuthology.orchestra.run.smithi016.stdout:023.out 2023-06-08T04:05:21.474 INFO:teuthology.orchestra.run.smithi016.stdout:024 2023-06-08T04:05:21.474 INFO:teuthology.orchestra.run.smithi016.stdout:024.out 2023-06-08T04:05:21.474 INFO:teuthology.orchestra.run.smithi016.stdout:025 2023-06-08T04:05:21.474 INFO:teuthology.orchestra.run.smithi016.stdout:025.out 2023-06-08T04:05:21.474 INFO:teuthology.orchestra.run.smithi016.stdout:026 2023-06-08T04:05:21.474 INFO:teuthology.orchestra.run.smithi016.stdout:026.out 2023-06-08T04:05:21.474 INFO:teuthology.orchestra.run.smithi016.stdout:027 2023-06-08T04:05:21.475 INFO:teuthology.orchestra.run.smithi016.stdout:027.out 2023-06-08T04:05:21.475 INFO:teuthology.orchestra.run.smithi016.stdout:028 2023-06-08T04:05:21.475 INFO:teuthology.orchestra.run.smithi016.stdout:028.out 2023-06-08T04:05:21.475 INFO:teuthology.orchestra.run.smithi016.stdout:029 2023-06-08T04:05:21.475 INFO:teuthology.orchestra.run.smithi016.stdout:029.out 2023-06-08T04:05:21.475 INFO:teuthology.orchestra.run.smithi016.stdout:030 2023-06-08T04:05:21.475 INFO:teuthology.orchestra.run.smithi016.stdout:030.out 2023-06-08T04:05:21.476 INFO:teuthology.orchestra.run.smithi016.stdout:031 2023-06-08T04:05:21.476 INFO:teuthology.orchestra.run.smithi016.stdout:031.out 2023-06-08T04:05:21.476 INFO:teuthology.orchestra.run.smithi016.stdout:032 2023-06-08T04:05:21.476 INFO:teuthology.orchestra.run.smithi016.stdout:032.out 2023-06-08T04:05:21.476 INFO:teuthology.orchestra.run.smithi016.stdout:033 2023-06-08T04:05:21.476 INFO:teuthology.orchestra.run.smithi016.stdout:033.out 2023-06-08T04:05:21.476 INFO:teuthology.orchestra.run.smithi016.stdout:034 2023-06-08T04:05:21.477 INFO:teuthology.orchestra.run.smithi016.stdout:034.out 2023-06-08T04:05:21.477 INFO:teuthology.orchestra.run.smithi016.stdout:035 2023-06-08T04:05:21.477 INFO:teuthology.orchestra.run.smithi016.stdout:035.cfg 2023-06-08T04:05:21.477 INFO:teuthology.orchestra.run.smithi016.stdout:035.out.default 2023-06-08T04:05:21.477 INFO:teuthology.orchestra.run.smithi016.stdout:035.out.nfs 2023-06-08T04:05:21.477 INFO:teuthology.orchestra.run.smithi016.stdout:036 2023-06-08T04:05:21.477 INFO:teuthology.orchestra.run.smithi016.stdout:036.out 2023-06-08T04:05:21.477 INFO:teuthology.orchestra.run.smithi016.stdout:037 2023-06-08T04:05:21.478 INFO:teuthology.orchestra.run.smithi016.stdout:037.out 2023-06-08T04:05:21.478 INFO:teuthology.orchestra.run.smithi016.stdout:038 2023-06-08T04:05:21.478 INFO:teuthology.orchestra.run.smithi016.stdout:038.out 2023-06-08T04:05:21.478 INFO:teuthology.orchestra.run.smithi016.stdout:039 2023-06-08T04:05:21.478 INFO:teuthology.orchestra.run.smithi016.stdout:039.out 2023-06-08T04:05:21.478 INFO:teuthology.orchestra.run.smithi016.stdout:040 2023-06-08T04:05:21.478 INFO:teuthology.orchestra.run.smithi016.stdout:040.out 2023-06-08T04:05:21.478 INFO:teuthology.orchestra.run.smithi016.stdout:041 2023-06-08T04:05:21.479 INFO:teuthology.orchestra.run.smithi016.stdout:041.out 2023-06-08T04:05:21.479 INFO:teuthology.orchestra.run.smithi016.stdout:042 2023-06-08T04:05:21.479 INFO:teuthology.orchestra.run.smithi016.stdout:042.out 2023-06-08T04:05:21.479 INFO:teuthology.orchestra.run.smithi016.stdout:043 2023-06-08T04:05:21.479 INFO:teuthology.orchestra.run.smithi016.stdout:043.out 2023-06-08T04:05:21.479 INFO:teuthology.orchestra.run.smithi016.stdout:044 2023-06-08T04:05:21.479 INFO:teuthology.orchestra.run.smithi016.stdout:044.out 2023-06-08T04:05:21.480 INFO:teuthology.orchestra.run.smithi016.stdout:045 2023-06-08T04:05:21.480 INFO:teuthology.orchestra.run.smithi016.stdout:045.out 2023-06-08T04:05:21.480 INFO:teuthology.orchestra.run.smithi016.stdout:046 2023-06-08T04:05:21.480 INFO:teuthology.orchestra.run.smithi016.stdout:046.out 2023-06-08T04:05:21.480 INFO:teuthology.orchestra.run.smithi016.stdout:047 2023-06-08T04:05:21.480 INFO:teuthology.orchestra.run.smithi016.stdout:047.out 2023-06-08T04:05:21.480 INFO:teuthology.orchestra.run.smithi016.stdout:048 2023-06-08T04:05:21.480 INFO:teuthology.orchestra.run.smithi016.stdout:048.out 2023-06-08T04:05:21.481 INFO:teuthology.orchestra.run.smithi016.stdout:049 2023-06-08T04:05:21.481 INFO:teuthology.orchestra.run.smithi016.stdout:049.out 2023-06-08T04:05:21.481 INFO:teuthology.orchestra.run.smithi016.stdout:050 2023-06-08T04:05:21.481 INFO:teuthology.orchestra.run.smithi016.stdout:050.cfg 2023-06-08T04:05:21.481 INFO:teuthology.orchestra.run.smithi016.stdout:050.out.default 2023-06-08T04:05:21.481 INFO:teuthology.orchestra.run.smithi016.stdout:050.out.nojournal 2023-06-08T04:05:21.481 INFO:teuthology.orchestra.run.smithi016.stdout:050.out.xfsquota 2023-06-08T04:05:21.481 INFO:teuthology.orchestra.run.smithi016.stdout:051 2023-06-08T04:05:21.482 INFO:teuthology.orchestra.run.smithi016.stdout:051.out 2023-06-08T04:05:21.482 INFO:teuthology.orchestra.run.smithi016.stdout:052 2023-06-08T04:05:21.482 INFO:teuthology.orchestra.run.smithi016.stdout:052.out 2023-06-08T04:05:21.482 INFO:teuthology.orchestra.run.smithi016.stdout:053 2023-06-08T04:05:21.482 INFO:teuthology.orchestra.run.smithi016.stdout:053.out 2023-06-08T04:05:21.482 INFO:teuthology.orchestra.run.smithi016.stdout:054 2023-06-08T04:05:21.482 INFO:teuthology.orchestra.run.smithi016.stdout:054.out 2023-06-08T04:05:21.482 INFO:teuthology.orchestra.run.smithi016.stdout:055 2023-06-08T04:05:21.483 INFO:teuthology.orchestra.run.smithi016.stdout:055.out 2023-06-08T04:05:21.483 INFO:teuthology.orchestra.run.smithi016.stdout:056 2023-06-08T04:05:21.483 INFO:teuthology.orchestra.run.smithi016.stdout:056.out 2023-06-08T04:05:21.483 INFO:teuthology.orchestra.run.smithi016.stdout:057 2023-06-08T04:05:21.483 INFO:teuthology.orchestra.run.smithi016.stdout:057.out 2023-06-08T04:05:21.483 INFO:teuthology.orchestra.run.smithi016.stdout:058 2023-06-08T04:05:21.483 INFO:teuthology.orchestra.run.smithi016.stdout:058.out 2023-06-08T04:05:21.483 INFO:teuthology.orchestra.run.smithi016.stdout:059 2023-06-08T04:05:21.484 INFO:teuthology.orchestra.run.smithi016.stdout:059.out 2023-06-08T04:05:21.484 INFO:teuthology.orchestra.run.smithi016.stdout:060 2023-06-08T04:05:21.484 INFO:teuthology.orchestra.run.smithi016.stdout:060.out 2023-06-08T04:05:21.484 INFO:teuthology.orchestra.run.smithi016.stdout:061 2023-06-08T04:05:21.484 INFO:teuthology.orchestra.run.smithi016.stdout:061.out 2023-06-08T04:05:21.484 INFO:teuthology.orchestra.run.smithi016.stdout:062 2023-06-08T04:05:21.484 INFO:teuthology.orchestra.run.smithi016.stdout:062.out 2023-06-08T04:05:21.485 INFO:teuthology.orchestra.run.smithi016.stdout:063 2023-06-08T04:05:21.485 INFO:teuthology.orchestra.run.smithi016.stdout:063.out 2023-06-08T04:05:21.485 INFO:teuthology.orchestra.run.smithi016.stdout:064 2023-06-08T04:05:21.485 INFO:teuthology.orchestra.run.smithi016.stdout:064.out 2023-06-08T04:05:21.485 INFO:teuthology.orchestra.run.smithi016.stdout:065 2023-06-08T04:05:21.485 INFO:teuthology.orchestra.run.smithi016.stdout:065.out 2023-06-08T04:05:21.485 INFO:teuthology.orchestra.run.smithi016.stdout:066 2023-06-08T04:05:21.485 INFO:teuthology.orchestra.run.smithi016.stdout:066.out 2023-06-08T04:05:21.486 INFO:teuthology.orchestra.run.smithi016.stdout:067 2023-06-08T04:05:21.486 INFO:teuthology.orchestra.run.smithi016.stdout:067.out 2023-06-08T04:05:21.486 INFO:teuthology.orchestra.run.smithi016.stdout:068 2023-06-08T04:05:21.486 INFO:teuthology.orchestra.run.smithi016.stdout:068.out 2023-06-08T04:05:21.486 INFO:teuthology.orchestra.run.smithi016.stdout:069 2023-06-08T04:05:21.486 INFO:teuthology.orchestra.run.smithi016.stdout:069.out 2023-06-08T04:05:21.486 INFO:teuthology.orchestra.run.smithi016.stdout:070 2023-06-08T04:05:21.486 INFO:teuthology.orchestra.run.smithi016.stdout:070.out 2023-06-08T04:05:21.487 INFO:teuthology.orchestra.run.smithi016.stdout:071 2023-06-08T04:05:21.487 INFO:teuthology.orchestra.run.smithi016.stdout:071.out 2023-06-08T04:05:21.487 INFO:teuthology.orchestra.run.smithi016.stdout:072 2023-06-08T04:05:21.487 INFO:teuthology.orchestra.run.smithi016.stdout:072.out 2023-06-08T04:05:21.487 INFO:teuthology.orchestra.run.smithi016.stdout:073 2023-06-08T04:05:21.487 INFO:teuthology.orchestra.run.smithi016.stdout:073.out 2023-06-08T04:05:21.487 INFO:teuthology.orchestra.run.smithi016.stdout:074 2023-06-08T04:05:21.487 INFO:teuthology.orchestra.run.smithi016.stdout:074.out 2023-06-08T04:05:21.488 INFO:teuthology.orchestra.run.smithi016.stdout:075 2023-06-08T04:05:21.488 INFO:teuthology.orchestra.run.smithi016.stdout:075.out 2023-06-08T04:05:21.488 INFO:teuthology.orchestra.run.smithi016.stdout:076 2023-06-08T04:05:21.488 INFO:teuthology.orchestra.run.smithi016.stdout:076.out 2023-06-08T04:05:21.488 INFO:teuthology.orchestra.run.smithi016.stdout:077 2023-06-08T04:05:21.488 INFO:teuthology.orchestra.run.smithi016.stdout:077.out 2023-06-08T04:05:21.488 INFO:teuthology.orchestra.run.smithi016.stdout:078 2023-06-08T04:05:21.488 INFO:teuthology.orchestra.run.smithi016.stdout:078.out 2023-06-08T04:05:21.489 INFO:teuthology.orchestra.run.smithi016.stdout:079 2023-06-08T04:05:21.489 INFO:teuthology.orchestra.run.smithi016.stdout:079.out 2023-06-08T04:05:21.489 INFO:teuthology.orchestra.run.smithi016.stdout:080 2023-06-08T04:05:21.489 INFO:teuthology.orchestra.run.smithi016.stdout:080.out 2023-06-08T04:05:21.489 INFO:teuthology.orchestra.run.smithi016.stdout:081 2023-06-08T04:05:21.489 INFO:teuthology.orchestra.run.smithi016.stdout:081.out 2023-06-08T04:05:21.489 INFO:teuthology.orchestra.run.smithi016.stdout:082 2023-06-08T04:05:21.490 INFO:teuthology.orchestra.run.smithi016.stdout:082.out 2023-06-08T04:05:21.490 INFO:teuthology.orchestra.run.smithi016.stdout:083 2023-06-08T04:05:21.490 INFO:teuthology.orchestra.run.smithi016.stdout:083.out 2023-06-08T04:05:21.490 INFO:teuthology.orchestra.run.smithi016.stdout:084 2023-06-08T04:05:21.490 INFO:teuthology.orchestra.run.smithi016.stdout:084.out 2023-06-08T04:05:21.490 INFO:teuthology.orchestra.run.smithi016.stdout:085 2023-06-08T04:05:21.490 INFO:teuthology.orchestra.run.smithi016.stdout:085.out 2023-06-08T04:05:21.490 INFO:teuthology.orchestra.run.smithi016.stdout:086 2023-06-08T04:05:21.491 INFO:teuthology.orchestra.run.smithi016.stdout:086.out 2023-06-08T04:05:21.491 INFO:teuthology.orchestra.run.smithi016.stdout:087 2023-06-08T04:05:21.491 INFO:teuthology.orchestra.run.smithi016.stdout:087.out 2023-06-08T04:05:21.491 INFO:teuthology.orchestra.run.smithi016.stdout:088 2023-06-08T04:05:21.491 INFO:teuthology.orchestra.run.smithi016.stdout:088.out 2023-06-08T04:05:21.491 INFO:teuthology.orchestra.run.smithi016.stdout:089 2023-06-08T04:05:21.491 INFO:teuthology.orchestra.run.smithi016.stdout:089.out 2023-06-08T04:05:21.491 INFO:teuthology.orchestra.run.smithi016.stdout:090 2023-06-08T04:05:21.492 INFO:teuthology.orchestra.run.smithi016.stdout:090.out 2023-06-08T04:05:21.492 INFO:teuthology.orchestra.run.smithi016.stdout:091 2023-06-08T04:05:21.492 INFO:teuthology.orchestra.run.smithi016.stdout:091.out 2023-06-08T04:05:21.492 INFO:teuthology.orchestra.run.smithi016.stdout:092 2023-06-08T04:05:21.492 INFO:teuthology.orchestra.run.smithi016.stdout:092.out 2023-06-08T04:05:21.492 INFO:teuthology.orchestra.run.smithi016.stdout:093 2023-06-08T04:05:21.492 INFO:teuthology.orchestra.run.smithi016.stdout:093.out 2023-06-08T04:05:21.492 INFO:teuthology.orchestra.run.smithi016.stdout:094 2023-06-08T04:05:21.493 INFO:teuthology.orchestra.run.smithi016.stdout:094.out 2023-06-08T04:05:21.493 INFO:teuthology.orchestra.run.smithi016.stdout:095 2023-06-08T04:05:21.493 INFO:teuthology.orchestra.run.smithi016.stdout:095.out 2023-06-08T04:05:21.493 INFO:teuthology.orchestra.run.smithi016.stdout:096 2023-06-08T04:05:21.493 INFO:teuthology.orchestra.run.smithi016.stdout:096.out 2023-06-08T04:05:21.493 INFO:teuthology.orchestra.run.smithi016.stdout:097 2023-06-08T04:05:21.493 INFO:teuthology.orchestra.run.smithi016.stdout:097.out 2023-06-08T04:05:21.493 INFO:teuthology.orchestra.run.smithi016.stdout:098 2023-06-08T04:05:21.494 INFO:teuthology.orchestra.run.smithi016.stdout:098.out 2023-06-08T04:05:21.494 INFO:teuthology.orchestra.run.smithi016.stdout:099 2023-06-08T04:05:21.494 INFO:teuthology.orchestra.run.smithi016.stdout:099.out 2023-06-08T04:05:21.494 INFO:teuthology.orchestra.run.smithi016.stdout:100 2023-06-08T04:05:21.494 INFO:teuthology.orchestra.run.smithi016.stdout:100.out 2023-06-08T04:05:21.494 INFO:teuthology.orchestra.run.smithi016.stdout:101 2023-06-08T04:05:21.494 INFO:teuthology.orchestra.run.smithi016.stdout:101.out 2023-06-08T04:05:21.494 INFO:teuthology.orchestra.run.smithi016.stdout:102 2023-06-08T04:05:21.495 INFO:teuthology.orchestra.run.smithi016.stdout:102.out 2023-06-08T04:05:21.495 INFO:teuthology.orchestra.run.smithi016.stdout:103 2023-06-08T04:05:21.495 INFO:teuthology.orchestra.run.smithi016.stdout:103.out 2023-06-08T04:05:21.495 INFO:teuthology.orchestra.run.smithi016.stdout:104 2023-06-08T04:05:21.495 INFO:teuthology.orchestra.run.smithi016.stdout:104.out 2023-06-08T04:05:21.495 INFO:teuthology.orchestra.run.smithi016.stdout:105 2023-06-08T04:05:21.495 INFO:teuthology.orchestra.run.smithi016.stdout:105.out 2023-06-08T04:05:21.495 INFO:teuthology.orchestra.run.smithi016.stdout:106 2023-06-08T04:05:21.496 INFO:teuthology.orchestra.run.smithi016.stdout:106.out 2023-06-08T04:05:21.496 INFO:teuthology.orchestra.run.smithi016.stdout:107 2023-06-08T04:05:21.496 INFO:teuthology.orchestra.run.smithi016.stdout:107.out 2023-06-08T04:05:21.496 INFO:teuthology.orchestra.run.smithi016.stdout:108 2023-06-08T04:05:21.496 INFO:teuthology.orchestra.run.smithi016.stdout:108.out 2023-06-08T04:05:21.496 INFO:teuthology.orchestra.run.smithi016.stdout:109 2023-06-08T04:05:21.496 INFO:teuthology.orchestra.run.smithi016.stdout:109.out 2023-06-08T04:05:21.496 INFO:teuthology.orchestra.run.smithi016.stdout:110 2023-06-08T04:05:21.497 INFO:teuthology.orchestra.run.smithi016.stdout:110.out 2023-06-08T04:05:21.497 INFO:teuthology.orchestra.run.smithi016.stdout:111 2023-06-08T04:05:21.497 INFO:teuthology.orchestra.run.smithi016.stdout:111.out 2023-06-08T04:05:21.497 INFO:teuthology.orchestra.run.smithi016.stdout:112 2023-06-08T04:05:21.497 INFO:teuthology.orchestra.run.smithi016.stdout:112.out 2023-06-08T04:05:21.497 INFO:teuthology.orchestra.run.smithi016.stdout:113 2023-06-08T04:05:21.497 INFO:teuthology.orchestra.run.smithi016.stdout:113.out 2023-06-08T04:05:21.497 INFO:teuthology.orchestra.run.smithi016.stdout:114 2023-06-08T04:05:21.498 INFO:teuthology.orchestra.run.smithi016.stdout:114.out 2023-06-08T04:05:21.498 INFO:teuthology.orchestra.run.smithi016.stdout:115 2023-06-08T04:05:21.498 INFO:teuthology.orchestra.run.smithi016.stdout:115.out 2023-06-08T04:05:21.498 INFO:teuthology.orchestra.run.smithi016.stdout:116 2023-06-08T04:05:21.498 INFO:teuthology.orchestra.run.smithi016.stdout:116.out 2023-06-08T04:05:21.498 INFO:teuthology.orchestra.run.smithi016.stdout:117 2023-06-08T04:05:21.498 INFO:teuthology.orchestra.run.smithi016.stdout:117.out 2023-06-08T04:05:21.498 INFO:teuthology.orchestra.run.smithi016.stdout:118 2023-06-08T04:05:21.499 INFO:teuthology.orchestra.run.smithi016.stdout:118.out 2023-06-08T04:05:21.499 INFO:teuthology.orchestra.run.smithi016.stdout:119 2023-06-08T04:05:21.499 INFO:teuthology.orchestra.run.smithi016.stdout:119.out 2023-06-08T04:05:21.499 INFO:teuthology.orchestra.run.smithi016.stdout:120 2023-06-08T04:05:21.499 INFO:teuthology.orchestra.run.smithi016.stdout:120.out 2023-06-08T04:05:21.499 INFO:teuthology.orchestra.run.smithi016.stdout:121 2023-06-08T04:05:21.499 INFO:teuthology.orchestra.run.smithi016.stdout:121.out 2023-06-08T04:05:21.500 INFO:teuthology.orchestra.run.smithi016.stdout:122 2023-06-08T04:05:21.500 INFO:teuthology.orchestra.run.smithi016.stdout:122.out 2023-06-08T04:05:21.500 INFO:teuthology.orchestra.run.smithi016.stdout:123 2023-06-08T04:05:21.500 INFO:teuthology.orchestra.run.smithi016.stdout:123.out 2023-06-08T04:05:21.500 INFO:teuthology.orchestra.run.smithi016.stdout:124 2023-06-08T04:05:21.500 INFO:teuthology.orchestra.run.smithi016.stdout:124.out 2023-06-08T04:05:21.500 INFO:teuthology.orchestra.run.smithi016.stdout:125 2023-06-08T04:05:21.500 INFO:teuthology.orchestra.run.smithi016.stdout:125.out 2023-06-08T04:05:21.501 INFO:teuthology.orchestra.run.smithi016.stdout:126 2023-06-08T04:05:21.501 INFO:teuthology.orchestra.run.smithi016.stdout:126.out 2023-06-08T04:05:21.501 INFO:teuthology.orchestra.run.smithi016.stdout:127 2023-06-08T04:05:21.501 INFO:teuthology.orchestra.run.smithi016.stdout:127.out 2023-06-08T04:05:21.501 INFO:teuthology.orchestra.run.smithi016.stdout:128 2023-06-08T04:05:21.501 INFO:teuthology.orchestra.run.smithi016.stdout:128.out 2023-06-08T04:05:21.501 INFO:teuthology.orchestra.run.smithi016.stdout:129 2023-06-08T04:05:21.501 INFO:teuthology.orchestra.run.smithi016.stdout:129.out 2023-06-08T04:05:21.502 INFO:teuthology.orchestra.run.smithi016.stdout:130 2023-06-08T04:05:21.502 INFO:teuthology.orchestra.run.smithi016.stdout:130.out 2023-06-08T04:05:21.502 INFO:teuthology.orchestra.run.smithi016.stdout:131 2023-06-08T04:05:21.502 INFO:teuthology.orchestra.run.smithi016.stdout:131.out 2023-06-08T04:05:21.502 INFO:teuthology.orchestra.run.smithi016.stdout:132 2023-06-08T04:05:21.502 INFO:teuthology.orchestra.run.smithi016.stdout:132.out 2023-06-08T04:05:21.502 INFO:teuthology.orchestra.run.smithi016.stdout:133 2023-06-08T04:05:21.502 INFO:teuthology.orchestra.run.smithi016.stdout:133.out 2023-06-08T04:05:21.503 INFO:teuthology.orchestra.run.smithi016.stdout:134 2023-06-08T04:05:21.503 INFO:teuthology.orchestra.run.smithi016.stdout:134.out 2023-06-08T04:05:21.503 INFO:teuthology.orchestra.run.smithi016.stdout:135 2023-06-08T04:05:21.503 INFO:teuthology.orchestra.run.smithi016.stdout:135.out 2023-06-08T04:05:21.503 INFO:teuthology.orchestra.run.smithi016.stdout:136 2023-06-08T04:05:21.503 INFO:teuthology.orchestra.run.smithi016.stdout:136.out 2023-06-08T04:05:21.503 INFO:teuthology.orchestra.run.smithi016.stdout:137 2023-06-08T04:05:21.503 INFO:teuthology.orchestra.run.smithi016.stdout:137.out 2023-06-08T04:05:21.504 INFO:teuthology.orchestra.run.smithi016.stdout:138 2023-06-08T04:05:21.504 INFO:teuthology.orchestra.run.smithi016.stdout:138.out 2023-06-08T04:05:21.504 INFO:teuthology.orchestra.run.smithi016.stdout:139 2023-06-08T04:05:21.504 INFO:teuthology.orchestra.run.smithi016.stdout:139.out 2023-06-08T04:05:21.504 INFO:teuthology.orchestra.run.smithi016.stdout:140 2023-06-08T04:05:21.504 INFO:teuthology.orchestra.run.smithi016.stdout:140.out 2023-06-08T04:05:21.504 INFO:teuthology.orchestra.run.smithi016.stdout:141 2023-06-08T04:05:21.505 INFO:teuthology.orchestra.run.smithi016.stdout:141.out 2023-06-08T04:05:21.505 INFO:teuthology.orchestra.run.smithi016.stdout:142 2023-06-08T04:05:21.505 INFO:teuthology.orchestra.run.smithi016.stdout:142.out 2023-06-08T04:05:21.505 INFO:teuthology.orchestra.run.smithi016.stdout:143 2023-06-08T04:05:21.505 INFO:teuthology.orchestra.run.smithi016.stdout:143.out 2023-06-08T04:05:21.505 INFO:teuthology.orchestra.run.smithi016.stdout:144 2023-06-08T04:05:21.505 INFO:teuthology.orchestra.run.smithi016.stdout:144.out 2023-06-08T04:05:21.505 INFO:teuthology.orchestra.run.smithi016.stdout:145 2023-06-08T04:05:21.506 INFO:teuthology.orchestra.run.smithi016.stdout:145.out 2023-06-08T04:05:21.506 INFO:teuthology.orchestra.run.smithi016.stdout:146 2023-06-08T04:05:21.506 INFO:teuthology.orchestra.run.smithi016.stdout:146.out 2023-06-08T04:05:21.506 INFO:teuthology.orchestra.run.smithi016.stdout:147 2023-06-08T04:05:21.506 INFO:teuthology.orchestra.run.smithi016.stdout:147.out 2023-06-08T04:05:21.506 INFO:teuthology.orchestra.run.smithi016.stdout:148 2023-06-08T04:05:21.506 INFO:teuthology.orchestra.run.smithi016.stdout:148.out 2023-06-08T04:05:21.506 INFO:teuthology.orchestra.run.smithi016.stdout:149 2023-06-08T04:05:21.507 INFO:teuthology.orchestra.run.smithi016.stdout:149.out 2023-06-08T04:05:21.507 INFO:teuthology.orchestra.run.smithi016.stdout:150 2023-06-08T04:05:21.507 INFO:teuthology.orchestra.run.smithi016.stdout:150.out 2023-06-08T04:05:21.507 INFO:teuthology.orchestra.run.smithi016.stdout:151 2023-06-08T04:05:21.507 INFO:teuthology.orchestra.run.smithi016.stdout:151.out 2023-06-08T04:05:21.507 INFO:teuthology.orchestra.run.smithi016.stdout:152 2023-06-08T04:05:21.507 INFO:teuthology.orchestra.run.smithi016.stdout:152.out 2023-06-08T04:05:21.507 INFO:teuthology.orchestra.run.smithi016.stdout:153 2023-06-08T04:05:21.508 INFO:teuthology.orchestra.run.smithi016.stdout:153.out 2023-06-08T04:05:21.508 INFO:teuthology.orchestra.run.smithi016.stdout:154 2023-06-08T04:05:21.508 INFO:teuthology.orchestra.run.smithi016.stdout:154.out 2023-06-08T04:05:21.508 INFO:teuthology.orchestra.run.smithi016.stdout:155 2023-06-08T04:05:21.508 INFO:teuthology.orchestra.run.smithi016.stdout:155.out 2023-06-08T04:05:21.508 INFO:teuthology.orchestra.run.smithi016.stdout:156 2023-06-08T04:05:21.508 INFO:teuthology.orchestra.run.smithi016.stdout:156.out 2023-06-08T04:05:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:157 2023-06-08T04:05:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:157.out 2023-06-08T04:05:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:158 2023-06-08T04:05:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:158.out 2023-06-08T04:05:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:159 2023-06-08T04:05:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:159.out 2023-06-08T04:05:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:160 2023-06-08T04:05:21.509 INFO:teuthology.orchestra.run.smithi016.stdout:160.out 2023-06-08T04:05:21.510 INFO:teuthology.orchestra.run.smithi016.stdout:161 2023-06-08T04:05:21.510 INFO:teuthology.orchestra.run.smithi016.stdout:161.out 2023-06-08T04:05:21.510 INFO:teuthology.orchestra.run.smithi016.stdout:162 2023-06-08T04:05:21.510 INFO:teuthology.orchestra.run.smithi016.stdout:162.out 2023-06-08T04:05:21.510 INFO:teuthology.orchestra.run.smithi016.stdout:163 2023-06-08T04:05:21.510 INFO:teuthology.orchestra.run.smithi016.stdout:163.out 2023-06-08T04:05:21.510 INFO:teuthology.orchestra.run.smithi016.stdout:164 2023-06-08T04:05:21.510 INFO:teuthology.orchestra.run.smithi016.stdout:164.out 2023-06-08T04:05:21.511 INFO:teuthology.orchestra.run.smithi016.stdout:165 2023-06-08T04:05:21.511 INFO:teuthology.orchestra.run.smithi016.stdout:165.out 2023-06-08T04:05:21.511 INFO:teuthology.orchestra.run.smithi016.stdout:166 2023-06-08T04:05:21.511 INFO:teuthology.orchestra.run.smithi016.stdout:166.out 2023-06-08T04:05:21.511 INFO:teuthology.orchestra.run.smithi016.stdout:167 2023-06-08T04:05:21.511 INFO:teuthology.orchestra.run.smithi016.stdout:167.out 2023-06-08T04:05:21.511 INFO:teuthology.orchestra.run.smithi016.stdout:168 2023-06-08T04:05:21.511 INFO:teuthology.orchestra.run.smithi016.stdout:168.out 2023-06-08T04:05:21.512 INFO:teuthology.orchestra.run.smithi016.stdout:169 2023-06-08T04:05:21.512 INFO:teuthology.orchestra.run.smithi016.stdout:169.out 2023-06-08T04:05:21.512 INFO:teuthology.orchestra.run.smithi016.stdout:170 2023-06-08T04:05:21.512 INFO:teuthology.orchestra.run.smithi016.stdout:170.out 2023-06-08T04:05:21.512 INFO:teuthology.orchestra.run.smithi016.stdout:171 2023-06-08T04:05:21.512 INFO:teuthology.orchestra.run.smithi016.stdout:171.out 2023-06-08T04:05:21.512 INFO:teuthology.orchestra.run.smithi016.stdout:172 2023-06-08T04:05:21.513 INFO:teuthology.orchestra.run.smithi016.stdout:172.out 2023-06-08T04:05:21.513 INFO:teuthology.orchestra.run.smithi016.stdout:173 2023-06-08T04:05:21.513 INFO:teuthology.orchestra.run.smithi016.stdout:173.out 2023-06-08T04:05:21.513 INFO:teuthology.orchestra.run.smithi016.stdout:174 2023-06-08T04:05:21.513 INFO:teuthology.orchestra.run.smithi016.stdout:174.out 2023-06-08T04:05:21.513 INFO:teuthology.orchestra.run.smithi016.stdout:175 2023-06-08T04:05:21.513 INFO:teuthology.orchestra.run.smithi016.stdout:175.out 2023-06-08T04:05:21.514 INFO:teuthology.orchestra.run.smithi016.stdout:176 2023-06-08T04:05:21.514 INFO:teuthology.orchestra.run.smithi016.stdout:176.out 2023-06-08T04:05:21.514 INFO:teuthology.orchestra.run.smithi016.stdout:177 2023-06-08T04:05:21.514 INFO:teuthology.orchestra.run.smithi016.stdout:177.out 2023-06-08T04:05:21.514 INFO:teuthology.orchestra.run.smithi016.stdout:178 2023-06-08T04:05:21.514 INFO:teuthology.orchestra.run.smithi016.stdout:178.out 2023-06-08T04:05:21.514 INFO:teuthology.orchestra.run.smithi016.stdout:179 2023-06-08T04:05:21.514 INFO:teuthology.orchestra.run.smithi016.stdout:179.out 2023-06-08T04:05:21.515 INFO:teuthology.orchestra.run.smithi016.stdout:180 2023-06-08T04:05:21.515 INFO:teuthology.orchestra.run.smithi016.stdout:180.out 2023-06-08T04:05:21.515 INFO:teuthology.orchestra.run.smithi016.stdout:181 2023-06-08T04:05:21.515 INFO:teuthology.orchestra.run.smithi016.stdout:181.out 2023-06-08T04:05:21.515 INFO:teuthology.orchestra.run.smithi016.stdout:182 2023-06-08T04:05:21.515 INFO:teuthology.orchestra.run.smithi016.stdout:182.out 2023-06-08T04:05:21.515 INFO:teuthology.orchestra.run.smithi016.stdout:183 2023-06-08T04:05:21.515 INFO:teuthology.orchestra.run.smithi016.stdout:183.out 2023-06-08T04:05:21.516 INFO:teuthology.orchestra.run.smithi016.stdout:184 2023-06-08T04:05:21.516 INFO:teuthology.orchestra.run.smithi016.stdout:184.out 2023-06-08T04:05:21.516 INFO:teuthology.orchestra.run.smithi016.stdout:185 2023-06-08T04:05:21.516 INFO:teuthology.orchestra.run.smithi016.stdout:185.out 2023-06-08T04:05:21.516 INFO:teuthology.orchestra.run.smithi016.stdout:186 2023-06-08T04:05:21.516 INFO:teuthology.orchestra.run.smithi016.stdout:186.out 2023-06-08T04:05:21.516 INFO:teuthology.orchestra.run.smithi016.stdout:187 2023-06-08T04:05:21.517 INFO:teuthology.orchestra.run.smithi016.stdout:187.out 2023-06-08T04:05:21.517 INFO:teuthology.orchestra.run.smithi016.stdout:188 2023-06-08T04:05:21.517 INFO:teuthology.orchestra.run.smithi016.stdout:188.out 2023-06-08T04:05:21.517 INFO:teuthology.orchestra.run.smithi016.stdout:189 2023-06-08T04:05:21.517 INFO:teuthology.orchestra.run.smithi016.stdout:189.out 2023-06-08T04:05:21.517 INFO:teuthology.orchestra.run.smithi016.stdout:190 2023-06-08T04:05:21.517 INFO:teuthology.orchestra.run.smithi016.stdout:190.out 2023-06-08T04:05:21.517 INFO:teuthology.orchestra.run.smithi016.stdout:191 2023-06-08T04:05:21.518 INFO:teuthology.orchestra.run.smithi016.stdout:191.out 2023-06-08T04:05:21.518 INFO:teuthology.orchestra.run.smithi016.stdout:192 2023-06-08T04:05:21.518 INFO:teuthology.orchestra.run.smithi016.stdout:192.out 2023-06-08T04:05:21.518 INFO:teuthology.orchestra.run.smithi016.stdout:193 2023-06-08T04:05:21.518 INFO:teuthology.orchestra.run.smithi016.stdout:193.out 2023-06-08T04:05:21.518 INFO:teuthology.orchestra.run.smithi016.stdout:194 2023-06-08T04:05:21.518 INFO:teuthology.orchestra.run.smithi016.stdout:194.out 2023-06-08T04:05:21.518 INFO:teuthology.orchestra.run.smithi016.stdout:195 2023-06-08T04:05:21.519 INFO:teuthology.orchestra.run.smithi016.stdout:195.out 2023-06-08T04:05:21.519 INFO:teuthology.orchestra.run.smithi016.stdout:196 2023-06-08T04:05:21.519 INFO:teuthology.orchestra.run.smithi016.stdout:196.out 2023-06-08T04:05:21.519 INFO:teuthology.orchestra.run.smithi016.stdout:197 2023-06-08T04:05:21.519 INFO:teuthology.orchestra.run.smithi016.stdout:197.out 2023-06-08T04:05:21.519 INFO:teuthology.orchestra.run.smithi016.stdout:198 2023-06-08T04:05:21.519 INFO:teuthology.orchestra.run.smithi016.stdout:198.out 2023-06-08T04:05:21.520 INFO:teuthology.orchestra.run.smithi016.stdout:199 2023-06-08T04:05:21.520 INFO:teuthology.orchestra.run.smithi016.stdout:199.out 2023-06-08T04:05:21.520 INFO:teuthology.orchestra.run.smithi016.stdout:200 2023-06-08T04:05:21.520 INFO:teuthology.orchestra.run.smithi016.stdout:200.out 2023-06-08T04:05:21.520 INFO:teuthology.orchestra.run.smithi016.stdout:201 2023-06-08T04:05:21.520 INFO:teuthology.orchestra.run.smithi016.stdout:201.out 2023-06-08T04:05:21.520 INFO:teuthology.orchestra.run.smithi016.stdout:202 2023-06-08T04:05:21.520 INFO:teuthology.orchestra.run.smithi016.stdout:202.out 2023-06-08T04:05:21.521 INFO:teuthology.orchestra.run.smithi016.stdout:203 2023-06-08T04:05:21.521 INFO:teuthology.orchestra.run.smithi016.stdout:203.out 2023-06-08T04:05:21.521 INFO:teuthology.orchestra.run.smithi016.stdout:204 2023-06-08T04:05:21.521 INFO:teuthology.orchestra.run.smithi016.stdout:204.out 2023-06-08T04:05:21.521 INFO:teuthology.orchestra.run.smithi016.stdout:205 2023-06-08T04:05:21.521 INFO:teuthology.orchestra.run.smithi016.stdout:205.out 2023-06-08T04:05:21.521 INFO:teuthology.orchestra.run.smithi016.stdout:206 2023-06-08T04:05:21.521 INFO:teuthology.orchestra.run.smithi016.stdout:206.out 2023-06-08T04:05:21.522 INFO:teuthology.orchestra.run.smithi016.stdout:207 2023-06-08T04:05:21.522 INFO:teuthology.orchestra.run.smithi016.stdout:207.out 2023-06-08T04:05:21.522 INFO:teuthology.orchestra.run.smithi016.stdout:208 2023-06-08T04:05:21.522 INFO:teuthology.orchestra.run.smithi016.stdout:208.out 2023-06-08T04:05:21.522 INFO:teuthology.orchestra.run.smithi016.stdout:209 2023-06-08T04:05:21.522 INFO:teuthology.orchestra.run.smithi016.stdout:209.out 2023-06-08T04:05:21.522 INFO:teuthology.orchestra.run.smithi016.stdout:210 2023-06-08T04:05:21.522 INFO:teuthology.orchestra.run.smithi016.stdout:210.out 2023-06-08T04:05:21.523 INFO:teuthology.orchestra.run.smithi016.stdout:211 2023-06-08T04:05:21.523 INFO:teuthology.orchestra.run.smithi016.stdout:211.out 2023-06-08T04:05:21.523 INFO:teuthology.orchestra.run.smithi016.stdout:212 2023-06-08T04:05:21.523 INFO:teuthology.orchestra.run.smithi016.stdout:212.out 2023-06-08T04:05:21.523 INFO:teuthology.orchestra.run.smithi016.stdout:213 2023-06-08T04:05:21.523 INFO:teuthology.orchestra.run.smithi016.stdout:213.out 2023-06-08T04:05:21.523 INFO:teuthology.orchestra.run.smithi016.stdout:214 2023-06-08T04:05:21.523 INFO:teuthology.orchestra.run.smithi016.stdout:214.out 2023-06-08T04:05:21.524 INFO:teuthology.orchestra.run.smithi016.stdout:215 2023-06-08T04:05:21.524 INFO:teuthology.orchestra.run.smithi016.stdout:215.out 2023-06-08T04:05:21.524 INFO:teuthology.orchestra.run.smithi016.stdout:216 2023-06-08T04:05:21.524 INFO:teuthology.orchestra.run.smithi016.stdout:216.out 2023-06-08T04:05:21.524 INFO:teuthology.orchestra.run.smithi016.stdout:217 2023-06-08T04:05:21.524 INFO:teuthology.orchestra.run.smithi016.stdout:217.out 2023-06-08T04:05:21.524 INFO:teuthology.orchestra.run.smithi016.stdout:218 2023-06-08T04:05:21.525 INFO:teuthology.orchestra.run.smithi016.stdout:218.out 2023-06-08T04:05:21.525 INFO:teuthology.orchestra.run.smithi016.stdout:219 2023-06-08T04:05:21.525 INFO:teuthology.orchestra.run.smithi016.stdout:219.out 2023-06-08T04:05:21.525 INFO:teuthology.orchestra.run.smithi016.stdout:220 2023-06-08T04:05:21.525 INFO:teuthology.orchestra.run.smithi016.stdout:220.out 2023-06-08T04:05:21.525 INFO:teuthology.orchestra.run.smithi016.stdout:221 2023-06-08T04:05:21.525 INFO:teuthology.orchestra.run.smithi016.stdout:221.out 2023-06-08T04:05:21.526 INFO:teuthology.orchestra.run.smithi016.stdout:222 2023-06-08T04:05:21.526 INFO:teuthology.orchestra.run.smithi016.stdout:222.out 2023-06-08T04:05:21.526 INFO:teuthology.orchestra.run.smithi016.stdout:223 2023-06-08T04:05:21.526 INFO:teuthology.orchestra.run.smithi016.stdout:223.out 2023-06-08T04:05:21.526 INFO:teuthology.orchestra.run.smithi016.stdout:224 2023-06-08T04:05:21.526 INFO:teuthology.orchestra.run.smithi016.stdout:224.out 2023-06-08T04:05:21.526 INFO:teuthology.orchestra.run.smithi016.stdout:225 2023-06-08T04:05:21.526 INFO:teuthology.orchestra.run.smithi016.stdout:225.out 2023-06-08T04:05:21.527 INFO:teuthology.orchestra.run.smithi016.stdout:226 2023-06-08T04:05:21.527 INFO:teuthology.orchestra.run.smithi016.stdout:226.out 2023-06-08T04:05:21.527 INFO:teuthology.orchestra.run.smithi016.stdout:227 2023-06-08T04:05:21.527 INFO:teuthology.orchestra.run.smithi016.stdout:227.out 2023-06-08T04:05:21.527 INFO:teuthology.orchestra.run.smithi016.stdout:228 2023-06-08T04:05:21.527 INFO:teuthology.orchestra.run.smithi016.stdout:228.out 2023-06-08T04:05:21.527 INFO:teuthology.orchestra.run.smithi016.stdout:229 2023-06-08T04:05:21.527 INFO:teuthology.orchestra.run.smithi016.stdout:229.out 2023-06-08T04:05:21.528 INFO:teuthology.orchestra.run.smithi016.stdout:230 2023-06-08T04:05:21.528 INFO:teuthology.orchestra.run.smithi016.stdout:230.out 2023-06-08T04:05:21.528 INFO:teuthology.orchestra.run.smithi016.stdout:231 2023-06-08T04:05:21.528 INFO:teuthology.orchestra.run.smithi016.stdout:231.out 2023-06-08T04:05:21.528 INFO:teuthology.orchestra.run.smithi016.stdout:232 2023-06-08T04:05:21.528 INFO:teuthology.orchestra.run.smithi016.stdout:232.out 2023-06-08T04:05:21.528 INFO:teuthology.orchestra.run.smithi016.stdout:233 2023-06-08T04:05:21.528 INFO:teuthology.orchestra.run.smithi016.stdout:233.out 2023-06-08T04:05:21.529 INFO:teuthology.orchestra.run.smithi016.stdout:234 2023-06-08T04:05:21.529 INFO:teuthology.orchestra.run.smithi016.stdout:234.out 2023-06-08T04:05:21.529 INFO:teuthology.orchestra.run.smithi016.stdout:235 2023-06-08T04:05:21.529 INFO:teuthology.orchestra.run.smithi016.stdout:235.out 2023-06-08T04:05:21.529 INFO:teuthology.orchestra.run.smithi016.stdout:236 2023-06-08T04:05:21.529 INFO:teuthology.orchestra.run.smithi016.stdout:236.out 2023-06-08T04:05:21.529 INFO:teuthology.orchestra.run.smithi016.stdout:237 2023-06-08T04:05:21.529 INFO:teuthology.orchestra.run.smithi016.stdout:237.out 2023-06-08T04:05:21.530 INFO:teuthology.orchestra.run.smithi016.stdout:238 2023-06-08T04:05:21.530 INFO:teuthology.orchestra.run.smithi016.stdout:238.out 2023-06-08T04:05:21.530 INFO:teuthology.orchestra.run.smithi016.stdout:239 2023-06-08T04:05:21.530 INFO:teuthology.orchestra.run.smithi016.stdout:239.out 2023-06-08T04:05:21.530 INFO:teuthology.orchestra.run.smithi016.stdout:240 2023-06-08T04:05:21.530 INFO:teuthology.orchestra.run.smithi016.stdout:240.out 2023-06-08T04:05:21.530 INFO:teuthology.orchestra.run.smithi016.stdout:241 2023-06-08T04:05:21.531 INFO:teuthology.orchestra.run.smithi016.stdout:241.out 2023-06-08T04:05:21.531 INFO:teuthology.orchestra.run.smithi016.stdout:242 2023-06-08T04:05:21.531 INFO:teuthology.orchestra.run.smithi016.stdout:242.out 2023-06-08T04:05:21.531 INFO:teuthology.orchestra.run.smithi016.stdout:243 2023-06-08T04:05:21.531 INFO:teuthology.orchestra.run.smithi016.stdout:243.out 2023-06-08T04:05:21.531 INFO:teuthology.orchestra.run.smithi016.stdout:244 2023-06-08T04:05:21.531 INFO:teuthology.orchestra.run.smithi016.stdout:244.out 2023-06-08T04:05:21.531 INFO:teuthology.orchestra.run.smithi016.stdout:245 2023-06-08T04:05:21.532 INFO:teuthology.orchestra.run.smithi016.stdout:245.out 2023-06-08T04:05:21.532 INFO:teuthology.orchestra.run.smithi016.stdout:246 2023-06-08T04:05:21.532 INFO:teuthology.orchestra.run.smithi016.stdout:246.out 2023-06-08T04:05:21.532 INFO:teuthology.orchestra.run.smithi016.stdout:247 2023-06-08T04:05:21.532 INFO:teuthology.orchestra.run.smithi016.stdout:247.out 2023-06-08T04:05:21.532 INFO:teuthology.orchestra.run.smithi016.stdout:248 2023-06-08T04:05:21.532 INFO:teuthology.orchestra.run.smithi016.stdout:248.out 2023-06-08T04:05:21.532 INFO:teuthology.orchestra.run.smithi016.stdout:249 2023-06-08T04:05:21.533 INFO:teuthology.orchestra.run.smithi016.stdout:249.out 2023-06-08T04:05:21.533 INFO:teuthology.orchestra.run.smithi016.stdout:250 2023-06-08T04:05:21.533 INFO:teuthology.orchestra.run.smithi016.stdout:250.out 2023-06-08T04:05:21.533 INFO:teuthology.orchestra.run.smithi016.stdout:251 2023-06-08T04:05:21.533 INFO:teuthology.orchestra.run.smithi016.stdout:251.out 2023-06-08T04:05:21.533 INFO:teuthology.orchestra.run.smithi016.stdout:252 2023-06-08T04:05:21.533 INFO:teuthology.orchestra.run.smithi016.stdout:252.out 2023-06-08T04:05:21.533 INFO:teuthology.orchestra.run.smithi016.stdout:253 2023-06-08T04:05:21.534 INFO:teuthology.orchestra.run.smithi016.stdout:253.out 2023-06-08T04:05:21.534 INFO:teuthology.orchestra.run.smithi016.stdout:254 2023-06-08T04:05:21.534 INFO:teuthology.orchestra.run.smithi016.stdout:254.out 2023-06-08T04:05:21.534 INFO:teuthology.orchestra.run.smithi016.stdout:255 2023-06-08T04:05:21.534 INFO:teuthology.orchestra.run.smithi016.stdout:255.out 2023-06-08T04:05:21.534 INFO:teuthology.orchestra.run.smithi016.stdout:256 2023-06-08T04:05:21.534 INFO:teuthology.orchestra.run.smithi016.stdout:256.out 2023-06-08T04:05:21.534 INFO:teuthology.orchestra.run.smithi016.stdout:257 2023-06-08T04:05:21.535 INFO:teuthology.orchestra.run.smithi016.stdout:257.out 2023-06-08T04:05:21.535 INFO:teuthology.orchestra.run.smithi016.stdout:258 2023-06-08T04:05:21.535 INFO:teuthology.orchestra.run.smithi016.stdout:258.out 2023-06-08T04:05:21.535 INFO:teuthology.orchestra.run.smithi016.stdout:259 2023-06-08T04:05:21.535 INFO:teuthology.orchestra.run.smithi016.stdout:259.out 2023-06-08T04:05:21.535 INFO:teuthology.orchestra.run.smithi016.stdout:260 2023-06-08T04:05:21.535 INFO:teuthology.orchestra.run.smithi016.stdout:260.out 2023-06-08T04:05:21.535 INFO:teuthology.orchestra.run.smithi016.stdout:261 2023-06-08T04:05:21.536 INFO:teuthology.orchestra.run.smithi016.stdout:261.out 2023-06-08T04:05:21.536 INFO:teuthology.orchestra.run.smithi016.stdout:262 2023-06-08T04:05:21.536 INFO:teuthology.orchestra.run.smithi016.stdout:262.out 2023-06-08T04:05:21.536 INFO:teuthology.orchestra.run.smithi016.stdout:263 2023-06-08T04:05:21.536 INFO:teuthology.orchestra.run.smithi016.stdout:263.out 2023-06-08T04:05:21.536 INFO:teuthology.orchestra.run.smithi016.stdout:264 2023-06-08T04:05:21.536 INFO:teuthology.orchestra.run.smithi016.stdout:264.out 2023-06-08T04:05:21.536 INFO:teuthology.orchestra.run.smithi016.stdout:265 2023-06-08T04:05:21.537 INFO:teuthology.orchestra.run.smithi016.stdout:265.out 2023-06-08T04:05:21.537 INFO:teuthology.orchestra.run.smithi016.stdout:266 2023-06-08T04:05:21.537 INFO:teuthology.orchestra.run.smithi016.stdout:266.out 2023-06-08T04:05:21.537 INFO:teuthology.orchestra.run.smithi016.stdout:267 2023-06-08T04:05:21.537 INFO:teuthology.orchestra.run.smithi016.stdout:267.out 2023-06-08T04:05:21.537 INFO:teuthology.orchestra.run.smithi016.stdout:268 2023-06-08T04:05:21.537 INFO:teuthology.orchestra.run.smithi016.stdout:268.out 2023-06-08T04:05:21.537 INFO:teuthology.orchestra.run.smithi016.stdout:269 2023-06-08T04:05:21.538 INFO:teuthology.orchestra.run.smithi016.stdout:269.out 2023-06-08T04:05:21.538 INFO:teuthology.orchestra.run.smithi016.stdout:270 2023-06-08T04:05:21.538 INFO:teuthology.orchestra.run.smithi016.stdout:270.out 2023-06-08T04:05:21.538 INFO:teuthology.orchestra.run.smithi016.stdout:271 2023-06-08T04:05:21.538 INFO:teuthology.orchestra.run.smithi016.stdout:271.out 2023-06-08T04:05:21.538 INFO:teuthology.orchestra.run.smithi016.stdout:272 2023-06-08T04:05:21.538 INFO:teuthology.orchestra.run.smithi016.stdout:272.out 2023-06-08T04:05:21.538 INFO:teuthology.orchestra.run.smithi016.stdout:273 2023-06-08T04:05:21.539 INFO:teuthology.orchestra.run.smithi016.stdout:273.out 2023-06-08T04:05:21.539 INFO:teuthology.orchestra.run.smithi016.stdout:274 2023-06-08T04:05:21.539 INFO:teuthology.orchestra.run.smithi016.stdout:274.out 2023-06-08T04:05:21.539 INFO:teuthology.orchestra.run.smithi016.stdout:275 2023-06-08T04:05:21.539 INFO:teuthology.orchestra.run.smithi016.stdout:275.out 2023-06-08T04:05:21.539 INFO:teuthology.orchestra.run.smithi016.stdout:276 2023-06-08T04:05:21.539 INFO:teuthology.orchestra.run.smithi016.stdout:276.out 2023-06-08T04:05:21.539 INFO:teuthology.orchestra.run.smithi016.stdout:277 2023-06-08T04:05:21.540 INFO:teuthology.orchestra.run.smithi016.stdout:277.out 2023-06-08T04:05:21.540 INFO:teuthology.orchestra.run.smithi016.stdout:278 2023-06-08T04:05:21.540 INFO:teuthology.orchestra.run.smithi016.stdout:278.out 2023-06-08T04:05:21.540 INFO:teuthology.orchestra.run.smithi016.stdout:279 2023-06-08T04:05:21.540 INFO:teuthology.orchestra.run.smithi016.stdout:279.out 2023-06-08T04:05:21.540 INFO:teuthology.orchestra.run.smithi016.stdout:280 2023-06-08T04:05:21.540 INFO:teuthology.orchestra.run.smithi016.stdout:280.out 2023-06-08T04:05:21.541 INFO:teuthology.orchestra.run.smithi016.stdout:281 2023-06-08T04:05:21.541 INFO:teuthology.orchestra.run.smithi016.stdout:281.out 2023-06-08T04:05:21.541 INFO:teuthology.orchestra.run.smithi016.stdout:282 2023-06-08T04:05:21.541 INFO:teuthology.orchestra.run.smithi016.stdout:282.out 2023-06-08T04:05:21.541 INFO:teuthology.orchestra.run.smithi016.stdout:283 2023-06-08T04:05:21.541 INFO:teuthology.orchestra.run.smithi016.stdout:283.out 2023-06-08T04:05:21.541 INFO:teuthology.orchestra.run.smithi016.stdout:284 2023-06-08T04:05:21.542 INFO:teuthology.orchestra.run.smithi016.stdout:284.out 2023-06-08T04:05:21.542 INFO:teuthology.orchestra.run.smithi016.stdout:285 2023-06-08T04:05:21.542 INFO:teuthology.orchestra.run.smithi016.stdout:285.out 2023-06-08T04:05:21.542 INFO:teuthology.orchestra.run.smithi016.stdout:286 2023-06-08T04:05:21.542 INFO:teuthology.orchestra.run.smithi016.stdout:286.out 2023-06-08T04:05:21.542 INFO:teuthology.orchestra.run.smithi016.stdout:287 2023-06-08T04:05:21.542 INFO:teuthology.orchestra.run.smithi016.stdout:287.out 2023-06-08T04:05:21.542 INFO:teuthology.orchestra.run.smithi016.stdout:288 2023-06-08T04:05:21.543 INFO:teuthology.orchestra.run.smithi016.stdout:288.out 2023-06-08T04:05:21.543 INFO:teuthology.orchestra.run.smithi016.stdout:289 2023-06-08T04:05:21.543 INFO:teuthology.orchestra.run.smithi016.stdout:289.out 2023-06-08T04:05:21.543 INFO:teuthology.orchestra.run.smithi016.stdout:290 2023-06-08T04:05:21.543 INFO:teuthology.orchestra.run.smithi016.stdout:290.out 2023-06-08T04:05:21.543 INFO:teuthology.orchestra.run.smithi016.stdout:291 2023-06-08T04:05:21.543 INFO:teuthology.orchestra.run.smithi016.stdout:291.out 2023-06-08T04:05:21.543 INFO:teuthology.orchestra.run.smithi016.stdout:292 2023-06-08T04:05:21.544 INFO:teuthology.orchestra.run.smithi016.stdout:292.out 2023-06-08T04:05:21.544 INFO:teuthology.orchestra.run.smithi016.stdout:293 2023-06-08T04:05:21.544 INFO:teuthology.orchestra.run.smithi016.stdout:293.out 2023-06-08T04:05:21.544 INFO:teuthology.orchestra.run.smithi016.stdout:294 2023-06-08T04:05:21.544 INFO:teuthology.orchestra.run.smithi016.stdout:294.out 2023-06-08T04:05:21.544 INFO:teuthology.orchestra.run.smithi016.stdout:295 2023-06-08T04:05:21.544 INFO:teuthology.orchestra.run.smithi016.stdout:295.out 2023-06-08T04:05:21.545 INFO:teuthology.orchestra.run.smithi016.stdout:296 2023-06-08T04:05:21.545 INFO:teuthology.orchestra.run.smithi016.stdout:296.out 2023-06-08T04:05:21.545 INFO:teuthology.orchestra.run.smithi016.stdout:297 2023-06-08T04:05:21.545 INFO:teuthology.orchestra.run.smithi016.stdout:297.out 2023-06-08T04:05:21.545 INFO:teuthology.orchestra.run.smithi016.stdout:298 2023-06-08T04:05:21.545 INFO:teuthology.orchestra.run.smithi016.stdout:298.out 2023-06-08T04:05:21.545 INFO:teuthology.orchestra.run.smithi016.stdout:299 2023-06-08T04:05:21.546 INFO:teuthology.orchestra.run.smithi016.stdout:299.out 2023-06-08T04:05:21.546 INFO:teuthology.orchestra.run.smithi016.stdout:300 2023-06-08T04:05:21.546 INFO:teuthology.orchestra.run.smithi016.stdout:300.out 2023-06-08T04:05:21.546 INFO:teuthology.orchestra.run.smithi016.stdout:301 2023-06-08T04:05:21.546 INFO:teuthology.orchestra.run.smithi016.stdout:301.out 2023-06-08T04:05:21.546 INFO:teuthology.orchestra.run.smithi016.stdout:302 2023-06-08T04:05:21.546 INFO:teuthology.orchestra.run.smithi016.stdout:302.out 2023-06-08T04:05:21.547 INFO:teuthology.orchestra.run.smithi016.stdout:303 2023-06-08T04:05:21.547 INFO:teuthology.orchestra.run.smithi016.stdout:303.out 2023-06-08T04:05:21.547 INFO:teuthology.orchestra.run.smithi016.stdout:304 2023-06-08T04:05:21.547 INFO:teuthology.orchestra.run.smithi016.stdout:304.out 2023-06-08T04:05:21.547 INFO:teuthology.orchestra.run.smithi016.stdout:305 2023-06-08T04:05:21.547 INFO:teuthology.orchestra.run.smithi016.stdout:305.out 2023-06-08T04:05:21.547 INFO:teuthology.orchestra.run.smithi016.stdout:306 2023-06-08T04:05:21.547 INFO:teuthology.orchestra.run.smithi016.stdout:306.out 2023-06-08T04:05:21.548 INFO:teuthology.orchestra.run.smithi016.stdout:307 2023-06-08T04:05:21.548 INFO:teuthology.orchestra.run.smithi016.stdout:307.out 2023-06-08T04:05:21.548 INFO:teuthology.orchestra.run.smithi016.stdout:308 2023-06-08T04:05:21.548 INFO:teuthology.orchestra.run.smithi016.stdout:308.out 2023-06-08T04:05:21.548 INFO:teuthology.orchestra.run.smithi016.stdout:309 2023-06-08T04:05:21.548 INFO:teuthology.orchestra.run.smithi016.stdout:309.out 2023-06-08T04:05:21.548 INFO:teuthology.orchestra.run.smithi016.stdout:310 2023-06-08T04:05:21.548 INFO:teuthology.orchestra.run.smithi016.stdout:310.out 2023-06-08T04:05:21.549 INFO:teuthology.orchestra.run.smithi016.stdout:311 2023-06-08T04:05:21.549 INFO:teuthology.orchestra.run.smithi016.stdout:311.out 2023-06-08T04:05:21.549 INFO:teuthology.orchestra.run.smithi016.stdout:312 2023-06-08T04:05:21.549 INFO:teuthology.orchestra.run.smithi016.stdout:312.out 2023-06-08T04:05:21.549 INFO:teuthology.orchestra.run.smithi016.stdout:313 2023-06-08T04:05:21.549 INFO:teuthology.orchestra.run.smithi016.stdout:313.out 2023-06-08T04:05:21.549 INFO:teuthology.orchestra.run.smithi016.stdout:314 2023-06-08T04:05:21.550 INFO:teuthology.orchestra.run.smithi016.stdout:314.out 2023-06-08T04:05:21.550 INFO:teuthology.orchestra.run.smithi016.stdout:315 2023-06-08T04:05:21.550 INFO:teuthology.orchestra.run.smithi016.stdout:315.out 2023-06-08T04:05:21.550 INFO:teuthology.orchestra.run.smithi016.stdout:316 2023-06-08T04:05:21.550 INFO:teuthology.orchestra.run.smithi016.stdout:316.out 2023-06-08T04:05:21.550 INFO:teuthology.orchestra.run.smithi016.stdout:317 2023-06-08T04:05:21.550 INFO:teuthology.orchestra.run.smithi016.stdout:317.out 2023-06-08T04:05:21.550 INFO:teuthology.orchestra.run.smithi016.stdout:318 2023-06-08T04:05:21.551 INFO:teuthology.orchestra.run.smithi016.stdout:318.out 2023-06-08T04:05:21.551 INFO:teuthology.orchestra.run.smithi016.stdout:319 2023-06-08T04:05:21.551 INFO:teuthology.orchestra.run.smithi016.stdout:319.out 2023-06-08T04:05:21.551 INFO:teuthology.orchestra.run.smithi016.stdout:320 2023-06-08T04:05:21.551 INFO:teuthology.orchestra.run.smithi016.stdout:320.out 2023-06-08T04:05:21.551 INFO:teuthology.orchestra.run.smithi016.stdout:321 2023-06-08T04:05:21.551 INFO:teuthology.orchestra.run.smithi016.stdout:321.out 2023-06-08T04:05:21.551 INFO:teuthology.orchestra.run.smithi016.stdout:322 2023-06-08T04:05:21.552 INFO:teuthology.orchestra.run.smithi016.stdout:322.out 2023-06-08T04:05:21.552 INFO:teuthology.orchestra.run.smithi016.stdout:323 2023-06-08T04:05:21.552 INFO:teuthology.orchestra.run.smithi016.stdout:323.out 2023-06-08T04:05:21.552 INFO:teuthology.orchestra.run.smithi016.stdout:324 2023-06-08T04:05:21.552 INFO:teuthology.orchestra.run.smithi016.stdout:324.out 2023-06-08T04:05:21.552 INFO:teuthology.orchestra.run.smithi016.stdout:325 2023-06-08T04:05:21.552 INFO:teuthology.orchestra.run.smithi016.stdout:325.out 2023-06-08T04:05:21.552 INFO:teuthology.orchestra.run.smithi016.stdout:326 2023-06-08T04:05:21.553 INFO:teuthology.orchestra.run.smithi016.stdout:326.out 2023-06-08T04:05:21.553 INFO:teuthology.orchestra.run.smithi016.stdout:327 2023-06-08T04:05:21.553 INFO:teuthology.orchestra.run.smithi016.stdout:327.out 2023-06-08T04:05:21.553 INFO:teuthology.orchestra.run.smithi016.stdout:328 2023-06-08T04:05:21.553 INFO:teuthology.orchestra.run.smithi016.stdout:328.out 2023-06-08T04:05:21.553 INFO:teuthology.orchestra.run.smithi016.stdout:329 2023-06-08T04:05:21.553 INFO:teuthology.orchestra.run.smithi016.stdout:329.out 2023-06-08T04:05:21.553 INFO:teuthology.orchestra.run.smithi016.stdout:330 2023-06-08T04:05:21.554 INFO:teuthology.orchestra.run.smithi016.stdout:330.out 2023-06-08T04:05:21.554 INFO:teuthology.orchestra.run.smithi016.stdout:331 2023-06-08T04:05:21.554 INFO:teuthology.orchestra.run.smithi016.stdout:331.out 2023-06-08T04:05:21.554 INFO:teuthology.orchestra.run.smithi016.stdout:332 2023-06-08T04:05:21.554 INFO:teuthology.orchestra.run.smithi016.stdout:332.out 2023-06-08T04:05:21.554 INFO:teuthology.orchestra.run.smithi016.stdout:333 2023-06-08T04:05:21.554 INFO:teuthology.orchestra.run.smithi016.stdout:333.out 2023-06-08T04:05:21.554 INFO:teuthology.orchestra.run.smithi016.stdout:334 2023-06-08T04:05:21.555 INFO:teuthology.orchestra.run.smithi016.stdout:334.out 2023-06-08T04:05:21.555 INFO:teuthology.orchestra.run.smithi016.stdout:335 2023-06-08T04:05:21.555 INFO:teuthology.orchestra.run.smithi016.stdout:335.out 2023-06-08T04:05:21.555 INFO:teuthology.orchestra.run.smithi016.stdout:336 2023-06-08T04:05:21.555 INFO:teuthology.orchestra.run.smithi016.stdout:336.out 2023-06-08T04:05:21.555 INFO:teuthology.orchestra.run.smithi016.stdout:337 2023-06-08T04:05:21.555 INFO:teuthology.orchestra.run.smithi016.stdout:337.out 2023-06-08T04:05:21.555 INFO:teuthology.orchestra.run.smithi016.stdout:338 2023-06-08T04:05:21.556 INFO:teuthology.orchestra.run.smithi016.stdout:338.out 2023-06-08T04:05:21.556 INFO:teuthology.orchestra.run.smithi016.stdout:339 2023-06-08T04:05:21.556 INFO:teuthology.orchestra.run.smithi016.stdout:339.out 2023-06-08T04:05:21.556 INFO:teuthology.orchestra.run.smithi016.stdout:340 2023-06-08T04:05:21.556 INFO:teuthology.orchestra.run.smithi016.stdout:340.out 2023-06-08T04:05:21.556 INFO:teuthology.orchestra.run.smithi016.stdout:341 2023-06-08T04:05:21.556 INFO:teuthology.orchestra.run.smithi016.stdout:341.out 2023-06-08T04:05:21.556 INFO:teuthology.orchestra.run.smithi016.stdout:342 2023-06-08T04:05:21.557 INFO:teuthology.orchestra.run.smithi016.stdout:342.out 2023-06-08T04:05:21.557 INFO:teuthology.orchestra.run.smithi016.stdout:343 2023-06-08T04:05:21.557 INFO:teuthology.orchestra.run.smithi016.stdout:343.out 2023-06-08T04:05:21.557 INFO:teuthology.orchestra.run.smithi016.stdout:344 2023-06-08T04:05:21.557 INFO:teuthology.orchestra.run.smithi016.stdout:344.out 2023-06-08T04:05:21.557 INFO:teuthology.orchestra.run.smithi016.stdout:345 2023-06-08T04:05:21.557 INFO:teuthology.orchestra.run.smithi016.stdout:345.out 2023-06-08T04:05:21.558 INFO:teuthology.orchestra.run.smithi016.stdout:346 2023-06-08T04:05:21.558 INFO:teuthology.orchestra.run.smithi016.stdout:346.out 2023-06-08T04:05:21.558 INFO:teuthology.orchestra.run.smithi016.stdout:347 2023-06-08T04:05:21.558 INFO:teuthology.orchestra.run.smithi016.stdout:347.out 2023-06-08T04:05:21.558 INFO:teuthology.orchestra.run.smithi016.stdout:348 2023-06-08T04:05:21.558 INFO:teuthology.orchestra.run.smithi016.stdout:348.out 2023-06-08T04:05:21.558 INFO:teuthology.orchestra.run.smithi016.stdout:349 2023-06-08T04:05:21.558 INFO:teuthology.orchestra.run.smithi016.stdout:349.out 2023-06-08T04:05:21.559 INFO:teuthology.orchestra.run.smithi016.stdout:350 2023-06-08T04:05:21.559 INFO:teuthology.orchestra.run.smithi016.stdout:350.out 2023-06-08T04:05:21.559 INFO:teuthology.orchestra.run.smithi016.stdout:351 2023-06-08T04:05:21.559 INFO:teuthology.orchestra.run.smithi016.stdout:351.out 2023-06-08T04:05:21.559 INFO:teuthology.orchestra.run.smithi016.stdout:352 2023-06-08T04:05:21.559 INFO:teuthology.orchestra.run.smithi016.stdout:352.out 2023-06-08T04:05:21.559 INFO:teuthology.orchestra.run.smithi016.stdout:353 2023-06-08T04:05:21.559 INFO:teuthology.orchestra.run.smithi016.stdout:353.out 2023-06-08T04:05:21.560 INFO:teuthology.orchestra.run.smithi016.stdout:354 2023-06-08T04:05:21.560 INFO:teuthology.orchestra.run.smithi016.stdout:354.out 2023-06-08T04:05:21.560 INFO:teuthology.orchestra.run.smithi016.stdout:355 2023-06-08T04:05:21.560 INFO:teuthology.orchestra.run.smithi016.stdout:355.out 2023-06-08T04:05:21.560 INFO:teuthology.orchestra.run.smithi016.stdout:356 2023-06-08T04:05:21.560 INFO:teuthology.orchestra.run.smithi016.stdout:356.out 2023-06-08T04:05:21.560 INFO:teuthology.orchestra.run.smithi016.stdout:357 2023-06-08T04:05:21.560 INFO:teuthology.orchestra.run.smithi016.stdout:357.out 2023-06-08T04:05:21.561 INFO:teuthology.orchestra.run.smithi016.stdout:358 2023-06-08T04:05:21.561 INFO:teuthology.orchestra.run.smithi016.stdout:358.out 2023-06-08T04:05:21.561 INFO:teuthology.orchestra.run.smithi016.stdout:359 2023-06-08T04:05:21.561 INFO:teuthology.orchestra.run.smithi016.stdout:359.out 2023-06-08T04:05:21.561 INFO:teuthology.orchestra.run.smithi016.stdout:360 2023-06-08T04:05:21.561 INFO:teuthology.orchestra.run.smithi016.stdout:360.out 2023-06-08T04:05:21.561 INFO:teuthology.orchestra.run.smithi016.stdout:361 2023-06-08T04:05:21.562 INFO:teuthology.orchestra.run.smithi016.stdout:361.out 2023-06-08T04:05:21.562 INFO:teuthology.orchestra.run.smithi016.stdout:362 2023-06-08T04:05:21.562 INFO:teuthology.orchestra.run.smithi016.stdout:362.out 2023-06-08T04:05:21.562 INFO:teuthology.orchestra.run.smithi016.stdout:363 2023-06-08T04:05:21.562 INFO:teuthology.orchestra.run.smithi016.stdout:363.out 2023-06-08T04:05:21.562 INFO:teuthology.orchestra.run.smithi016.stdout:364 2023-06-08T04:05:21.562 INFO:teuthology.orchestra.run.smithi016.stdout:364.out 2023-06-08T04:05:21.562 INFO:teuthology.orchestra.run.smithi016.stdout:365 2023-06-08T04:05:21.563 INFO:teuthology.orchestra.run.smithi016.stdout:365.out 2023-06-08T04:05:21.563 INFO:teuthology.orchestra.run.smithi016.stdout:366 2023-06-08T04:05:21.563 INFO:teuthology.orchestra.run.smithi016.stdout:366.out 2023-06-08T04:05:21.563 INFO:teuthology.orchestra.run.smithi016.stdout:367 2023-06-08T04:05:21.563 INFO:teuthology.orchestra.run.smithi016.stdout:367.out 2023-06-08T04:05:21.563 INFO:teuthology.orchestra.run.smithi016.stdout:368 2023-06-08T04:05:21.563 INFO:teuthology.orchestra.run.smithi016.stdout:368.out 2023-06-08T04:05:21.564 INFO:teuthology.orchestra.run.smithi016.stdout:369 2023-06-08T04:05:21.564 INFO:teuthology.orchestra.run.smithi016.stdout:369.out 2023-06-08T04:05:21.564 INFO:teuthology.orchestra.run.smithi016.stdout:370 2023-06-08T04:05:21.564 INFO:teuthology.orchestra.run.smithi016.stdout:370.out 2023-06-08T04:05:21.564 INFO:teuthology.orchestra.run.smithi016.stdout:371 2023-06-08T04:05:21.564 INFO:teuthology.orchestra.run.smithi016.stdout:371.out 2023-06-08T04:05:21.564 INFO:teuthology.orchestra.run.smithi016.stdout:372 2023-06-08T04:05:21.565 INFO:teuthology.orchestra.run.smithi016.stdout:372.out 2023-06-08T04:05:21.565 INFO:teuthology.orchestra.run.smithi016.stdout:373 2023-06-08T04:05:21.565 INFO:teuthology.orchestra.run.smithi016.stdout:373.out 2023-06-08T04:05:21.565 INFO:teuthology.orchestra.run.smithi016.stdout:374 2023-06-08T04:05:21.565 INFO:teuthology.orchestra.run.smithi016.stdout:374.out 2023-06-08T04:05:21.565 INFO:teuthology.orchestra.run.smithi016.stdout:375 2023-06-08T04:05:21.565 INFO:teuthology.orchestra.run.smithi016.stdout:375.out 2023-06-08T04:05:21.565 INFO:teuthology.orchestra.run.smithi016.stdout:376 2023-06-08T04:05:21.566 INFO:teuthology.orchestra.run.smithi016.stdout:376.out 2023-06-08T04:05:21.566 INFO:teuthology.orchestra.run.smithi016.stdout:377 2023-06-08T04:05:21.566 INFO:teuthology.orchestra.run.smithi016.stdout:377.out 2023-06-08T04:05:21.566 INFO:teuthology.orchestra.run.smithi016.stdout:378 2023-06-08T04:05:21.566 INFO:teuthology.orchestra.run.smithi016.stdout:378.out 2023-06-08T04:05:21.566 INFO:teuthology.orchestra.run.smithi016.stdout:379 2023-06-08T04:05:21.566 INFO:teuthology.orchestra.run.smithi016.stdout:379.out 2023-06-08T04:05:21.566 INFO:teuthology.orchestra.run.smithi016.stdout:380 2023-06-08T04:05:21.567 INFO:teuthology.orchestra.run.smithi016.stdout:380.out 2023-06-08T04:05:21.567 INFO:teuthology.orchestra.run.smithi016.stdout:381 2023-06-08T04:05:21.567 INFO:teuthology.orchestra.run.smithi016.stdout:381.out 2023-06-08T04:05:21.567 INFO:teuthology.orchestra.run.smithi016.stdout:382 2023-06-08T04:05:21.567 INFO:teuthology.orchestra.run.smithi016.stdout:382.out 2023-06-08T04:05:21.567 INFO:teuthology.orchestra.run.smithi016.stdout:383 2023-06-08T04:05:21.567 INFO:teuthology.orchestra.run.smithi016.stdout:383.out 2023-06-08T04:05:21.567 INFO:teuthology.orchestra.run.smithi016.stdout:384 2023-06-08T04:05:21.568 INFO:teuthology.orchestra.run.smithi016.stdout:384.out 2023-06-08T04:05:21.568 INFO:teuthology.orchestra.run.smithi016.stdout:385 2023-06-08T04:05:21.568 INFO:teuthology.orchestra.run.smithi016.stdout:385.out 2023-06-08T04:05:21.568 INFO:teuthology.orchestra.run.smithi016.stdout:386 2023-06-08T04:05:21.568 INFO:teuthology.orchestra.run.smithi016.stdout:386.out 2023-06-08T04:05:21.568 INFO:teuthology.orchestra.run.smithi016.stdout:387 2023-06-08T04:05:21.568 INFO:teuthology.orchestra.run.smithi016.stdout:387.out 2023-06-08T04:05:21.568 INFO:teuthology.orchestra.run.smithi016.stdout:388 2023-06-08T04:05:21.569 INFO:teuthology.orchestra.run.smithi016.stdout:388.out 2023-06-08T04:05:21.569 INFO:teuthology.orchestra.run.smithi016.stdout:389 2023-06-08T04:05:21.569 INFO:teuthology.orchestra.run.smithi016.stdout:389.out 2023-06-08T04:05:21.569 INFO:teuthology.orchestra.run.smithi016.stdout:390 2023-06-08T04:05:21.569 INFO:teuthology.orchestra.run.smithi016.stdout:390.out 2023-06-08T04:05:21.569 INFO:teuthology.orchestra.run.smithi016.stdout:391 2023-06-08T04:05:21.569 INFO:teuthology.orchestra.run.smithi016.stdout:391.out 2023-06-08T04:05:21.569 INFO:teuthology.orchestra.run.smithi016.stdout:392 2023-06-08T04:05:21.570 INFO:teuthology.orchestra.run.smithi016.stdout:392.out 2023-06-08T04:05:21.570 INFO:teuthology.orchestra.run.smithi016.stdout:393 2023-06-08T04:05:21.570 INFO:teuthology.orchestra.run.smithi016.stdout:393.out 2023-06-08T04:05:21.570 INFO:teuthology.orchestra.run.smithi016.stdout:394 2023-06-08T04:05:21.570 INFO:teuthology.orchestra.run.smithi016.stdout:394.out 2023-06-08T04:05:21.570 INFO:teuthology.orchestra.run.smithi016.stdout:395 2023-06-08T04:05:21.570 INFO:teuthology.orchestra.run.smithi016.stdout:395.out 2023-06-08T04:05:21.570 INFO:teuthology.orchestra.run.smithi016.stdout:396 2023-06-08T04:05:21.571 INFO:teuthology.orchestra.run.smithi016.stdout:396.out 2023-06-08T04:05:21.571 INFO:teuthology.orchestra.run.smithi016.stdout:397 2023-06-08T04:05:21.571 INFO:teuthology.orchestra.run.smithi016.stdout:397.out 2023-06-08T04:05:21.571 INFO:teuthology.orchestra.run.smithi016.stdout:398 2023-06-08T04:05:21.571 INFO:teuthology.orchestra.run.smithi016.stdout:398.out 2023-06-08T04:05:21.571 INFO:teuthology.orchestra.run.smithi016.stdout:399 2023-06-08T04:05:21.571 INFO:teuthology.orchestra.run.smithi016.stdout:399.out 2023-06-08T04:05:21.572 INFO:teuthology.orchestra.run.smithi016.stdout:400 2023-06-08T04:05:21.572 INFO:teuthology.orchestra.run.smithi016.stdout:400.out 2023-06-08T04:05:21.572 INFO:teuthology.orchestra.run.smithi016.stdout:401 2023-06-08T04:05:21.572 INFO:teuthology.orchestra.run.smithi016.stdout:401.out 2023-06-08T04:05:21.572 INFO:teuthology.orchestra.run.smithi016.stdout:402 2023-06-08T04:05:21.572 INFO:teuthology.orchestra.run.smithi016.stdout:402.out 2023-06-08T04:05:21.572 INFO:teuthology.orchestra.run.smithi016.stdout:403 2023-06-08T04:05:21.572 INFO:teuthology.orchestra.run.smithi016.stdout:403.out 2023-06-08T04:05:21.573 INFO:teuthology.orchestra.run.smithi016.stdout:404 2023-06-08T04:05:21.573 INFO:teuthology.orchestra.run.smithi016.stdout:404.out 2023-06-08T04:05:21.573 INFO:teuthology.orchestra.run.smithi016.stdout:405 2023-06-08T04:05:21.573 INFO:teuthology.orchestra.run.smithi016.stdout:405.out 2023-06-08T04:05:21.573 INFO:teuthology.orchestra.run.smithi016.stdout:406 2023-06-08T04:05:21.573 INFO:teuthology.orchestra.run.smithi016.stdout:406.out 2023-06-08T04:05:21.573 INFO:teuthology.orchestra.run.smithi016.stdout:407 2023-06-08T04:05:21.573 INFO:teuthology.orchestra.run.smithi016.stdout:407.out 2023-06-08T04:05:21.574 INFO:teuthology.orchestra.run.smithi016.stdout:408 2023-06-08T04:05:21.574 INFO:teuthology.orchestra.run.smithi016.stdout:408.out 2023-06-08T04:05:21.574 INFO:teuthology.orchestra.run.smithi016.stdout:409 2023-06-08T04:05:21.574 INFO:teuthology.orchestra.run.smithi016.stdout:409.out 2023-06-08T04:05:21.574 INFO:teuthology.orchestra.run.smithi016.stdout:410 2023-06-08T04:05:21.574 INFO:teuthology.orchestra.run.smithi016.stdout:410.out 2023-06-08T04:05:21.574 INFO:teuthology.orchestra.run.smithi016.stdout:411 2023-06-08T04:05:21.574 INFO:teuthology.orchestra.run.smithi016.stdout:411.out 2023-06-08T04:05:21.575 INFO:teuthology.orchestra.run.smithi016.stdout:412 2023-06-08T04:05:21.575 INFO:teuthology.orchestra.run.smithi016.stdout:412.out 2023-06-08T04:05:21.575 INFO:teuthology.orchestra.run.smithi016.stdout:413 2023-06-08T04:05:21.575 INFO:teuthology.orchestra.run.smithi016.stdout:413.out 2023-06-08T04:05:21.575 INFO:teuthology.orchestra.run.smithi016.stdout:414 2023-06-08T04:05:21.575 INFO:teuthology.orchestra.run.smithi016.stdout:414.out 2023-06-08T04:05:21.575 INFO:teuthology.orchestra.run.smithi016.stdout:415 2023-06-08T04:05:21.575 INFO:teuthology.orchestra.run.smithi016.stdout:415.out 2023-06-08T04:05:21.576 INFO:teuthology.orchestra.run.smithi016.stdout:416 2023-06-08T04:05:21.576 INFO:teuthology.orchestra.run.smithi016.stdout:416.out 2023-06-08T04:05:21.576 INFO:teuthology.orchestra.run.smithi016.stdout:417 2023-06-08T04:05:21.576 INFO:teuthology.orchestra.run.smithi016.stdout:417.out 2023-06-08T04:05:21.576 INFO:teuthology.orchestra.run.smithi016.stdout:418 2023-06-08T04:05:21.576 INFO:teuthology.orchestra.run.smithi016.stdout:418.out 2023-06-08T04:05:21.576 INFO:teuthology.orchestra.run.smithi016.stdout:419 2023-06-08T04:05:21.577 INFO:teuthology.orchestra.run.smithi016.stdout:419.out 2023-06-08T04:05:21.577 INFO:teuthology.orchestra.run.smithi016.stdout:420 2023-06-08T04:05:21.577 INFO:teuthology.orchestra.run.smithi016.stdout:420.out 2023-06-08T04:05:21.577 INFO:teuthology.orchestra.run.smithi016.stdout:421 2023-06-08T04:05:21.577 INFO:teuthology.orchestra.run.smithi016.stdout:421.out 2023-06-08T04:05:21.577 INFO:teuthology.orchestra.run.smithi016.stdout:422 2023-06-08T04:05:21.577 INFO:teuthology.orchestra.run.smithi016.stdout:422.out 2023-06-08T04:05:21.577 INFO:teuthology.orchestra.run.smithi016.stdout:423 2023-06-08T04:05:21.578 INFO:teuthology.orchestra.run.smithi016.stdout:423.out 2023-06-08T04:05:21.578 INFO:teuthology.orchestra.run.smithi016.stdout:424 2023-06-08T04:05:21.578 INFO:teuthology.orchestra.run.smithi016.stdout:424.out 2023-06-08T04:05:21.578 INFO:teuthology.orchestra.run.smithi016.stdout:425 2023-06-08T04:05:21.578 INFO:teuthology.orchestra.run.smithi016.stdout:425.out 2023-06-08T04:05:21.578 INFO:teuthology.orchestra.run.smithi016.stdout:426 2023-06-08T04:05:21.578 INFO:teuthology.orchestra.run.smithi016.stdout:426.out 2023-06-08T04:05:21.579 INFO:teuthology.orchestra.run.smithi016.stdout:427 2023-06-08T04:05:21.579 INFO:teuthology.orchestra.run.smithi016.stdout:427.out 2023-06-08T04:05:21.579 INFO:teuthology.orchestra.run.smithi016.stdout:428 2023-06-08T04:05:21.579 INFO:teuthology.orchestra.run.smithi016.stdout:428.out 2023-06-08T04:05:21.579 INFO:teuthology.orchestra.run.smithi016.stdout:429 2023-06-08T04:05:21.579 INFO:teuthology.orchestra.run.smithi016.stdout:429.out 2023-06-08T04:05:21.579 INFO:teuthology.orchestra.run.smithi016.stdout:430 2023-06-08T04:05:21.579 INFO:teuthology.orchestra.run.smithi016.stdout:430.out 2023-06-08T04:05:21.580 INFO:teuthology.orchestra.run.smithi016.stdout:431 2023-06-08T04:05:21.580 INFO:teuthology.orchestra.run.smithi016.stdout:431.out 2023-06-08T04:05:21.580 INFO:teuthology.orchestra.run.smithi016.stdout:432 2023-06-08T04:05:21.580 INFO:teuthology.orchestra.run.smithi016.stdout:432.out 2023-06-08T04:05:21.580 INFO:teuthology.orchestra.run.smithi016.stdout:433 2023-06-08T04:05:21.580 INFO:teuthology.orchestra.run.smithi016.stdout:433.out 2023-06-08T04:05:21.580 INFO:teuthology.orchestra.run.smithi016.stdout:434 2023-06-08T04:05:21.580 INFO:teuthology.orchestra.run.smithi016.stdout:434.out 2023-06-08T04:05:21.581 INFO:teuthology.orchestra.run.smithi016.stdout:435 2023-06-08T04:05:21.581 INFO:teuthology.orchestra.run.smithi016.stdout:435.out 2023-06-08T04:05:21.581 INFO:teuthology.orchestra.run.smithi016.stdout:436 2023-06-08T04:05:21.581 INFO:teuthology.orchestra.run.smithi016.stdout:436.out 2023-06-08T04:05:21.581 INFO:teuthology.orchestra.run.smithi016.stdout:437 2023-06-08T04:05:21.581 INFO:teuthology.orchestra.run.smithi016.stdout:437.out 2023-06-08T04:05:21.581 INFO:teuthology.orchestra.run.smithi016.stdout:438 2023-06-08T04:05:21.581 INFO:teuthology.orchestra.run.smithi016.stdout:438.out 2023-06-08T04:05:21.582 INFO:teuthology.orchestra.run.smithi016.stdout:439 2023-06-08T04:05:21.582 INFO:teuthology.orchestra.run.smithi016.stdout:439.out 2023-06-08T04:05:21.582 INFO:teuthology.orchestra.run.smithi016.stdout:440 2023-06-08T04:05:21.582 INFO:teuthology.orchestra.run.smithi016.stdout:440.out 2023-06-08T04:05:21.582 INFO:teuthology.orchestra.run.smithi016.stdout:441 2023-06-08T04:05:21.582 INFO:teuthology.orchestra.run.smithi016.stdout:441.out 2023-06-08T04:05:21.582 INFO:teuthology.orchestra.run.smithi016.stdout:442 2023-06-08T04:05:21.582 INFO:teuthology.orchestra.run.smithi016.stdout:442.out 2023-06-08T04:05:21.583 INFO:teuthology.orchestra.run.smithi016.stdout:443 2023-06-08T04:05:21.583 INFO:teuthology.orchestra.run.smithi016.stdout:443.out 2023-06-08T04:05:21.583 INFO:teuthology.orchestra.run.smithi016.stdout:444 2023-06-08T04:05:21.583 INFO:teuthology.orchestra.run.smithi016.stdout:444.out 2023-06-08T04:05:21.583 INFO:teuthology.orchestra.run.smithi016.stdout:445 2023-06-08T04:05:21.583 INFO:teuthology.orchestra.run.smithi016.stdout:445.out 2023-06-08T04:05:21.583 INFO:teuthology.orchestra.run.smithi016.stdout:446 2023-06-08T04:05:21.583 INFO:teuthology.orchestra.run.smithi016.stdout:446.out 2023-06-08T04:05:21.584 INFO:teuthology.orchestra.run.smithi016.stdout:447 2023-06-08T04:05:21.584 INFO:teuthology.orchestra.run.smithi016.stdout:447.out 2023-06-08T04:05:21.584 INFO:teuthology.orchestra.run.smithi016.stdout:448 2023-06-08T04:05:21.584 INFO:teuthology.orchestra.run.smithi016.stdout:448.out 2023-06-08T04:05:21.584 INFO:teuthology.orchestra.run.smithi016.stdout:449 2023-06-08T04:05:21.584 INFO:teuthology.orchestra.run.smithi016.stdout:449.out 2023-06-08T04:05:21.584 INFO:teuthology.orchestra.run.smithi016.stdout:450 2023-06-08T04:05:21.585 INFO:teuthology.orchestra.run.smithi016.stdout:450.out 2023-06-08T04:05:21.585 INFO:teuthology.orchestra.run.smithi016.stdout:451 2023-06-08T04:05:21.585 INFO:teuthology.orchestra.run.smithi016.stdout:451.out 2023-06-08T04:05:21.585 INFO:teuthology.orchestra.run.smithi016.stdout:452 2023-06-08T04:05:21.585 INFO:teuthology.orchestra.run.smithi016.stdout:452.out 2023-06-08T04:05:21.585 INFO:teuthology.orchestra.run.smithi016.stdout:453 2023-06-08T04:05:21.585 INFO:teuthology.orchestra.run.smithi016.stdout:453.out 2023-06-08T04:05:21.585 INFO:teuthology.orchestra.run.smithi016.stdout:454 2023-06-08T04:05:21.586 INFO:teuthology.orchestra.run.smithi016.stdout:454.out 2023-06-08T04:05:21.586 INFO:teuthology.orchestra.run.smithi016.stdout:455 2023-06-08T04:05:21.586 INFO:teuthology.orchestra.run.smithi016.stdout:455.out 2023-06-08T04:05:21.586 INFO:teuthology.orchestra.run.smithi016.stdout:456 2023-06-08T04:05:21.586 INFO:teuthology.orchestra.run.smithi016.stdout:456.out 2023-06-08T04:05:21.586 INFO:teuthology.orchestra.run.smithi016.stdout:457 2023-06-08T04:05:21.586 INFO:teuthology.orchestra.run.smithi016.stdout:457.out 2023-06-08T04:05:21.586 INFO:teuthology.orchestra.run.smithi016.stdout:458 2023-06-08T04:05:21.587 INFO:teuthology.orchestra.run.smithi016.stdout:458.out 2023-06-08T04:05:21.587 INFO:teuthology.orchestra.run.smithi016.stdout:459 2023-06-08T04:05:21.587 INFO:teuthology.orchestra.run.smithi016.stdout:459.out 2023-06-08T04:05:21.587 INFO:teuthology.orchestra.run.smithi016.stdout:460 2023-06-08T04:05:21.587 INFO:teuthology.orchestra.run.smithi016.stdout:460.out 2023-06-08T04:05:21.587 INFO:teuthology.orchestra.run.smithi016.stdout:461 2023-06-08T04:05:21.587 INFO:teuthology.orchestra.run.smithi016.stdout:461.out 2023-06-08T04:05:21.587 INFO:teuthology.orchestra.run.smithi016.stdout:462 2023-06-08T04:05:21.588 INFO:teuthology.orchestra.run.smithi016.stdout:462.out 2023-06-08T04:05:21.588 INFO:teuthology.orchestra.run.smithi016.stdout:463 2023-06-08T04:05:21.588 INFO:teuthology.orchestra.run.smithi016.stdout:463.out 2023-06-08T04:05:21.588 INFO:teuthology.orchestra.run.smithi016.stdout:464 2023-06-08T04:05:21.588 INFO:teuthology.orchestra.run.smithi016.stdout:464.out 2023-06-08T04:05:21.588 INFO:teuthology.orchestra.run.smithi016.stdout:465 2023-06-08T04:05:21.588 INFO:teuthology.orchestra.run.smithi016.stdout:465.out 2023-06-08T04:05:21.588 INFO:teuthology.orchestra.run.smithi016.stdout:466 2023-06-08T04:05:21.589 INFO:teuthology.orchestra.run.smithi016.stdout:466.out 2023-06-08T04:05:21.589 INFO:teuthology.orchestra.run.smithi016.stdout:467 2023-06-08T04:05:21.589 INFO:teuthology.orchestra.run.smithi016.stdout:467.out 2023-06-08T04:05:21.589 INFO:teuthology.orchestra.run.smithi016.stdout:468 2023-06-08T04:05:21.589 INFO:teuthology.orchestra.run.smithi016.stdout:468.out 2023-06-08T04:05:21.589 INFO:teuthology.orchestra.run.smithi016.stdout:469 2023-06-08T04:05:21.589 INFO:teuthology.orchestra.run.smithi016.stdout:469.out 2023-06-08T04:05:21.589 INFO:teuthology.orchestra.run.smithi016.stdout:470 2023-06-08T04:05:21.590 INFO:teuthology.orchestra.run.smithi016.stdout:470.out 2023-06-08T04:05:21.590 INFO:teuthology.orchestra.run.smithi016.stdout:471 2023-06-08T04:05:21.590 INFO:teuthology.orchestra.run.smithi016.stdout:471.out 2023-06-08T04:05:21.590 INFO:teuthology.orchestra.run.smithi016.stdout:472 2023-06-08T04:05:21.590 INFO:teuthology.orchestra.run.smithi016.stdout:472.out 2023-06-08T04:05:21.590 INFO:teuthology.orchestra.run.smithi016.stdout:473 2023-06-08T04:05:21.590 INFO:teuthology.orchestra.run.smithi016.stdout:473.out 2023-06-08T04:05:21.590 INFO:teuthology.orchestra.run.smithi016.stdout:474 2023-06-08T04:05:21.591 INFO:teuthology.orchestra.run.smithi016.stdout:474.out 2023-06-08T04:05:21.591 INFO:teuthology.orchestra.run.smithi016.stdout:475 2023-06-08T04:05:21.591 INFO:teuthology.orchestra.run.smithi016.stdout:475.out 2023-06-08T04:05:21.591 INFO:teuthology.orchestra.run.smithi016.stdout:476 2023-06-08T04:05:21.591 INFO:teuthology.orchestra.run.smithi016.stdout:476.out 2023-06-08T04:05:21.591 INFO:teuthology.orchestra.run.smithi016.stdout:477 2023-06-08T04:05:21.591 INFO:teuthology.orchestra.run.smithi016.stdout:477.out 2023-06-08T04:05:21.591 INFO:teuthology.orchestra.run.smithi016.stdout:478 2023-06-08T04:05:21.592 INFO:teuthology.orchestra.run.smithi016.stdout:478.out 2023-06-08T04:05:21.592 INFO:teuthology.orchestra.run.smithi016.stdout:479 2023-06-08T04:05:21.592 INFO:teuthology.orchestra.run.smithi016.stdout:479.out 2023-06-08T04:05:21.592 INFO:teuthology.orchestra.run.smithi016.stdout:480 2023-06-08T04:05:21.592 INFO:teuthology.orchestra.run.smithi016.stdout:480.out 2023-06-08T04:05:21.592 INFO:teuthology.orchestra.run.smithi016.stdout:481 2023-06-08T04:05:21.592 INFO:teuthology.orchestra.run.smithi016.stdout:481.out 2023-06-08T04:05:21.593 INFO:teuthology.orchestra.run.smithi016.stdout:482 2023-06-08T04:05:21.593 INFO:teuthology.orchestra.run.smithi016.stdout:482.out 2023-06-08T04:05:21.593 INFO:teuthology.orchestra.run.smithi016.stdout:483 2023-06-08T04:05:21.593 INFO:teuthology.orchestra.run.smithi016.stdout:483.out 2023-06-08T04:05:21.593 INFO:teuthology.orchestra.run.smithi016.stdout:484 2023-06-08T04:05:21.593 INFO:teuthology.orchestra.run.smithi016.stdout:484.out 2023-06-08T04:05:21.593 INFO:teuthology.orchestra.run.smithi016.stdout:485 2023-06-08T04:05:21.593 INFO:teuthology.orchestra.run.smithi016.stdout:485.out 2023-06-08T04:05:21.594 INFO:teuthology.orchestra.run.smithi016.stdout:486 2023-06-08T04:05:21.594 INFO:teuthology.orchestra.run.smithi016.stdout:486.out 2023-06-08T04:05:21.594 INFO:teuthology.orchestra.run.smithi016.stdout:487 2023-06-08T04:05:21.594 INFO:teuthology.orchestra.run.smithi016.stdout:487.out 2023-06-08T04:05:21.594 INFO:teuthology.orchestra.run.smithi016.stdout:488 2023-06-08T04:05:21.594 INFO:teuthology.orchestra.run.smithi016.stdout:488.out 2023-06-08T04:05:21.594 INFO:teuthology.orchestra.run.smithi016.stdout:489 2023-06-08T04:05:21.594 INFO:teuthology.orchestra.run.smithi016.stdout:489.out 2023-06-08T04:05:21.595 INFO:teuthology.orchestra.run.smithi016.stdout:490 2023-06-08T04:05:21.595 INFO:teuthology.orchestra.run.smithi016.stdout:490.out 2023-06-08T04:05:21.595 INFO:teuthology.orchestra.run.smithi016.stdout:491 2023-06-08T04:05:21.595 INFO:teuthology.orchestra.run.smithi016.stdout:491.out 2023-06-08T04:05:21.595 INFO:teuthology.orchestra.run.smithi016.stdout:492 2023-06-08T04:05:21.595 INFO:teuthology.orchestra.run.smithi016.stdout:492.out 2023-06-08T04:05:21.595 INFO:teuthology.orchestra.run.smithi016.stdout:493 2023-06-08T04:05:21.595 INFO:teuthology.orchestra.run.smithi016.stdout:493.out 2023-06-08T04:05:21.596 INFO:teuthology.orchestra.run.smithi016.stdout:494 2023-06-08T04:05:21.596 INFO:teuthology.orchestra.run.smithi016.stdout:494.out 2023-06-08T04:05:21.596 INFO:teuthology.orchestra.run.smithi016.stdout:495 2023-06-08T04:05:21.596 INFO:teuthology.orchestra.run.smithi016.stdout:495.out 2023-06-08T04:05:21.596 INFO:teuthology.orchestra.run.smithi016.stdout:496 2023-06-08T04:05:21.596 INFO:teuthology.orchestra.run.smithi016.stdout:496.out 2023-06-08T04:05:21.596 INFO:teuthology.orchestra.run.smithi016.stdout:497 2023-06-08T04:05:21.597 INFO:teuthology.orchestra.run.smithi016.stdout:497.out 2023-06-08T04:05:21.597 INFO:teuthology.orchestra.run.smithi016.stdout:498 2023-06-08T04:05:21.597 INFO:teuthology.orchestra.run.smithi016.stdout:498.out 2023-06-08T04:05:21.597 INFO:teuthology.orchestra.run.smithi016.stdout:499 2023-06-08T04:05:21.597 INFO:teuthology.orchestra.run.smithi016.stdout:499.out 2023-06-08T04:05:21.597 INFO:teuthology.orchestra.run.smithi016.stdout:500 2023-06-08T04:05:21.597 INFO:teuthology.orchestra.run.smithi016.stdout:500.out 2023-06-08T04:05:21.597 INFO:teuthology.orchestra.run.smithi016.stdout:501 2023-06-08T04:05:21.598 INFO:teuthology.orchestra.run.smithi016.stdout:501.out 2023-06-08T04:05:21.598 INFO:teuthology.orchestra.run.smithi016.stdout:502 2023-06-08T04:05:21.598 INFO:teuthology.orchestra.run.smithi016.stdout:502.out 2023-06-08T04:05:21.598 INFO:teuthology.orchestra.run.smithi016.stdout:503 2023-06-08T04:05:21.598 INFO:teuthology.orchestra.run.smithi016.stdout:503.out 2023-06-08T04:05:21.598 INFO:teuthology.orchestra.run.smithi016.stdout:504 2023-06-08T04:05:21.598 INFO:teuthology.orchestra.run.smithi016.stdout:504.out 2023-06-08T04:05:21.598 INFO:teuthology.orchestra.run.smithi016.stdout:505 2023-06-08T04:05:21.599 INFO:teuthology.orchestra.run.smithi016.stdout:505.out 2023-06-08T04:05:21.599 INFO:teuthology.orchestra.run.smithi016.stdout:506 2023-06-08T04:05:21.599 INFO:teuthology.orchestra.run.smithi016.stdout:506.out 2023-06-08T04:05:21.599 INFO:teuthology.orchestra.run.smithi016.stdout:507 2023-06-08T04:05:21.599 INFO:teuthology.orchestra.run.smithi016.stdout:507.out 2023-06-08T04:05:21.599 INFO:teuthology.orchestra.run.smithi016.stdout:508 2023-06-08T04:05:21.599 INFO:teuthology.orchestra.run.smithi016.stdout:508.out 2023-06-08T04:05:21.599 INFO:teuthology.orchestra.run.smithi016.stdout:509 2023-06-08T04:05:21.600 INFO:teuthology.orchestra.run.smithi016.stdout:509.out 2023-06-08T04:05:21.600 INFO:teuthology.orchestra.run.smithi016.stdout:510 2023-06-08T04:05:21.600 INFO:teuthology.orchestra.run.smithi016.stdout:510.out 2023-06-08T04:05:21.600 INFO:teuthology.orchestra.run.smithi016.stdout:511 2023-06-08T04:05:21.600 INFO:teuthology.orchestra.run.smithi016.stdout:511.out 2023-06-08T04:05:21.600 INFO:teuthology.orchestra.run.smithi016.stdout:512 2023-06-08T04:05:21.600 INFO:teuthology.orchestra.run.smithi016.stdout:512.out 2023-06-08T04:05:21.600 INFO:teuthology.orchestra.run.smithi016.stdout:513 2023-06-08T04:05:21.601 INFO:teuthology.orchestra.run.smithi016.stdout:513.out 2023-06-08T04:05:21.601 INFO:teuthology.orchestra.run.smithi016.stdout:514 2023-06-08T04:05:21.601 INFO:teuthology.orchestra.run.smithi016.stdout:514.out 2023-06-08T04:05:21.601 INFO:teuthology.orchestra.run.smithi016.stdout:515 2023-06-08T04:05:21.601 INFO:teuthology.orchestra.run.smithi016.stdout:515.out 2023-06-08T04:05:21.601 INFO:teuthology.orchestra.run.smithi016.stdout:516 2023-06-08T04:05:21.601 INFO:teuthology.orchestra.run.smithi016.stdout:516.out 2023-06-08T04:05:21.601 INFO:teuthology.orchestra.run.smithi016.stdout:517 2023-06-08T04:05:21.602 INFO:teuthology.orchestra.run.smithi016.stdout:517.out 2023-06-08T04:05:21.602 INFO:teuthology.orchestra.run.smithi016.stdout:518 2023-06-08T04:05:21.602 INFO:teuthology.orchestra.run.smithi016.stdout:518.out 2023-06-08T04:05:21.602 INFO:teuthology.orchestra.run.smithi016.stdout:519 2023-06-08T04:05:21.602 INFO:teuthology.orchestra.run.smithi016.stdout:519.out 2023-06-08T04:05:21.602 INFO:teuthology.orchestra.run.smithi016.stdout:520 2023-06-08T04:05:21.602 INFO:teuthology.orchestra.run.smithi016.stdout:520.out 2023-06-08T04:05:21.602 INFO:teuthology.orchestra.run.smithi016.stdout:521 2023-06-08T04:05:21.603 INFO:teuthology.orchestra.run.smithi016.stdout:521.out 2023-06-08T04:05:21.603 INFO:teuthology.orchestra.run.smithi016.stdout:522 2023-06-08T04:05:21.603 INFO:teuthology.orchestra.run.smithi016.stdout:522.out 2023-06-08T04:05:21.603 INFO:teuthology.orchestra.run.smithi016.stdout:523 2023-06-08T04:05:21.603 INFO:teuthology.orchestra.run.smithi016.stdout:523.out 2023-06-08T04:05:21.603 INFO:teuthology.orchestra.run.smithi016.stdout:524 2023-06-08T04:05:21.603 INFO:teuthology.orchestra.run.smithi016.stdout:524.out 2023-06-08T04:05:21.603 INFO:teuthology.orchestra.run.smithi016.stdout:525 2023-06-08T04:05:21.604 INFO:teuthology.orchestra.run.smithi016.stdout:525.out 2023-06-08T04:05:21.604 INFO:teuthology.orchestra.run.smithi016.stdout:526 2023-06-08T04:05:21.604 INFO:teuthology.orchestra.run.smithi016.stdout:526.out 2023-06-08T04:05:21.604 INFO:teuthology.orchestra.run.smithi016.stdout:527 2023-06-08T04:05:21.604 INFO:teuthology.orchestra.run.smithi016.stdout:527.out 2023-06-08T04:05:21.604 INFO:teuthology.orchestra.run.smithi016.stdout:528 2023-06-08T04:05:21.604 INFO:teuthology.orchestra.run.smithi016.stdout:528.out 2023-06-08T04:05:21.604 INFO:teuthology.orchestra.run.smithi016.stdout:529 2023-06-08T04:05:21.605 INFO:teuthology.orchestra.run.smithi016.stdout:529.out 2023-06-08T04:05:21.605 INFO:teuthology.orchestra.run.smithi016.stdout:530 2023-06-08T04:05:21.605 INFO:teuthology.orchestra.run.smithi016.stdout:530.out 2023-06-08T04:05:21.605 INFO:teuthology.orchestra.run.smithi016.stdout:531 2023-06-08T04:05:21.605 INFO:teuthology.orchestra.run.smithi016.stdout:531.out 2023-06-08T04:05:21.605 INFO:teuthology.orchestra.run.smithi016.stdout:532 2023-06-08T04:05:21.605 INFO:teuthology.orchestra.run.smithi016.stdout:532.out 2023-06-08T04:05:21.606 INFO:teuthology.orchestra.run.smithi016.stdout:533 2023-06-08T04:05:21.606 INFO:teuthology.orchestra.run.smithi016.stdout:533.out 2023-06-08T04:05:21.606 INFO:teuthology.orchestra.run.smithi016.stdout:534 2023-06-08T04:05:21.606 INFO:teuthology.orchestra.run.smithi016.stdout:534.out 2023-06-08T04:05:21.606 INFO:teuthology.orchestra.run.smithi016.stdout:535 2023-06-08T04:05:21.606 INFO:teuthology.orchestra.run.smithi016.stdout:535.out 2023-06-08T04:05:21.606 INFO:teuthology.orchestra.run.smithi016.stdout:536 2023-06-08T04:05:21.606 INFO:teuthology.orchestra.run.smithi016.stdout:536.out 2023-06-08T04:05:21.607 INFO:teuthology.orchestra.run.smithi016.stdout:537 2023-06-08T04:05:21.607 INFO:teuthology.orchestra.run.smithi016.stdout:537.out 2023-06-08T04:05:21.607 INFO:teuthology.orchestra.run.smithi016.stdout:538 2023-06-08T04:05:21.607 INFO:teuthology.orchestra.run.smithi016.stdout:538.out 2023-06-08T04:05:21.607 INFO:teuthology.orchestra.run.smithi016.stdout:539 2023-06-08T04:05:21.607 INFO:teuthology.orchestra.run.smithi016.stdout:539.out 2023-06-08T04:05:21.607 INFO:teuthology.orchestra.run.smithi016.stdout:540 2023-06-08T04:05:21.607 INFO:teuthology.orchestra.run.smithi016.stdout:540.out 2023-06-08T04:05:21.608 INFO:teuthology.orchestra.run.smithi016.stdout:541 2023-06-08T04:05:21.608 INFO:teuthology.orchestra.run.smithi016.stdout:541.out 2023-06-08T04:05:21.608 INFO:teuthology.orchestra.run.smithi016.stdout:542 2023-06-08T04:05:21.608 INFO:teuthology.orchestra.run.smithi016.stdout:542.out 2023-06-08T04:05:21.608 INFO:teuthology.orchestra.run.smithi016.stdout:543 2023-06-08T04:05:21.608 INFO:teuthology.orchestra.run.smithi016.stdout:543.out 2023-06-08T04:05:21.608 INFO:teuthology.orchestra.run.smithi016.stdout:544 2023-06-08T04:05:21.609 INFO:teuthology.orchestra.run.smithi016.stdout:544.out 2023-06-08T04:05:21.609 INFO:teuthology.orchestra.run.smithi016.stdout:545 2023-06-08T04:05:21.609 INFO:teuthology.orchestra.run.smithi016.stdout:545.out 2023-06-08T04:05:21.609 INFO:teuthology.orchestra.run.smithi016.stdout:546 2023-06-08T04:05:21.609 INFO:teuthology.orchestra.run.smithi016.stdout:546.out 2023-06-08T04:05:21.609 INFO:teuthology.orchestra.run.smithi016.stdout:547 2023-06-08T04:05:21.609 INFO:teuthology.orchestra.run.smithi016.stdout:547.out 2023-06-08T04:05:21.609 INFO:teuthology.orchestra.run.smithi016.stdout:548 2023-06-08T04:05:21.610 INFO:teuthology.orchestra.run.smithi016.stdout:548.out 2023-06-08T04:05:21.610 INFO:teuthology.orchestra.run.smithi016.stdout:549 2023-06-08T04:05:21.610 INFO:teuthology.orchestra.run.smithi016.stdout:549.out 2023-06-08T04:05:21.610 INFO:teuthology.orchestra.run.smithi016.stdout:550 2023-06-08T04:05:21.610 INFO:teuthology.orchestra.run.smithi016.stdout:550.out 2023-06-08T04:05:21.610 INFO:teuthology.orchestra.run.smithi016.stdout:551 2023-06-08T04:05:21.610 INFO:teuthology.orchestra.run.smithi016.stdout:551.out 2023-06-08T04:05:21.610 INFO:teuthology.orchestra.run.smithi016.stdout:552 2023-06-08T04:05:21.611 INFO:teuthology.orchestra.run.smithi016.stdout:552.out 2023-06-08T04:05:21.611 INFO:teuthology.orchestra.run.smithi016.stdout:553 2023-06-08T04:05:21.611 INFO:teuthology.orchestra.run.smithi016.stdout:553.out 2023-06-08T04:05:21.611 INFO:teuthology.orchestra.run.smithi016.stdout:554 2023-06-08T04:05:21.611 INFO:teuthology.orchestra.run.smithi016.stdout:554.out 2023-06-08T04:05:21.611 INFO:teuthology.orchestra.run.smithi016.stdout:555 2023-06-08T04:05:21.611 INFO:teuthology.orchestra.run.smithi016.stdout:555.out 2023-06-08T04:05:21.611 INFO:teuthology.orchestra.run.smithi016.stdout:556 2023-06-08T04:05:21.612 INFO:teuthology.orchestra.run.smithi016.stdout:556.out 2023-06-08T04:05:21.612 INFO:teuthology.orchestra.run.smithi016.stdout:557 2023-06-08T04:05:21.612 INFO:teuthology.orchestra.run.smithi016.stdout:557.out 2023-06-08T04:05:21.612 INFO:teuthology.orchestra.run.smithi016.stdout:558 2023-06-08T04:05:21.612 INFO:teuthology.orchestra.run.smithi016.stdout:558.out 2023-06-08T04:05:21.612 INFO:teuthology.orchestra.run.smithi016.stdout:559 2023-06-08T04:05:21.612 INFO:teuthology.orchestra.run.smithi016.stdout:559.out 2023-06-08T04:05:21.613 INFO:teuthology.orchestra.run.smithi016.stdout:560 2023-06-08T04:05:21.613 INFO:teuthology.orchestra.run.smithi016.stdout:560.out 2023-06-08T04:05:21.613 INFO:teuthology.orchestra.run.smithi016.stdout:561 2023-06-08T04:05:21.613 INFO:teuthology.orchestra.run.smithi016.stdout:561.out 2023-06-08T04:05:21.613 INFO:teuthology.orchestra.run.smithi016.stdout:562 2023-06-08T04:05:21.613 INFO:teuthology.orchestra.run.smithi016.stdout:562.out 2023-06-08T04:05:21.613 INFO:teuthology.orchestra.run.smithi016.stdout:563 2023-06-08T04:05:21.613 INFO:teuthology.orchestra.run.smithi016.stdout:563.out 2023-06-08T04:05:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:564 2023-06-08T04:05:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:564.out 2023-06-08T04:05:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:565 2023-06-08T04:05:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:565.out 2023-06-08T04:05:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:566 2023-06-08T04:05:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:566.out 2023-06-08T04:05:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:567 2023-06-08T04:05:21.615 INFO:teuthology.orchestra.run.smithi016.stdout:567.out 2023-06-08T04:05:21.615 INFO:teuthology.orchestra.run.smithi016.stdout:568 2023-06-08T04:05:21.615 INFO:teuthology.orchestra.run.smithi016.stdout:568.out 2023-06-08T04:05:21.615 INFO:teuthology.orchestra.run.smithi016.stdout:569 2023-06-08T04:05:21.615 INFO:teuthology.orchestra.run.smithi016.stdout:569.out 2023-06-08T04:05:21.615 INFO:teuthology.orchestra.run.smithi016.stdout:570 2023-06-08T04:05:21.615 INFO:teuthology.orchestra.run.smithi016.stdout:570.out 2023-06-08T04:05:21.615 INFO:teuthology.orchestra.run.smithi016.stdout:571 2023-06-08T04:05:21.616 INFO:teuthology.orchestra.run.smithi016.stdout:571.out 2023-06-08T04:05:21.616 INFO:teuthology.orchestra.run.smithi016.stdout:572 2023-06-08T04:05:21.616 INFO:teuthology.orchestra.run.smithi016.stdout:572.out 2023-06-08T04:05:21.616 INFO:teuthology.orchestra.run.smithi016.stdout:573 2023-06-08T04:05:21.616 INFO:teuthology.orchestra.run.smithi016.stdout:573.out 2023-06-08T04:05:21.616 INFO:teuthology.orchestra.run.smithi016.stdout:574 2023-06-08T04:05:21.616 INFO:teuthology.orchestra.run.smithi016.stdout:574.out 2023-06-08T04:05:21.616 INFO:teuthology.orchestra.run.smithi016.stdout:575 2023-06-08T04:05:21.617 INFO:teuthology.orchestra.run.smithi016.stdout:575.out 2023-06-08T04:05:21.617 INFO:teuthology.orchestra.run.smithi016.stdout:576 2023-06-08T04:05:21.617 INFO:teuthology.orchestra.run.smithi016.stdout:576.out 2023-06-08T04:05:21.617 INFO:teuthology.orchestra.run.smithi016.stdout:577 2023-06-08T04:05:21.617 INFO:teuthology.orchestra.run.smithi016.stdout:577.out 2023-06-08T04:05:21.617 INFO:teuthology.orchestra.run.smithi016.stdout:578 2023-06-08T04:05:21.617 INFO:teuthology.orchestra.run.smithi016.stdout:578.out 2023-06-08T04:05:21.617 INFO:teuthology.orchestra.run.smithi016.stdout:579 2023-06-08T04:05:21.618 INFO:teuthology.orchestra.run.smithi016.stdout:579.out 2023-06-08T04:05:21.618 INFO:teuthology.orchestra.run.smithi016.stdout:580 2023-06-08T04:05:21.618 INFO:teuthology.orchestra.run.smithi016.stdout:580.out 2023-06-08T04:05:21.618 INFO:teuthology.orchestra.run.smithi016.stdout:581 2023-06-08T04:05:21.618 INFO:teuthology.orchestra.run.smithi016.stdout:581.out 2023-06-08T04:05:21.618 INFO:teuthology.orchestra.run.smithi016.stdout:582 2023-06-08T04:05:21.618 INFO:teuthology.orchestra.run.smithi016.stdout:582.out 2023-06-08T04:05:21.618 INFO:teuthology.orchestra.run.smithi016.stdout:583 2023-06-08T04:05:21.619 INFO:teuthology.orchestra.run.smithi016.stdout:583.out 2023-06-08T04:05:21.619 INFO:teuthology.orchestra.run.smithi016.stdout:584 2023-06-08T04:05:21.619 INFO:teuthology.orchestra.run.smithi016.stdout:584.out 2023-06-08T04:05:21.619 INFO:teuthology.orchestra.run.smithi016.stdout:585 2023-06-08T04:05:21.619 INFO:teuthology.orchestra.run.smithi016.stdout:585.out 2023-06-08T04:05:21.619 INFO:teuthology.orchestra.run.smithi016.stdout:586 2023-06-08T04:05:21.619 INFO:teuthology.orchestra.run.smithi016.stdout:586.out 2023-06-08T04:05:21.619 INFO:teuthology.orchestra.run.smithi016.stdout:587 2023-06-08T04:05:21.620 INFO:teuthology.orchestra.run.smithi016.stdout:587.out 2023-06-08T04:05:21.620 INFO:teuthology.orchestra.run.smithi016.stdout:588 2023-06-08T04:05:21.620 INFO:teuthology.orchestra.run.smithi016.stdout:588.out 2023-06-08T04:05:21.620 INFO:teuthology.orchestra.run.smithi016.stdout:589 2023-06-08T04:05:21.620 INFO:teuthology.orchestra.run.smithi016.stdout:589.out 2023-06-08T04:05:21.620 INFO:teuthology.orchestra.run.smithi016.stdout:590 2023-06-08T04:05:21.621 INFO:teuthology.orchestra.run.smithi016.stdout:590.out 2023-06-08T04:05:21.621 INFO:teuthology.orchestra.run.smithi016.stdout:591 2023-06-08T04:05:21.621 INFO:teuthology.orchestra.run.smithi016.stdout:591.out 2023-06-08T04:05:21.621 INFO:teuthology.orchestra.run.smithi016.stdout:592 2023-06-08T04:05:21.621 INFO:teuthology.orchestra.run.smithi016.stdout:592.out 2023-06-08T04:05:21.621 INFO:teuthology.orchestra.run.smithi016.stdout:593 2023-06-08T04:05:21.621 INFO:teuthology.orchestra.run.smithi016.stdout:593.out 2023-06-08T04:05:21.621 INFO:teuthology.orchestra.run.smithi016.stdout:594 2023-06-08T04:05:21.622 INFO:teuthology.orchestra.run.smithi016.stdout:594.out 2023-06-08T04:05:21.622 INFO:teuthology.orchestra.run.smithi016.stdout:595 2023-06-08T04:05:21.622 INFO:teuthology.orchestra.run.smithi016.stdout:595.out 2023-06-08T04:05:21.622 INFO:teuthology.orchestra.run.smithi016.stdout:596 2023-06-08T04:05:21.622 INFO:teuthology.orchestra.run.smithi016.stdout:596.out 2023-06-08T04:05:21.622 INFO:teuthology.orchestra.run.smithi016.stdout:597 2023-06-08T04:05:21.622 INFO:teuthology.orchestra.run.smithi016.stdout:597.out 2023-06-08T04:05:21.622 INFO:teuthology.orchestra.run.smithi016.stdout:598 2023-06-08T04:05:21.623 INFO:teuthology.orchestra.run.smithi016.stdout:598.out 2023-06-08T04:05:21.623 INFO:teuthology.orchestra.run.smithi016.stdout:599 2023-06-08T04:05:21.623 INFO:teuthology.orchestra.run.smithi016.stdout:599.out 2023-06-08T04:05:21.623 INFO:teuthology.orchestra.run.smithi016.stdout:600 2023-06-08T04:05:21.623 INFO:teuthology.orchestra.run.smithi016.stdout:600.out 2023-06-08T04:05:21.623 INFO:teuthology.orchestra.run.smithi016.stdout:601 2023-06-08T04:05:21.623 INFO:teuthology.orchestra.run.smithi016.stdout:601.out 2023-06-08T04:05:21.623 INFO:teuthology.orchestra.run.smithi016.stdout:602 2023-06-08T04:05:21.624 INFO:teuthology.orchestra.run.smithi016.stdout:602.out 2023-06-08T04:05:21.624 INFO:teuthology.orchestra.run.smithi016.stdout:603 2023-06-08T04:05:21.624 INFO:teuthology.orchestra.run.smithi016.stdout:603.out 2023-06-08T04:05:21.624 INFO:teuthology.orchestra.run.smithi016.stdout:604 2023-06-08T04:05:21.624 INFO:teuthology.orchestra.run.smithi016.stdout:604.out 2023-06-08T04:05:21.624 INFO:teuthology.orchestra.run.smithi016.stdout:605 2023-06-08T04:05:21.624 INFO:teuthology.orchestra.run.smithi016.stdout:605.out 2023-06-08T04:05:21.624 INFO:teuthology.orchestra.run.smithi016.stdout:606 2023-06-08T04:05:21.625 INFO:teuthology.orchestra.run.smithi016.stdout:606.out 2023-06-08T04:05:21.625 INFO:teuthology.orchestra.run.smithi016.stdout:607 2023-06-08T04:05:21.625 INFO:teuthology.orchestra.run.smithi016.stdout:607.out 2023-06-08T04:05:21.625 INFO:teuthology.orchestra.run.smithi016.stdout:608 2023-06-08T04:05:21.625 INFO:teuthology.orchestra.run.smithi016.stdout:608.out 2023-06-08T04:05:21.625 INFO:teuthology.orchestra.run.smithi016.stdout:609 2023-06-08T04:05:21.625 INFO:teuthology.orchestra.run.smithi016.stdout:609.out 2023-06-08T04:05:21.626 INFO:teuthology.orchestra.run.smithi016.stdout:610 2023-06-08T04:05:21.626 INFO:teuthology.orchestra.run.smithi016.stdout:610.out 2023-06-08T04:05:21.626 INFO:teuthology.orchestra.run.smithi016.stdout:611 2023-06-08T04:05:21.626 INFO:teuthology.orchestra.run.smithi016.stdout:611.out 2023-06-08T04:05:21.626 INFO:teuthology.orchestra.run.smithi016.stdout:612 2023-06-08T04:05:21.626 INFO:teuthology.orchestra.run.smithi016.stdout:612.out 2023-06-08T04:05:21.626 INFO:teuthology.orchestra.run.smithi016.stdout:613 2023-06-08T04:05:21.626 INFO:teuthology.orchestra.run.smithi016.stdout:613.out 2023-06-08T04:05:21.627 INFO:teuthology.orchestra.run.smithi016.stdout:614 2023-06-08T04:05:21.627 INFO:teuthology.orchestra.run.smithi016.stdout:614.out 2023-06-08T04:05:21.627 INFO:teuthology.orchestra.run.smithi016.stdout:615 2023-06-08T04:05:21.627 INFO:teuthology.orchestra.run.smithi016.stdout:615.out 2023-06-08T04:05:21.627 INFO:teuthology.orchestra.run.smithi016.stdout:616 2023-06-08T04:05:21.627 INFO:teuthology.orchestra.run.smithi016.stdout:616.out 2023-06-08T04:05:21.627 INFO:teuthology.orchestra.run.smithi016.stdout:617 2023-06-08T04:05:21.627 INFO:teuthology.orchestra.run.smithi016.stdout:617.out 2023-06-08T04:05:21.628 INFO:teuthology.orchestra.run.smithi016.stdout:618 2023-06-08T04:05:21.628 INFO:teuthology.orchestra.run.smithi016.stdout:618.out 2023-06-08T04:05:21.628 INFO:teuthology.orchestra.run.smithi016.stdout:619 2023-06-08T04:05:21.628 INFO:teuthology.orchestra.run.smithi016.stdout:619.out 2023-06-08T04:05:21.628 INFO:teuthology.orchestra.run.smithi016.stdout:620 2023-06-08T04:05:21.628 INFO:teuthology.orchestra.run.smithi016.stdout:620.out 2023-06-08T04:05:21.628 INFO:teuthology.orchestra.run.smithi016.stdout:621 2023-06-08T04:05:21.629 INFO:teuthology.orchestra.run.smithi016.stdout:621.out 2023-06-08T04:05:21.629 INFO:teuthology.orchestra.run.smithi016.stdout:622 2023-06-08T04:05:21.629 INFO:teuthology.orchestra.run.smithi016.stdout:622.out 2023-06-08T04:05:21.629 INFO:teuthology.orchestra.run.smithi016.stdout:623 2023-06-08T04:05:21.629 INFO:teuthology.orchestra.run.smithi016.stdout:623.out 2023-06-08T04:05:21.629 INFO:teuthology.orchestra.run.smithi016.stdout:624 2023-06-08T04:05:21.629 INFO:teuthology.orchestra.run.smithi016.stdout:624.out 2023-06-08T04:05:21.629 INFO:teuthology.orchestra.run.smithi016.stdout:625 2023-06-08T04:05:21.630 INFO:teuthology.orchestra.run.smithi016.stdout:625.out 2023-06-08T04:05:21.630 INFO:teuthology.orchestra.run.smithi016.stdout:626 2023-06-08T04:05:21.630 INFO:teuthology.orchestra.run.smithi016.stdout:626.out 2023-06-08T04:05:21.630 INFO:teuthology.orchestra.run.smithi016.stdout:627 2023-06-08T04:05:21.630 INFO:teuthology.orchestra.run.smithi016.stdout:627.out 2023-06-08T04:05:21.630 INFO:teuthology.orchestra.run.smithi016.stdout:628 2023-06-08T04:05:21.630 INFO:teuthology.orchestra.run.smithi016.stdout:628.out 2023-06-08T04:05:21.630 INFO:teuthology.orchestra.run.smithi016.stdout:629 2023-06-08T04:05:21.631 INFO:teuthology.orchestra.run.smithi016.stdout:629.out 2023-06-08T04:05:21.631 INFO:teuthology.orchestra.run.smithi016.stdout:630 2023-06-08T04:05:21.631 INFO:teuthology.orchestra.run.smithi016.stdout:630.out 2023-06-08T04:05:21.631 INFO:teuthology.orchestra.run.smithi016.stdout:631 2023-06-08T04:05:21.631 INFO:teuthology.orchestra.run.smithi016.stdout:631.out 2023-06-08T04:05:21.631 INFO:teuthology.orchestra.run.smithi016.stdout:632 2023-06-08T04:05:21.631 INFO:teuthology.orchestra.run.smithi016.stdout:632.out 2023-06-08T04:05:21.631 INFO:teuthology.orchestra.run.smithi016.stdout:633 2023-06-08T04:05:21.632 INFO:teuthology.orchestra.run.smithi016.stdout:633.out 2023-06-08T04:05:21.632 INFO:teuthology.orchestra.run.smithi016.stdout:634 2023-06-08T04:05:21.632 INFO:teuthology.orchestra.run.smithi016.stdout:634.out 2023-06-08T04:05:21.632 INFO:teuthology.orchestra.run.smithi016.stdout:635 2023-06-08T04:05:21.632 INFO:teuthology.orchestra.run.smithi016.stdout:635.out 2023-06-08T04:05:21.632 INFO:teuthology.orchestra.run.smithi016.stdout:636 2023-06-08T04:05:21.632 INFO:teuthology.orchestra.run.smithi016.stdout:636.out 2023-06-08T04:05:21.632 INFO:teuthology.orchestra.run.smithi016.stdout:637 2023-06-08T04:05:21.633 INFO:teuthology.orchestra.run.smithi016.stdout:637.out 2023-06-08T04:05:21.633 INFO:teuthology.orchestra.run.smithi016.stdout:638 2023-06-08T04:05:21.633 INFO:teuthology.orchestra.run.smithi016.stdout:638.out 2023-06-08T04:05:21.633 INFO:teuthology.orchestra.run.smithi016.stdout:639 2023-06-08T04:05:21.633 INFO:teuthology.orchestra.run.smithi016.stdout:639.out 2023-06-08T04:05:21.633 INFO:teuthology.orchestra.run.smithi016.stdout:640 2023-06-08T04:05:21.633 INFO:teuthology.orchestra.run.smithi016.stdout:640.out 2023-06-08T04:05:21.633 INFO:teuthology.orchestra.run.smithi016.stdout:641 2023-06-08T04:05:21.634 INFO:teuthology.orchestra.run.smithi016.stdout:641.out 2023-06-08T04:05:21.634 INFO:teuthology.orchestra.run.smithi016.stdout:642 2023-06-08T04:05:21.634 INFO:teuthology.orchestra.run.smithi016.stdout:642.out 2023-06-08T04:05:21.634 INFO:teuthology.orchestra.run.smithi016.stdout:643 2023-06-08T04:05:21.634 INFO:teuthology.orchestra.run.smithi016.stdout:643.out 2023-06-08T04:05:21.634 INFO:teuthology.orchestra.run.smithi016.stdout:644 2023-06-08T04:05:21.634 INFO:teuthology.orchestra.run.smithi016.stdout:644.out 2023-06-08T04:05:21.634 INFO:teuthology.orchestra.run.smithi016.stdout:645 2023-06-08T04:05:21.635 INFO:teuthology.orchestra.run.smithi016.stdout:645.out 2023-06-08T04:05:21.635 INFO:teuthology.orchestra.run.smithi016.stdout:646 2023-06-08T04:05:21.635 INFO:teuthology.orchestra.run.smithi016.stdout:646.out 2023-06-08T04:05:21.635 INFO:teuthology.orchestra.run.smithi016.stdout:647 2023-06-08T04:05:21.635 INFO:teuthology.orchestra.run.smithi016.stdout:647.out 2023-06-08T04:05:21.635 INFO:teuthology.orchestra.run.smithi016.stdout:648 2023-06-08T04:05:21.635 INFO:teuthology.orchestra.run.smithi016.stdout:648.out 2023-06-08T04:05:21.635 INFO:teuthology.orchestra.run.smithi016.stdout:649 2023-06-08T04:05:21.636 INFO:teuthology.orchestra.run.smithi016.stdout:649.out 2023-06-08T04:05:21.636 INFO:teuthology.orchestra.run.smithi016.stdout:650 2023-06-08T04:05:21.636 INFO:teuthology.orchestra.run.smithi016.stdout:650.out 2023-06-08T04:05:21.636 INFO:teuthology.orchestra.run.smithi016.stdout:651 2023-06-08T04:05:21.636 INFO:teuthology.orchestra.run.smithi016.stdout:651.out 2023-06-08T04:05:21.636 INFO:teuthology.orchestra.run.smithi016.stdout:652 2023-06-08T04:05:21.636 INFO:teuthology.orchestra.run.smithi016.stdout:652.out 2023-06-08T04:05:21.636 INFO:teuthology.orchestra.run.smithi016.stdout:653 2023-06-08T04:05:21.637 INFO:teuthology.orchestra.run.smithi016.stdout:653.out 2023-06-08T04:05:21.637 INFO:teuthology.orchestra.run.smithi016.stdout:654 2023-06-08T04:05:21.637 INFO:teuthology.orchestra.run.smithi016.stdout:654.out 2023-06-08T04:05:21.637 INFO:teuthology.orchestra.run.smithi016.stdout:655 2023-06-08T04:05:21.637 INFO:teuthology.orchestra.run.smithi016.stdout:655.out 2023-06-08T04:05:21.637 INFO:teuthology.orchestra.run.smithi016.stdout:656 2023-06-08T04:05:21.637 INFO:teuthology.orchestra.run.smithi016.stdout:656.out 2023-06-08T04:05:21.637 INFO:teuthology.orchestra.run.smithi016.stdout:657 2023-06-08T04:05:21.638 INFO:teuthology.orchestra.run.smithi016.stdout:657.out 2023-06-08T04:05:21.638 INFO:teuthology.orchestra.run.smithi016.stdout:658 2023-06-08T04:05:21.638 INFO:teuthology.orchestra.run.smithi016.stdout:658.out 2023-06-08T04:05:21.638 INFO:teuthology.orchestra.run.smithi016.stdout:659 2023-06-08T04:05:21.638 INFO:teuthology.orchestra.run.smithi016.stdout:659.out 2023-06-08T04:05:21.638 INFO:teuthology.orchestra.run.smithi016.stdout:660 2023-06-08T04:05:21.638 INFO:teuthology.orchestra.run.smithi016.stdout:660.out 2023-06-08T04:05:21.638 INFO:teuthology.orchestra.run.smithi016.stdout:661 2023-06-08T04:05:21.639 INFO:teuthology.orchestra.run.smithi016.stdout:661.out 2023-06-08T04:05:21.639 INFO:teuthology.orchestra.run.smithi016.stdout:662 2023-06-08T04:05:21.639 INFO:teuthology.orchestra.run.smithi016.stdout:662.out 2023-06-08T04:05:21.639 INFO:teuthology.orchestra.run.smithi016.stdout:663 2023-06-08T04:05:21.639 INFO:teuthology.orchestra.run.smithi016.stdout:663.out 2023-06-08T04:05:21.639 INFO:teuthology.orchestra.run.smithi016.stdout:664 2023-06-08T04:05:21.639 INFO:teuthology.orchestra.run.smithi016.stdout:664.out 2023-06-08T04:05:21.639 INFO:teuthology.orchestra.run.smithi016.stdout:665 2023-06-08T04:05:21.640 INFO:teuthology.orchestra.run.smithi016.stdout:665.out 2023-06-08T04:05:21.640 INFO:teuthology.orchestra.run.smithi016.stdout:666 2023-06-08T04:05:21.640 INFO:teuthology.orchestra.run.smithi016.stdout:666.out 2023-06-08T04:05:21.640 INFO:teuthology.orchestra.run.smithi016.stdout:667 2023-06-08T04:05:21.640 INFO:teuthology.orchestra.run.smithi016.stdout:667.out 2023-06-08T04:05:21.640 INFO:teuthology.orchestra.run.smithi016.stdout:668 2023-06-08T04:05:21.640 INFO:teuthology.orchestra.run.smithi016.stdout:668.out 2023-06-08T04:05:21.641 INFO:teuthology.orchestra.run.smithi016.stdout:669 2023-06-08T04:05:21.641 INFO:teuthology.orchestra.run.smithi016.stdout:669.out 2023-06-08T04:05:21.641 INFO:teuthology.orchestra.run.smithi016.stdout:670 2023-06-08T04:05:21.641 INFO:teuthology.orchestra.run.smithi016.stdout:670.out 2023-06-08T04:05:21.641 INFO:teuthology.orchestra.run.smithi016.stdout:671 2023-06-08T04:05:21.641 INFO:teuthology.orchestra.run.smithi016.stdout:671.out 2023-06-08T04:05:21.641 INFO:teuthology.orchestra.run.smithi016.stdout:672 2023-06-08T04:05:21.642 INFO:teuthology.orchestra.run.smithi016.stdout:672.out 2023-06-08T04:05:21.642 INFO:teuthology.orchestra.run.smithi016.stdout:673 2023-06-08T04:05:21.642 INFO:teuthology.orchestra.run.smithi016.stdout:673.out 2023-06-08T04:05:21.642 INFO:teuthology.orchestra.run.smithi016.stdout:674 2023-06-08T04:05:21.642 INFO:teuthology.orchestra.run.smithi016.stdout:674.out 2023-06-08T04:05:21.642 INFO:teuthology.orchestra.run.smithi016.stdout:675 2023-06-08T04:05:21.643 INFO:teuthology.orchestra.run.smithi016.stdout:675.out 2023-06-08T04:05:21.643 INFO:teuthology.orchestra.run.smithi016.stdout:676 2023-06-08T04:05:21.643 INFO:teuthology.orchestra.run.smithi016.stdout:676.out 2023-06-08T04:05:21.643 INFO:teuthology.orchestra.run.smithi016.stdout:677 2023-06-08T04:05:21.644 INFO:teuthology.orchestra.run.smithi016.stdout:677.out 2023-06-08T04:05:21.644 INFO:teuthology.orchestra.run.smithi016.stdout:678 2023-06-08T04:05:21.644 INFO:teuthology.orchestra.run.smithi016.stdout:678.out 2023-06-08T04:05:21.644 INFO:teuthology.orchestra.run.smithi016.stdout:679 2023-06-08T04:05:21.645 INFO:teuthology.orchestra.run.smithi016.stdout:679.out 2023-06-08T04:05:21.645 INFO:teuthology.orchestra.run.smithi016.stdout:680 2023-06-08T04:05:21.645 INFO:teuthology.orchestra.run.smithi016.stdout:680.out 2023-06-08T04:05:21.645 INFO:teuthology.orchestra.run.smithi016.stdout:681 2023-06-08T04:05:21.645 INFO:teuthology.orchestra.run.smithi016.stdout:681.out 2023-06-08T04:05:21.645 INFO:teuthology.orchestra.run.smithi016.stdout:682 2023-06-08T04:05:21.645 INFO:teuthology.orchestra.run.smithi016.stdout:682.out 2023-06-08T04:05:21.646 INFO:teuthology.orchestra.run.smithi016.stdout:683 2023-06-08T04:05:21.646 INFO:teuthology.orchestra.run.smithi016.stdout:683.out 2023-06-08T04:05:21.646 INFO:teuthology.orchestra.run.smithi016.stdout:684 2023-06-08T04:05:21.646 INFO:teuthology.orchestra.run.smithi016.stdout:684.out 2023-06-08T04:05:21.646 INFO:teuthology.orchestra.run.smithi016.stdout:685 2023-06-08T04:05:21.647 INFO:teuthology.orchestra.run.smithi016.stdout:685.out 2023-06-08T04:05:21.647 INFO:teuthology.orchestra.run.smithi016.stdout:686 2023-06-08T04:05:21.647 INFO:teuthology.orchestra.run.smithi016.stdout:686.out 2023-06-08T04:05:21.647 INFO:teuthology.orchestra.run.smithi016.stdout:687 2023-06-08T04:05:21.647 INFO:teuthology.orchestra.run.smithi016.stdout:687.out 2023-06-08T04:05:21.647 INFO:teuthology.orchestra.run.smithi016.stdout:688 2023-06-08T04:05:21.647 INFO:teuthology.orchestra.run.smithi016.stdout:688.out 2023-06-08T04:05:21.648 INFO:teuthology.orchestra.run.smithi016.stdout:689 2023-06-08T04:05:21.648 INFO:teuthology.orchestra.run.smithi016.stdout:689.out 2023-06-08T04:05:21.648 INFO:teuthology.orchestra.run.smithi016.stdout:690 2023-06-08T04:05:21.648 INFO:teuthology.orchestra.run.smithi016.stdout:690.out 2023-06-08T04:05:21.648 INFO:teuthology.orchestra.run.smithi016.stdout:691 2023-06-08T04:05:21.648 INFO:teuthology.orchestra.run.smithi016.stdout:691.out 2023-06-08T04:05:21.648 INFO:teuthology.orchestra.run.smithi016.stdout:692 2023-06-08T04:05:21.649 INFO:teuthology.orchestra.run.smithi016.stdout:692.out 2023-06-08T04:05:21.649 INFO:teuthology.orchestra.run.smithi016.stdout:693 2023-06-08T04:05:21.649 INFO:teuthology.orchestra.run.smithi016.stdout:693.out 2023-06-08T04:05:21.649 INFO:teuthology.orchestra.run.smithi016.stdout:694 2023-06-08T04:05:21.649 INFO:teuthology.orchestra.run.smithi016.stdout:694.out 2023-06-08T04:05:21.649 INFO:teuthology.orchestra.run.smithi016.stdout:695 2023-06-08T04:05:21.649 INFO:teuthology.orchestra.run.smithi016.stdout:695.out 2023-06-08T04:05:21.649 INFO:teuthology.orchestra.run.smithi016.stdout:696 2023-06-08T04:05:21.650 INFO:teuthology.orchestra.run.smithi016.stdout:696.out 2023-06-08T04:05:21.650 INFO:teuthology.orchestra.run.smithi016.stdout:697 2023-06-08T04:05:21.650 INFO:teuthology.orchestra.run.smithi016.stdout:697.out 2023-06-08T04:05:21.650 INFO:teuthology.orchestra.run.smithi016.stdout:698 2023-06-08T04:05:21.650 INFO:teuthology.orchestra.run.smithi016.stdout:698.out 2023-06-08T04:05:21.650 INFO:teuthology.orchestra.run.smithi016.stdout:699 2023-06-08T04:05:21.650 INFO:teuthology.orchestra.run.smithi016.stdout:699.out 2023-06-08T04:05:21.650 INFO:teuthology.orchestra.run.smithi016.stdout:700 2023-06-08T04:05:21.651 INFO:teuthology.orchestra.run.smithi016.stdout:700.out 2023-06-08T04:05:21.651 INFO:teuthology.orchestra.run.smithi016.stdout:701 2023-06-08T04:05:21.651 INFO:teuthology.orchestra.run.smithi016.stdout:701.out 2023-06-08T04:05:21.651 INFO:teuthology.orchestra.run.smithi016.stdout:702 2023-06-08T04:05:21.651 INFO:teuthology.orchestra.run.smithi016.stdout:702.out 2023-06-08T04:05:21.651 INFO:teuthology.orchestra.run.smithi016.stdout:703 2023-06-08T04:05:21.651 INFO:teuthology.orchestra.run.smithi016.stdout:703.out 2023-06-08T04:05:21.651 INFO:teuthology.orchestra.run.smithi016.stdout:704 2023-06-08T04:05:21.652 INFO:teuthology.orchestra.run.smithi016.stdout:704.out 2023-06-08T04:05:21.652 INFO:teuthology.orchestra.run.smithi016.stdout:705 2023-06-08T04:05:21.652 INFO:teuthology.orchestra.run.smithi016.stdout:705.out 2023-06-08T04:05:21.652 INFO:teuthology.orchestra.run.smithi016.stdout:706 2023-06-08T04:05:21.652 INFO:teuthology.orchestra.run.smithi016.stdout:706.out 2023-06-08T04:05:21.652 INFO:teuthology.orchestra.run.smithi016.stdout:707 2023-06-08T04:05:21.652 INFO:teuthology.orchestra.run.smithi016.stdout:707.out 2023-06-08T04:05:21.653 INFO:teuthology.orchestra.run.smithi016.stdout:708 2023-06-08T04:05:21.653 INFO:teuthology.orchestra.run.smithi016.stdout:708.out 2023-06-08T04:05:21.653 INFO:teuthology.orchestra.run.smithi016.stdout:709 2023-06-08T04:05:21.653 INFO:teuthology.orchestra.run.smithi016.stdout:709.out 2023-06-08T04:05:21.653 INFO:teuthology.orchestra.run.smithi016.stdout:710 2023-06-08T04:05:21.653 INFO:teuthology.orchestra.run.smithi016.stdout:710.out 2023-06-08T04:05:21.653 INFO:teuthology.orchestra.run.smithi016.stdout:711 2023-06-08T04:05:21.653 INFO:teuthology.orchestra.run.smithi016.stdout:711.out 2023-06-08T04:05:21.654 INFO:teuthology.orchestra.run.smithi016.stdout:712 2023-06-08T04:05:21.654 INFO:teuthology.orchestra.run.smithi016.stdout:712.out 2023-06-08T04:05:21.654 INFO:teuthology.orchestra.run.smithi016.stdout:713 2023-06-08T04:05:21.654 INFO:teuthology.orchestra.run.smithi016.stdout:713.out 2023-06-08T04:05:21.654 INFO:teuthology.orchestra.run.smithi016.stdout:714 2023-06-08T04:05:21.654 INFO:teuthology.orchestra.run.smithi016.stdout:714.out 2023-06-08T04:05:21.654 INFO:teuthology.orchestra.run.smithi016.stdout:715 2023-06-08T04:05:21.654 INFO:teuthology.orchestra.run.smithi016.stdout:715.out 2023-06-08T04:05:21.655 INFO:teuthology.orchestra.run.smithi016.stdout:716 2023-06-08T04:05:21.655 INFO:teuthology.orchestra.run.smithi016.stdout:716.out 2023-06-08T04:05:21.655 INFO:teuthology.orchestra.run.smithi016.stdout:717 2023-06-08T04:05:21.655 INFO:teuthology.orchestra.run.smithi016.stdout:717.out 2023-06-08T04:05:21.655 INFO:teuthology.orchestra.run.smithi016.stdout:718 2023-06-08T04:05:21.655 INFO:teuthology.orchestra.run.smithi016.stdout:718.out 2023-06-08T04:05:21.655 INFO:teuthology.orchestra.run.smithi016.stdout:719 2023-06-08T04:05:21.655 INFO:teuthology.orchestra.run.smithi016.stdout:719.out 2023-06-08T04:05:21.656 INFO:teuthology.orchestra.run.smithi016.stdout:720 2023-06-08T04:05:21.656 INFO:teuthology.orchestra.run.smithi016.stdout:720.out 2023-06-08T04:05:21.656 INFO:teuthology.orchestra.run.smithi016.stdout:721 2023-06-08T04:05:21.656 INFO:teuthology.orchestra.run.smithi016.stdout:721.out 2023-06-08T04:05:21.656 INFO:teuthology.orchestra.run.smithi016.stdout:722 2023-06-08T04:05:21.656 INFO:teuthology.orchestra.run.smithi016.stdout:722.out 2023-06-08T04:05:21.656 INFO:teuthology.orchestra.run.smithi016.stdout:723 2023-06-08T04:05:21.656 INFO:teuthology.orchestra.run.smithi016.stdout:723.out 2023-06-08T04:05:21.657 INFO:teuthology.orchestra.run.smithi016.stdout:724 2023-06-08T04:05:21.657 INFO:teuthology.orchestra.run.smithi016.stdout:724.out 2023-06-08T04:05:21.657 INFO:teuthology.orchestra.run.smithi016.stdout:725 2023-06-08T04:05:21.657 INFO:teuthology.orchestra.run.smithi016.stdout:725.out 2023-06-08T04:05:21.657 INFO:teuthology.orchestra.run.smithi016.stdout:726 2023-06-08T04:05:21.657 INFO:teuthology.orchestra.run.smithi016.stdout:726.out 2023-06-08T04:05:21.657 INFO:teuthology.orchestra.run.smithi016.stdout:727 2023-06-08T04:05:21.657 INFO:teuthology.orchestra.run.smithi016.stdout:727.out 2023-06-08T04:05:21.658 INFO:teuthology.orchestra.run.smithi016.stdout:group.list 2023-06-08T04:05:21.658 INFO:teuthology.orchestra.run.smithi016.stdout:Makefile 2023-06-08T04:05:21.659 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-06-08T04:05:22.151 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:05:22.163 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:05:22.164 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:05:22.167 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:05:22.167 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:05:29.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:05:29.200 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:05:29.927 INFO:teuthology.orchestra.run.smithi016.stdout:generic/001 7s 2023-06-08T04:05:29.939 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/001 2023-06-08T04:05:29.939 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:05:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:05:30.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:05:30.089 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-06-08T04:05:30.538 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:05:30.550 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:05:30.551 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:05:30.554 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:05:30.554 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:05:31.431 INFO:teuthology.orchestra.run.smithi016.stdout:generic/002 1s 2023-06-08T04:05:31.444 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/002 2023-06-08T04:05:31.444 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:05:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:05:31.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:05:31.531 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-06-08T04:05:31.980 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:05:31.992 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:05:31.993 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:05:31.996 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:05:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:05:32.500 INFO:teuthology.orchestra.run.smithi016.stdout:generic/003 [not run] atime not maintained by ceph 2023-06-08T04:05:32.510 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/003 2023-06-08T04:05:32.510 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/003 2023-06-08T04:05:32.510 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:05:32.516 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:05:32.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:05:32.552 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-06-08T04:05:33.001 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:05:33.013 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:05:33.014 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:05:33.016 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:05:33.017 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:05:33.525 INFO:teuthology.orchestra.run.smithi016.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-08T04:05:33.535 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/004 2023-06-08T04:05:33.535 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/004 2023-06-08T04:05:33.535 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:05:33.541 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:05:33.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:05:33.571 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-06-08T04:05:34.025 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:05:34.037 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:05:34.038 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:05:34.041 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:05:34.041 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:05:34.782 INFO:teuthology.orchestra.run.smithi016.stdout:generic/005 0s 2023-06-08T04:05:34.794 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/005 2023-06-08T04:05:34.795 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:05:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:05:34.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:05:34.898 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-06-08T04:05:35.347 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:05:35.360 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:05:35.361 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:05:35.363 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:05:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:05:59.350 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:05:59.357 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:06:00.198 INFO:teuthology.orchestra.run.smithi016.stdout:generic/006 25s 2023-06-08T04:06:00.222 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/006 2023-06-08T04:06:00.222 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:06:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:06:00.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:06:00.495 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-06-08T04:06:00.945 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:06:00.958 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:06:00.959 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:06:00.961 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:06:00.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:06:29.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:06:29.545 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:06:53.962 INFO:teuthology.orchestra.run.smithi016.stdout:generic/007 51s 2023-06-08T04:06:55.100 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/007 2023-06-08T04:06:55.100 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:06:55.107 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:06:55.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:06:55.232 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-06-08T04:06:55.698 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:06:55.711 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:06:55.712 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:06:55.715 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:06:55.715 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:06:56.331 INFO:teuthology.orchestra.run.smithi016.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-08T04:06:56.341 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/008 2023-06-08T04:06:56.341 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/008 2023-06-08T04:06:56.341 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:06:56.347 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:06:56.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:06:56.404 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-06-08T04:06:56.854 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:06:56.866 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:06:56.867 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:06:56.869 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:06:56.869 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:06:57.480 INFO:teuthology.orchestra.run.smithi016.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-08T04:06:57.490 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/009 2023-06-08T04:06:57.490 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/009 2023-06-08T04:06:57.490 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:06:57.496 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:06:57.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:06:57.542 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-06-08T04:06:57.987 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:06:58.000 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:06:58.001 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:06:58.003 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:06:58.003 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:06:58.485 INFO:teuthology.orchestra.run.smithi016.stdout:generic/010 [not run] /tmp/tmp.KjWTKBMgZ7xfstests-dev/src/dbtest not built 2023-06-08T04:06:58.494 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/010 2023-06-08T04:06:58.495 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/010 2023-06-08T04:06:58.495 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:06:58.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:06:58.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:06:58.544 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-06-08T04:06:58.993 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:06:59.006 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:06:59.007 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:06:59.009 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:06:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:06:59.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:06:59.723 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:07:29.931 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:07:29.936 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:07:30.327 INFO:teuthology.orchestra.run.smithi016.stdout:generic/011 31s 2023-06-08T04:07:30.919 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/011 2023-06-08T04:07:30.920 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:07:30.926 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:07:31.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:07:31.158 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-06-08T04:07:31.655 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:07:31.668 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:07:31.669 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:07:31.671 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:07:31.672 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:07:32.645 INFO:teuthology.orchestra.run.smithi016.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:07:32.656 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/012 2023-06-08T04:07:32.656 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/012 2023-06-08T04:07:32.656 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:07:32.662 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:07:32.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:07:32.744 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-06-08T04:07:33.197 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:07:33.209 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:07:33.210 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:07:33.213 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:07:33.213 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:08:01.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:08:01.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:08:31.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:08:31.632 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:08:41.048 INFO:teuthology.orchestra.run.smithi016.stdout:generic/013 68s 2023-06-08T04:08:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/013 2023-06-08T04:08:41.507 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:08:41.516 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:08:41.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:08:41.588 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-06-08T04:08:42.248 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:08:42.268 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:08:42.270 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:08:42.274 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:08:42.274 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:09:01.776 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:09:01.784 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:09:31.929 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:09:31.935 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:10:02.084 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:10:02.094 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:10:32.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:10:32.252 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:11:02.422 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:11:02.430 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:11:32.607 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:11:32.617 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:12:02.781 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:12:02.792 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:12:32.966 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:12:32.972 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:13:03.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:13:03.144 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:13:08.975 INFO:teuthology.orchestra.run.smithi016.stdout:generic/014 266s 2023-06-08T04:13:08.997 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/014 2023-06-08T04:13:08.997 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:13:09.007 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:09.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:13:09.068 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-06-08T04:13:09.746 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:13:09.765 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:13:09.767 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:13:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:13:09.772 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:10.501 INFO:teuthology.orchestra.run.smithi016.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T04:13:10.515 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/015 2023-06-08T04:13:10.515 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/015 2023-06-08T04:13:10.515 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:13:10.528 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:10.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:13:10.582 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-06-08T04:13:11.228 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:13:11.245 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:13:11.246 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:13:11.250 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:13:11.250 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:12.240 INFO:teuthology.orchestra.run.smithi016.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:13:12.257 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/016 2023-06-08T04:13:12.257 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/016 2023-06-08T04:13:12.257 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:13:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:12.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:13:12.420 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-06-08T04:13:13.239 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:13:13.252 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:13:13.254 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:13:13.257 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:13:13.258 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:14.084 INFO:teuthology.orchestra.run.smithi016.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-08T04:13:14.100 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/017 2023-06-08T04:13:14.100 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/017 2023-06-08T04:13:14.100 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:13:14.112 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:14.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:13:14.179 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-06-08T04:13:14.841 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:13:14.860 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:13:14.861 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:13:14.865 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:13:14.865 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:15.827 INFO:teuthology.orchestra.run.smithi016.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-06-08T04:13:15.858 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/018 2023-06-08T04:13:15.858 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/018 2023-06-08T04:13:15.859 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:13:15.869 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:15.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:13:15.923 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-06-08T04:13:16.565 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:13:16.587 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:13:16.588 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:13:16.592 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:13:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:17.323 INFO:teuthology.orchestra.run.smithi016.stdout:generic/019 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:13:17.337 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/019 2023-06-08T04:13:17.337 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/019 2023-06-08T04:13:17.337 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:13:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:17.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:13:17.396 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-06-08T04:13:18.091 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:13:18.112 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:13:18.112 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:13:18.116 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:13:18.116 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:26.596 INFO:teuthology.orchestra.run.smithi016.stdout:generic/020 8s 2023-06-08T04:13:26.615 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/020 2023-06-08T04:13:26.615 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:13:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:26.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:13:26.764 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-06-08T04:13:27.596 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:13:27.611 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:13:27.613 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:13:27.620 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:13:27.620 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:28.616 INFO:teuthology.orchestra.run.smithi016.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:13:28.630 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/021 2023-06-08T04:13:28.630 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/021 2023-06-08T04:13:28.630 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:13:28.642 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:28.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:13:28.781 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-06-08T04:13:29.615 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:13:29.631 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:13:29.633 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:13:29.637 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:13:29.637 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:30.618 INFO:teuthology.orchestra.run.smithi016.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:13:30.631 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/022 2023-06-08T04:13:30.632 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/022 2023-06-08T04:13:30.632 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:13:30.641 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:30.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:13:30.781 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-06-08T04:13:31.592 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:13:31.608 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:13:31.610 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:13:31.614 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:13:31.614 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:13:34.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:13:34.305 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:14:04.455 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:14:04.461 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:14:07.747 INFO:teuthology.orchestra.run.smithi016.stdout:generic/023 36s 2023-06-08T04:14:07.766 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/023 2023-06-08T04:14:07.766 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:07.774 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:07.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:07.905 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-06-08T04:14:08.729 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:08.751 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:08.752 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:08.756 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:09.516 INFO:teuthology.orchestra.run.smithi016.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-08T04:14:09.531 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/024 2023-06-08T04:14:09.531 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/024 2023-06-08T04:14:09.532 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:09.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:09.681 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-06-08T04:14:10.547 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:10.564 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:10.565 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:10.569 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:10.569 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:11.334 INFO:teuthology.orchestra.run.smithi016.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-08T04:14:11.351 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/025 2023-06-08T04:14:11.351 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/025 2023-06-08T04:14:11.352 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:11.359 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:11.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:11.503 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-06-08T04:14:12.307 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:12.322 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:12.324 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:12.327 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:12.327 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:13.136 INFO:teuthology.orchestra.run.smithi016.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-06-08T04:14:13.155 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/026 2023-06-08T04:14:13.156 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/026 2023-06-08T04:14:13.156 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:13.169 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:13.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:13.240 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-06-08T04:14:13.926 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:13.944 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:13.945 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:13.949 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:13.949 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:14.666 INFO:teuthology.orchestra.run.smithi016.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T04:14:14.680 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/027 2023-06-08T04:14:14.680 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/027 2023-06-08T04:14:14.681 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:14.692 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:14.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:14.741 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-06-08T04:14:15.409 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:15.426 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:15.427 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:15.433 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:15.433 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:21.221 INFO:teuthology.orchestra.run.smithi016.stdout:generic/028 6s 2023-06-08T04:14:21.240 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/028 2023-06-08T04:14:21.241 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:21.250 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:21.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:21.309 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-06-08T04:14:22.008 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:22.028 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:22.029 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:22.032 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:26.862 INFO:teuthology.orchestra.run.smithi016.stdout:generic/029 4s 2023-06-08T04:14:26.880 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/029 2023-06-08T04:14:26.880 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:26.887 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:26.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:26.924 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-06-08T04:14:27.587 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:27.613 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:27.615 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:27.618 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:27.618 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:29.936 INFO:teuthology.orchestra.run.smithi016.stdout:generic/030 2s 2023-06-08T04:14:29.958 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/030 2023-06-08T04:14:29.958 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:30.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:30.001 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-06-08T04:14:30.696 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:30.715 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:30.717 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:30.721 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:30.721 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:31.646 INFO:teuthology.orchestra.run.smithi016.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-08T04:14:31.658 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/031 2023-06-08T04:14:31.659 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/031 2023-06-08T04:14:31.659 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:31.671 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:31.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:31.736 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-06-08T04:14:32.453 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:32.472 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:32.473 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:32.478 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:32.478 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:33.229 INFO:teuthology.orchestra.run.smithi016.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:14:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/032 2023-06-08T04:14:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/032 2023-06-08T04:14:33.243 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:33.255 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:33.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:33.322 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-06-08T04:14:34.010 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:34.027 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:34.029 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:34.032 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:34.033 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:34.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:14:34.596 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:14:34.946 INFO:teuthology.orchestra.run.smithi016.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-08T04:14:34.961 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/033 2023-06-08T04:14:34.961 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/033 2023-06-08T04:14:34.961 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:34.973 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:35.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:35.038 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-06-08T04:14:35.740 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:35.754 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:35.755 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:35.759 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:35.760 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:36.514 INFO:teuthology.orchestra.run.smithi016.stdout:generic/034 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:14:36.529 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/034 2023-06-08T04:14:36.530 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/034 2023-06-08T04:14:36.530 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:36.539 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:36.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:36.586 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-06-08T04:14:37.266 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:37.283 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:37.284 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:37.287 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:37.287 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:38.157 INFO:teuthology.orchestra.run.smithi016.stdout:generic/035 1s 2023-06-08T04:14:38.177 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/035 2023-06-08T04:14:38.177 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:38.186 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:38.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:38.311 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-06-08T04:14:39.170 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:39.188 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:39.190 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:39.193 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:50.164 INFO:teuthology.orchestra.run.smithi016.stdout:generic/036 11s 2023-06-08T04:14:50.182 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/036 2023-06-08T04:14:50.183 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:14:50.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:14:50.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:14:50.354 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-06-08T04:14:51.162 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:14:51.179 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:14:51.181 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:14:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:14:51.185 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:02.350 INFO:teuthology.orchestra.run.smithi016.stdout:generic/037 11s 2023-06-08T04:15:02.389 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/037 2023-06-08T04:15:02.390 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:02.395 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:02.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:02.416 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-06-08T04:15:02.866 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:02.878 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:02.879 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:02.882 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:02.882 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:03.406 INFO:teuthology.orchestra.run.smithi016.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:15:03.416 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/038 2023-06-08T04:15:03.416 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/038 2023-06-08T04:15:03.416 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:03.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:03.465 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-06-08T04:15:03.919 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:03.932 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:03.933 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:03.935 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:04.471 INFO:teuthology.orchestra.run.smithi016.stdout:generic/039 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:15:04.481 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/039 2023-06-08T04:15:04.481 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/039 2023-06-08T04:15:04.481 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:04.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:04.529 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-06-08T04:15:04.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:15:04.740 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:15:04.983 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:04.996 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:04.997 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:04.999 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:04.999 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:05.546 INFO:teuthology.orchestra.run.smithi016.stdout:generic/040 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:15:05.556 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/040 2023-06-08T04:15:05.556 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/040 2023-06-08T04:15:05.556 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:05.562 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:05.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:05.602 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-06-08T04:15:06.055 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:06.067 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:06.069 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:06.071 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:06.071 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:06.621 INFO:teuthology.orchestra.run.smithi016.stdout:generic/041 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:15:06.631 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/041 2023-06-08T04:15:06.631 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/041 2023-06-08T04:15:06.631 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:06.637 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:06.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:06.681 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-06-08T04:15:07.132 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:07.144 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:07.145 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:07.148 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:07.148 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:07.798 INFO:teuthology.orchestra.run.smithi016.stdout:generic/042 [not run] ceph does not support shutdown 2023-06-08T04:15:07.822 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/042 2023-06-08T04:15:07.822 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/042 2023-06-08T04:15:07.823 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:07.828 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:07.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:07.873 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-06-08T04:15:08.320 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:08.333 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:08.334 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:08.336 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:08.337 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:08.991 INFO:teuthology.orchestra.run.smithi016.stdout:generic/043 [not run] ceph does not support shutdown 2023-06-08T04:15:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/043 2023-06-08T04:15:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/043 2023-06-08T04:15:09.017 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:09.023 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:09.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:09.060 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-06-08T04:15:09.522 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:09.534 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:09.535 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:09.538 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:10.189 INFO:teuthology.orchestra.run.smithi016.stdout:generic/044 [not run] ceph does not support shutdown 2023-06-08T04:15:10.213 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/044 2023-06-08T04:15:10.214 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/044 2023-06-08T04:15:10.214 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:10.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:10.257 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-06-08T04:15:10.703 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:10.715 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:10.716 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:10.719 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:10.719 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:11.362 INFO:teuthology.orchestra.run.smithi016.stdout:generic/045 [not run] ceph does not support shutdown 2023-06-08T04:15:11.394 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/045 2023-06-08T04:15:11.395 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/045 2023-06-08T04:15:11.395 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:11.400 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:11.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:11.437 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-06-08T04:15:11.891 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:11.903 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:11.904 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:11.907 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:11.907 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:12.552 INFO:teuthology.orchestra.run.smithi016.stdout:generic/046 [not run] ceph does not support shutdown 2023-06-08T04:15:12.581 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/046 2023-06-08T04:15:12.581 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/046 2023-06-08T04:15:12.581 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:12.587 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:12.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:12.623 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-06-08T04:15:13.072 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:13.085 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:13.086 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:13.088 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:13.088 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:13.724 INFO:teuthology.orchestra.run.smithi016.stdout:generic/047 [not run] ceph does not support shutdown 2023-06-08T04:15:13.755 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/047 2023-06-08T04:15:13.755 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/047 2023-06-08T04:15:13.756 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:13.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:13.794 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-06-08T04:15:14.244 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:14.257 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:14.258 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:14.260 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:14.909 INFO:teuthology.orchestra.run.smithi016.stdout:generic/048 [not run] ceph does not support shutdown 2023-06-08T04:15:14.938 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/048 2023-06-08T04:15:14.938 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/048 2023-06-08T04:15:14.939 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:14.944 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:14.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:14.981 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-06-08T04:15:15.440 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:15.452 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:15.454 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:15.456 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:15.456 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:16.117 INFO:teuthology.orchestra.run.smithi016.stdout:generic/049 [not run] ceph does not support shutdown 2023-06-08T04:15:16.145 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/049 2023-06-08T04:15:16.145 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/049 2023-06-08T04:15:16.145 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:16.151 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:16.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:16.188 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-06-08T04:15:16.645 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:16.657 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:16.658 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:16.661 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:16.661 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:17.314 INFO:teuthology.orchestra.run.smithi016.stdout:generic/050 [not run] ceph does not support shutdown 2023-06-08T04:15:17.343 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/050 2023-06-08T04:15:17.344 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/050 2023-06-08T04:15:17.344 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:17.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:17.386 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-06-08T04:15:17.838 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:17.850 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:17.851 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:17.854 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:17.854 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:18.526 INFO:teuthology.orchestra.run.smithi016.stdout:generic/051 [not run] ceph does not support shutdown 2023-06-08T04:15:18.536 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/051 2023-06-08T04:15:18.536 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/051 2023-06-08T04:15:18.536 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:18.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:18.576 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-06-08T04:15:19.028 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:19.040 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:19.041 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:19.043 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:19.044 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:19.693 INFO:teuthology.orchestra.run.smithi016.stdout:generic/052 [not run] ceph does not support shutdown 2023-06-08T04:15:19.725 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/052 2023-06-08T04:15:19.725 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/052 2023-06-08T04:15:19.725 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:19.731 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:19.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:19.770 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-06-08T04:15:20.223 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:20.236 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:20.237 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:20.239 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:20.240 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:21.335 INFO:teuthology.orchestra.run.smithi016.stdout:generic/053 1s 2023-06-08T04:15:21.372 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/053 2023-06-08T04:15:21.372 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:21.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:21.460 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-06-08T04:15:21.952 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:21.964 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:21.965 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:21.968 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:21.968 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:22.639 INFO:teuthology.orchestra.run.smithi016.stdout:generic/054 [not run] ceph does not support shutdown 2023-06-08T04:15:22.669 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/054 2023-06-08T04:15:22.669 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/054 2023-06-08T04:15:22.669 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:22.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:22.718 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-06-08T04:15:23.166 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:23.178 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:23.179 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:23.182 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:23.182 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:23.838 INFO:teuthology.orchestra.run.smithi016.stdout:generic/055 [not run] ceph does not support shutdown 2023-06-08T04:15:23.866 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/055 2023-06-08T04:15:23.867 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/055 2023-06-08T04:15:23.867 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:23.872 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:23.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:23.910 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-06-08T04:15:24.360 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:24.372 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:24.373 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:24.375 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:24.376 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:24.912 INFO:teuthology.orchestra.run.smithi016.stdout:generic/056 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:15:24.922 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/056 2023-06-08T04:15:24.922 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/056 2023-06-08T04:15:24.923 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:24.928 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:24.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:24.967 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-06-08T04:15:25.415 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:25.427 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:25.428 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:25.431 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:25.431 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:25.965 INFO:teuthology.orchestra.run.smithi016.stdout:generic/057 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:15:25.975 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/057 2023-06-08T04:15:25.975 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/057 2023-06-08T04:15:25.975 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:25.982 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:26.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:26.022 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-06-08T04:15:26.474 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:26.487 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:26.488 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:26.490 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:26.490 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:27.152 INFO:teuthology.orchestra.run.smithi016.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:15:27.162 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/058 2023-06-08T04:15:27.162 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/058 2023-06-08T04:15:27.162 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:27.168 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:27.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:27.262 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-06-08T04:15:27.925 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:27.937 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:27.938 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:27.941 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:27.941 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:28.460 INFO:teuthology.orchestra.run.smithi016.stdout:generic/059 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:15:28.470 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/059 2023-06-08T04:15:28.470 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/059 2023-06-08T04:15:28.470 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:28.476 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:28.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:28.513 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-06-08T04:15:28.963 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:28.975 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:28.976 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:28.979 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:28.979 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:29.625 INFO:teuthology.orchestra.run.smithi016.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:15:29.635 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/060 2023-06-08T04:15:29.635 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/060 2023-06-08T04:15:29.635 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:29.641 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:29.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:29.760 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-06-08T04:15:30.392 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:30.404 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:30.405 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:30.407 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:30.408 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:31.069 INFO:teuthology.orchestra.run.smithi016.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:15:31.079 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/061 2023-06-08T04:15:31.079 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/061 2023-06-08T04:15:31.079 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:31.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:31.215 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-06-08T04:15:31.834 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:31.846 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:31.847 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:31.850 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:31.850 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:34.498 INFO:teuthology.orchestra.run.smithi016.stdout:generic/062 2s 2023-06-08T04:15:34.533 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/062 2023-06-08T04:15:34.533 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:34.558 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:34.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:34.635 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-06-08T04:15:34.891 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:15:34.896 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:15:35.146 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:35.159 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:35.160 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:35.163 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:35.163 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:35.882 INFO:teuthology.orchestra.run.smithi016.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:15:35.892 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/063 2023-06-08T04:15:35.892 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/063 2023-06-08T04:15:35.892 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:35.898 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:36.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:36.086 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-06-08T04:15:36.675 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:36.688 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:36.689 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:36.691 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:36.691 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:37.223 INFO:teuthology.orchestra.run.smithi016.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-08T04:15:37.233 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/064 2023-06-08T04:15:37.233 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/064 2023-06-08T04:15:37.233 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:37.239 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:37.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:37.280 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-06-08T04:15:37.737 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:37.749 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:37.750 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:37.753 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:37.753 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:38.279 INFO:teuthology.orchestra.run.smithi016.stdout:generic/065 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:15:38.289 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/065 2023-06-08T04:15:38.289 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/065 2023-06-08T04:15:38.289 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:38.295 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:38.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:38.340 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-06-08T04:15:38.801 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:38.813 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:38.814 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:38.817 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:38.817 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:39.340 INFO:teuthology.orchestra.run.smithi016.stdout:generic/066 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:15:39.350 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/066 2023-06-08T04:15:39.350 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/066 2023-06-08T04:15:39.350 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:39.356 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:39.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:39.394 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-06-08T04:15:39.845 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:39.858 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:39.859 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:39.861 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:39.862 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:40.431 INFO:teuthology.orchestra.run.smithi016.stdout:generic/067 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:15:40.441 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/067 2023-06-08T04:15:40.441 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/067 2023-06-08T04:15:40.441 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:40.447 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:40.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:40.486 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-06-08T04:15:40.944 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:40.957 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:40.958 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:40.960 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:40.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:41.496 INFO:teuthology.orchestra.run.smithi016.stdout:generic/068 [not run] ceph does not support freezing 2023-06-08T04:15:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/068 2023-06-08T04:15:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/068 2023-06-08T04:15:41.506 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:15:41.512 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:15:41.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:15:41.547 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-06-08T04:15:41.995 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:15:42.007 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:15:42.008 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:15:42.011 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:15:42.011 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:16:03.011 INFO:teuthology.orchestra.run.smithi016.stdout:generic/069 20s 2023-06-08T04:16:03.060 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/069 2023-06-08T04:16:03.060 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:16:03.071 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:16:03.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:03.120 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-06-08T04:16:03.599 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:16:03.611 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:16:03.612 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:16:03.615 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:16:03.615 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:16:05.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:16:05.044 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:16:26.800 INFO:teuthology.orchestra.run.smithi016.stdout:generic/070 23s 2023-06-08T04:16:26.822 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/070 2023-06-08T04:16:26.822 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:16:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:16:26.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:26.990 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-06-08T04:16:27.777 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:16:27.793 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:16:27.795 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:16:27.798 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:16:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:16:28.582 INFO:teuthology.orchestra.run.smithi016.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-08T04:16:28.598 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/071 2023-06-08T04:16:28.598 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/071 2023-06-08T04:16:28.599 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:16:28.608 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:16:28.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:28.669 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-06-08T04:16:29.333 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:16:29.351 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:16:29.353 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:16:29.357 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:16:29.357 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:16:30.252 INFO:teuthology.orchestra.run.smithi016.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-08T04:16:30.266 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/072 2023-06-08T04:16:30.267 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/072 2023-06-08T04:16:30.267 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:16:30.274 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:16:30.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:30.338 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-06-08T04:16:31.009 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:16:31.028 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:16:31.030 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:16:31.035 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:16:31.035 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:16:31.798 INFO:teuthology.orchestra.run.smithi016.stdout:generic/073 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:16:31.813 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/073 2023-06-08T04:16:31.814 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/073 2023-06-08T04:16:31.814 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:16:31.823 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:16:31.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:16:31.875 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-06-08T04:16:32.537 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:16:32.558 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:16:32.559 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:16:32.565 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:16:32.565 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:16:35.185 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:16:35.198 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:17:05.386 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:17:05.413 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:17:19.124 INFO:teuthology.orchestra.run.smithi016.stdout:generic/074 47s 2023-06-08T04:17:19.151 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/074 2023-06-08T04:17:19.151 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:17:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:17:19.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:17:19.806 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-06-08T04:17:20.622 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:17:20.637 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:17:20.639 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:17:20.642 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:17:20.642 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:17:35.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:17:35.706 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:17:36.069 INFO:tasks.ceph.mds.a.smithi016.stderr:2023-06-08T04:17:36.066+0000 7f1b71df9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 212421) UID: 0 2023-06-08T04:17:36.070 INFO:tasks.ceph.mds.c.smithi016.stderr:2023-06-08T04:17:36.066+0000 7f392d3f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 212421) UID: 0 2023-06-08T04:17:53.445 INFO:teuthology.orchestra.run.smithi016.stdout:generic/075 33s 2023-06-08T04:17:53.465 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/075 2023-06-08T04:17:53.465 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:17:53.476 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:17:53.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:17:53.591 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-06-08T04:17:54.547 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:17:54.568 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:17:54.571 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:17:54.575 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:17:54.575 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:17:55.405 INFO:teuthology.orchestra.run.smithi016.stdout:generic/076 [not run] require 172.21.15.16:6789:/scratch to be local device 2023-06-08T04:17:55.421 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/076 2023-06-08T04:17:55.421 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/076 2023-06-08T04:17:55.422 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:17:55.434 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:17:55.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:17:55.489 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-06-08T04:17:56.233 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:17:56.256 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:17:56.257 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:17:56.262 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:17:56.262 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:17:58.232 INFO:teuthology.orchestra.run.smithi016.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T04:17:58.247 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/077 2023-06-08T04:17:58.247 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/077 2023-06-08T04:17:58.248 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:17:58.258 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:17:58.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:17:58.478 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-06-08T04:17:59.436 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:17:59.456 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:17:59.458 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:17:59.463 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:17:59.463 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:00.355 INFO:teuthology.orchestra.run.smithi016.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-08T04:18:00.371 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/078 2023-06-08T04:18:00.371 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/078 2023-06-08T04:18:00.371 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:18:00.383 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:00.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:18:00.543 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-06-08T04:18:01.521 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:18:01.541 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:18:01.543 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:18:01.546 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:18:01.546 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:02.370 INFO:teuthology.orchestra.run.smithi016.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-08T04:18:02.387 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/079 2023-06-08T04:18:02.388 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/079 2023-06-08T04:18:02.388 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:18:02.397 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:02.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:18:02.480 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-06-08T04:18:03.283 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:18:03.304 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:18:03.307 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:18:03.310 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:18:03.311 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:06.225 INFO:teuthology.orchestra.run.smithi016.stdout:generic/080 3s 2023-06-08T04:18:06.249 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/080 2023-06-08T04:18:06.249 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:18:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:06.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:18:06.360 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-06-08T04:18:07.139 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:18:07.162 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:18:07.164 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:18:07.168 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:18:07.168 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:08.051 INFO:teuthology.orchestra.run.smithi016.stdout:generic/081 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:18:08.067 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/081 2023-06-08T04:18:08.067 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/081 2023-06-08T04:18:08.068 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:18:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:08.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:18:08.141 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-06-08T04:18:08.960 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:18:08.983 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:18:08.985 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:18:08.988 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:18:08.988 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:09.878 INFO:teuthology.orchestra.run.smithi016.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-08T04:18:09.898 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/082 2023-06-08T04:18:09.898 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/082 2023-06-08T04:18:09.899 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:18:09.910 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:09.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:18:09.964 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-06-08T04:18:10.753 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:18:10.779 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:18:10.780 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:18:10.784 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:18:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:11.584 INFO:teuthology.orchestra.run.smithi016.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-08T04:18:11.597 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/083 2023-06-08T04:18:11.598 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/083 2023-06-08T04:18:11.598 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:18:11.611 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:11.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:18:11.667 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-06-08T04:18:12.410 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:18:12.431 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:18:12.432 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:18:12.435 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:18:12.435 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:14.170 INFO:tasks.ceph.mds.a.smithi016.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7f1b6a5ea700 time 2023-06-08T04:18:14.167263+0000 2023-06-08T04:18:14.170 INFO:tasks.ceph.mds.a.smithi016.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-08T04:18:14.171 INFO:tasks.ceph.mds.a.smithi016.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T04:18:14.172 INFO:tasks.ceph.mds.a.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1b80aa9dbf] 2023-06-08T04:18:14.172 INFO:tasks.ceph.mds.a.smithi016.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7f1b80aa9f85] 2023-06-08T04:18:14.172 INFO:tasks.ceph.mds.a.smithi016.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x562bd4e49432] 2023-06-08T04:18:14.172 INFO:tasks.ceph.mds.a.smithi016.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x562bd4e3134c] 2023-06-08T04:18:14.172 INFO:tasks.ceph.mds.a.smithi016.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x562bd4e3a187] 2023-06-08T04:18:14.172 INFO:tasks.ceph.mds.a.smithi016.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x562bd4e3e9ff] 2023-06-08T04:18:14.172 INFO:tasks.ceph.mds.a.smithi016.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x562bd4c90bd7] 2023-06-08T04:18:14.173 INFO:tasks.ceph.mds.a.smithi016.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x562bd4c91a80] 2023-06-08T04:18:14.173 INFO:tasks.ceph.mds.a.smithi016.stderr: 9: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2ea) [0x562bd4cafc3a] 2023-06-08T04:18:14.173 INFO:tasks.ceph.mds.a.smithi016.stderr: 10: (MDSContext::complete(int)+0x5f) [0x562bd4f7818f] 2023-06-08T04:18:14.173 INFO:tasks.ceph.mds.a.smithi016.stderr: 11: (MDSIOContextBase::complete(int)+0x524) [0x562bd4f78914] 2023-06-08T04:18:14.173 INFO:tasks.ceph.mds.a.smithi016.stderr: 12: (MDSLogContextBase::complete(int)+0x5b) [0x562bd4f78ccb] 2023-06-08T04:18:14.173 INFO:tasks.ceph.mds.a.smithi016.stderr: 13: (Finisher::finisher_thread_entry()+0x18d) [0x7f1b80b4d7cd] 2023-06-08T04:18:14.173 INFO:tasks.ceph.mds.a.smithi016.stderr: 14: /lib64/libpthread.so.0(+0x81ca) [0x7f1b7ee081ca] 2023-06-08T04:18:14.174 INFO:tasks.ceph.mds.a.smithi016.stderr: 15: clone() 2023-06-08T04:18:14.174 INFO:tasks.ceph.mds.a.smithi016.stderr:2023-06-08T04:18:14.168+0000 7f1b6a5ea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7f1b6a5ea700 time 2023-06-08T04:18:14.167263+0000 2023-06-08T04:18:14.174 INFO:tasks.ceph.mds.a.smithi016.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-08T04:18:14.174 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:14.174 INFO:tasks.ceph.mds.a.smithi016.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T04:18:14.174 INFO:tasks.ceph.mds.a.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1b80aa9dbf] 2023-06-08T04:18:14.174 INFO:tasks.ceph.mds.a.smithi016.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7f1b80aa9f85] 2023-06-08T04:18:14.174 INFO:tasks.ceph.mds.a.smithi016.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x562bd4e49432] 2023-06-08T04:18:14.175 INFO:tasks.ceph.mds.a.smithi016.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x562bd4e3134c] 2023-06-08T04:18:14.175 INFO:tasks.ceph.mds.a.smithi016.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x562bd4e3a187] 2023-06-08T04:18:14.175 INFO:tasks.ceph.mds.a.smithi016.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x562bd4e3e9ff] 2023-06-08T04:18:14.175 INFO:tasks.ceph.mds.a.smithi016.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x562bd4c90bd7] 2023-06-08T04:18:14.175 INFO:tasks.ceph.mds.a.smithi016.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x562bd4c91a80] 2023-06-08T04:18:14.175 INFO:tasks.ceph.mds.a.smithi016.stderr: 9: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2ea) [0x562bd4cafc3a] 2023-06-08T04:18:14.175 INFO:tasks.ceph.mds.a.smithi016.stderr: 10: (MDSContext::complete(int)+0x5f) [0x562bd4f7818f] 2023-06-08T04:18:14.175 INFO:tasks.ceph.mds.a.smithi016.stderr: 11: (MDSIOContextBase::complete(int)+0x524) [0x562bd4f78914] 2023-06-08T04:18:14.176 INFO:tasks.ceph.mds.a.smithi016.stderr: 12: (MDSLogContextBase::complete(int)+0x5b) [0x562bd4f78ccb] 2023-06-08T04:18:14.176 INFO:tasks.ceph.mds.a.smithi016.stderr: 13: (Finisher::finisher_thread_entry()+0x18d) [0x7f1b80b4d7cd] 2023-06-08T04:18:14.176 INFO:tasks.ceph.mds.a.smithi016.stderr: 14: /lib64/libpthread.so.0(+0x81ca) [0x7f1b7ee081ca] 2023-06-08T04:18:14.176 INFO:tasks.ceph.mds.a.smithi016.stderr: 15: clone() 2023-06-08T04:18:14.176 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:14.176 INFO:tasks.ceph.mds.a.smithi016.stderr:*** Caught signal (Aborted) ** 2023-06-08T04:18:14.176 INFO:tasks.ceph.mds.a.smithi016.stderr: in thread 7f1b6a5ea700 thread_name:MR_Finisher 2023-06-08T04:18:14.177 INFO:tasks.ceph.mds.a.smithi016.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T04:18:14.177 INFO:tasks.ceph.mds.a.smithi016.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f1b7ee12cf0] 2023-06-08T04:18:14.177 INFO:tasks.ceph.mds.a.smithi016.stderr: 2: gsignal() 2023-06-08T04:18:14.177 INFO:tasks.ceph.mds.a.smithi016.stderr: 3: abort() 2023-06-08T04:18:14.178 INFO:tasks.ceph.mds.a.smithi016.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1b80aa9e19] 2023-06-08T04:18:14.178 INFO:tasks.ceph.mds.a.smithi016.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7f1b80aa9f85] 2023-06-08T04:18:14.178 INFO:tasks.ceph.mds.a.smithi016.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x562bd4e49432] 2023-06-08T04:18:14.178 INFO:tasks.ceph.mds.a.smithi016.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x562bd4e3134c] 2023-06-08T04:18:14.178 INFO:tasks.ceph.mds.a.smithi016.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x562bd4e3a187] 2023-06-08T04:18:14.178 INFO:tasks.ceph.mds.a.smithi016.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x562bd4e3e9ff] 2023-06-08T04:18:14.178 INFO:tasks.ceph.mds.a.smithi016.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x562bd4c90bd7] 2023-06-08T04:18:14.178 INFO:tasks.ceph.mds.a.smithi016.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x562bd4c91a80] 2023-06-08T04:18:14.179 INFO:tasks.ceph.mds.a.smithi016.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2ea) [0x562bd4cafc3a] 2023-06-08T04:18:14.179 INFO:tasks.ceph.mds.a.smithi016.stderr: 13: (MDSContext::complete(int)+0x5f) [0x562bd4f7818f] 2023-06-08T04:18:14.179 INFO:tasks.ceph.mds.a.smithi016.stderr: 14: (MDSIOContextBase::complete(int)+0x524) [0x562bd4f78914] 2023-06-08T04:18:14.179 INFO:tasks.ceph.mds.a.smithi016.stderr: 15: (MDSLogContextBase::complete(int)+0x5b) [0x562bd4f78ccb] 2023-06-08T04:18:14.179 INFO:tasks.ceph.mds.a.smithi016.stderr: 16: (Finisher::finisher_thread_entry()+0x18d) [0x7f1b80b4d7cd] 2023-06-08T04:18:14.179 INFO:tasks.ceph.mds.a.smithi016.stderr: 17: /lib64/libpthread.so.0(+0x81ca) [0x7f1b7ee081ca] 2023-06-08T04:18:14.179 INFO:tasks.ceph.mds.a.smithi016.stderr: 18: clone() 2023-06-08T04:18:14.180 INFO:tasks.ceph.mds.a.smithi016.stderr:2023-06-08T04:18:14.170+0000 7f1b6a5ea700 -1 *** Caught signal (Aborted) ** 2023-06-08T04:18:14.180 INFO:tasks.ceph.mds.a.smithi016.stderr: in thread 7f1b6a5ea700 thread_name:MR_Finisher 2023-06-08T04:18:14.180 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:14.180 INFO:tasks.ceph.mds.a.smithi016.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T04:18:14.180 INFO:tasks.ceph.mds.a.smithi016.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f1b7ee12cf0] 2023-06-08T04:18:14.180 INFO:tasks.ceph.mds.a.smithi016.stderr: 2: gsignal() 2023-06-08T04:18:14.180 INFO:tasks.ceph.mds.a.smithi016.stderr: 3: abort() 2023-06-08T04:18:14.180 INFO:tasks.ceph.mds.a.smithi016.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1b80aa9e19] 2023-06-08T04:18:14.181 INFO:tasks.ceph.mds.a.smithi016.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7f1b80aa9f85] 2023-06-08T04:18:14.181 INFO:tasks.ceph.mds.a.smithi016.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x562bd4e49432] 2023-06-08T04:18:14.181 INFO:tasks.ceph.mds.a.smithi016.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x562bd4e3134c] 2023-06-08T04:18:14.181 INFO:tasks.ceph.mds.a.smithi016.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x562bd4e3a187] 2023-06-08T04:18:14.181 INFO:tasks.ceph.mds.a.smithi016.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x562bd4e3e9ff] 2023-06-08T04:18:14.181 INFO:tasks.ceph.mds.a.smithi016.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x562bd4c90bd7] 2023-06-08T04:18:14.181 INFO:tasks.ceph.mds.a.smithi016.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x562bd4c91a80] 2023-06-08T04:18:14.181 INFO:tasks.ceph.mds.a.smithi016.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2ea) [0x562bd4cafc3a] 2023-06-08T04:18:14.182 INFO:tasks.ceph.mds.a.smithi016.stderr: 13: (MDSContext::complete(int)+0x5f) [0x562bd4f7818f] 2023-06-08T04:18:14.182 INFO:tasks.ceph.mds.a.smithi016.stderr: 14: (MDSIOContextBase::complete(int)+0x524) [0x562bd4f78914] 2023-06-08T04:18:14.182 INFO:tasks.ceph.mds.a.smithi016.stderr: 15: (MDSLogContextBase::complete(int)+0x5b) [0x562bd4f78ccb] 2023-06-08T04:18:14.182 INFO:tasks.ceph.mds.a.smithi016.stderr: 16: (Finisher::finisher_thread_entry()+0x18d) [0x7f1b80b4d7cd] 2023-06-08T04:18:14.182 INFO:tasks.ceph.mds.a.smithi016.stderr: 17: /lib64/libpthread.so.0(+0x81ca) [0x7f1b7ee081ca] 2023-06-08T04:18:14.182 INFO:tasks.ceph.mds.a.smithi016.stderr: 18: clone() 2023-06-08T04:18:14.182 INFO:tasks.ceph.mds.a.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-08T04:18:14.182 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:14.214 INFO:tasks.ceph.mds.a.smithi016.stderr: -3> 2023-06-08T04:18:14.168+0000 7f1b6a5ea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7f1b6a5ea700 time 2023-06-08T04:18:14.167263+0000 2023-06-08T04:18:14.215 INFO:tasks.ceph.mds.a.smithi016.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-08T04:18:14.215 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:14.215 INFO:tasks.ceph.mds.a.smithi016.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T04:18:14.215 INFO:tasks.ceph.mds.a.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1b80aa9dbf] 2023-06-08T04:18:14.215 INFO:tasks.ceph.mds.a.smithi016.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7f1b80aa9f85] 2023-06-08T04:18:14.215 INFO:tasks.ceph.mds.a.smithi016.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x562bd4e49432] 2023-06-08T04:18:14.215 INFO:tasks.ceph.mds.a.smithi016.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x562bd4e3134c] 2023-06-08T04:18:14.215 INFO:tasks.ceph.mds.a.smithi016.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x562bd4e3a187] 2023-06-08T04:18:14.216 INFO:tasks.ceph.mds.a.smithi016.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x562bd4e3e9ff] 2023-06-08T04:18:14.216 INFO:tasks.ceph.mds.a.smithi016.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x562bd4c90bd7] 2023-06-08T04:18:14.216 INFO:tasks.ceph.mds.a.smithi016.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x562bd4c91a80] 2023-06-08T04:18:14.216 INFO:tasks.ceph.mds.a.smithi016.stderr: 9: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2ea) [0x562bd4cafc3a] 2023-06-08T04:18:14.216 INFO:tasks.ceph.mds.a.smithi016.stderr: 10: (MDSContext::complete(int)+0x5f) [0x562bd4f7818f] 2023-06-08T04:18:14.216 INFO:tasks.ceph.mds.a.smithi016.stderr: 11: (MDSIOContextBase::complete(int)+0x524) [0x562bd4f78914] 2023-06-08T04:18:14.216 INFO:tasks.ceph.mds.a.smithi016.stderr: 12: (MDSLogContextBase::complete(int)+0x5b) [0x562bd4f78ccb] 2023-06-08T04:18:14.217 INFO:tasks.ceph.mds.a.smithi016.stderr: 13: (Finisher::finisher_thread_entry()+0x18d) [0x7f1b80b4d7cd] 2023-06-08T04:18:14.217 INFO:tasks.ceph.mds.a.smithi016.stderr: 14: /lib64/libpthread.so.0(+0x81ca) [0x7f1b7ee081ca] 2023-06-08T04:18:14.217 INFO:tasks.ceph.mds.a.smithi016.stderr: 15: clone() 2023-06-08T04:18:14.217 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:14.217 INFO:tasks.ceph.mds.a.smithi016.stderr: 0> 2023-06-08T04:18:14.170+0000 7f1b6a5ea700 -1 *** Caught signal (Aborted) ** 2023-06-08T04:18:14.217 INFO:tasks.ceph.mds.a.smithi016.stderr: in thread 7f1b6a5ea700 thread_name:MR_Finisher 2023-06-08T04:18:14.217 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:14.217 INFO:tasks.ceph.mds.a.smithi016.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T04:18:14.218 INFO:tasks.ceph.mds.a.smithi016.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f1b7ee12cf0] 2023-06-08T04:18:14.218 INFO:tasks.ceph.mds.a.smithi016.stderr: 2: gsignal() 2023-06-08T04:18:14.218 INFO:tasks.ceph.mds.a.smithi016.stderr: 3: abort() 2023-06-08T04:18:14.218 INFO:tasks.ceph.mds.a.smithi016.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1b80aa9e19] 2023-06-08T04:18:14.218 INFO:tasks.ceph.mds.a.smithi016.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7f1b80aa9f85] 2023-06-08T04:18:14.218 INFO:tasks.ceph.mds.a.smithi016.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x562bd4e49432] 2023-06-08T04:18:14.218 INFO:tasks.ceph.mds.a.smithi016.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x562bd4e3134c] 2023-06-08T04:18:14.218 INFO:tasks.ceph.mds.a.smithi016.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x562bd4e3a187] 2023-06-08T04:18:14.219 INFO:tasks.ceph.mds.a.smithi016.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x562bd4e3e9ff] 2023-06-08T04:18:14.219 INFO:tasks.ceph.mds.a.smithi016.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x562bd4c90bd7] 2023-06-08T04:18:14.219 INFO:tasks.ceph.mds.a.smithi016.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x562bd4c91a80] 2023-06-08T04:18:14.219 INFO:tasks.ceph.mds.a.smithi016.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2ea) [0x562bd4cafc3a] 2023-06-08T04:18:14.219 INFO:tasks.ceph.mds.a.smithi016.stderr: 13: (MDSContext::complete(int)+0x5f) [0x562bd4f7818f] 2023-06-08T04:18:14.219 INFO:tasks.ceph.mds.a.smithi016.stderr: 14: (MDSIOContextBase::complete(int)+0x524) [0x562bd4f78914] 2023-06-08T04:18:14.219 INFO:tasks.ceph.mds.a.smithi016.stderr: 15: (MDSLogContextBase::complete(int)+0x5b) [0x562bd4f78ccb] 2023-06-08T04:18:14.220 INFO:tasks.ceph.mds.a.smithi016.stderr: 16: (Finisher::finisher_thread_entry()+0x18d) [0x7f1b80b4d7cd] 2023-06-08T04:18:14.220 INFO:tasks.ceph.mds.a.smithi016.stderr: 17: /lib64/libpthread.so.0(+0x81ca) [0x7f1b7ee081ca] 2023-06-08T04:18:14.220 INFO:tasks.ceph.mds.a.smithi016.stderr: 18: clone() 2023-06-08T04:18:14.220 INFO:tasks.ceph.mds.a.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-08T04:18:14.220 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:14.240 INFO:tasks.ceph.mds.a.smithi016.stderr: -61> 2023-06-08T04:18:14.168+0000 7f1b6a5ea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7f1b6a5ea700 time 2023-06-08T04:18:14.167263+0000 2023-06-08T04:18:14.240 INFO:tasks.ceph.mds.a.smithi016.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-08T04:18:14.240 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:14.240 INFO:tasks.ceph.mds.a.smithi016.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T04:18:14.240 INFO:tasks.ceph.mds.a.smithi016.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1b80aa9dbf] 2023-06-08T04:18:14.241 INFO:tasks.ceph.mds.a.smithi016.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7f1b80aa9f85] 2023-06-08T04:18:14.241 INFO:tasks.ceph.mds.a.smithi016.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x562bd4e49432] 2023-06-08T04:18:14.241 INFO:tasks.ceph.mds.a.smithi016.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x562bd4e3134c] 2023-06-08T04:18:14.241 INFO:tasks.ceph.mds.a.smithi016.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x562bd4e3a187] 2023-06-08T04:18:14.241 INFO:tasks.ceph.mds.a.smithi016.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x562bd4e3e9ff] 2023-06-08T04:18:14.241 INFO:tasks.ceph.mds.a.smithi016.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x562bd4c90bd7] 2023-06-08T04:18:14.241 INFO:tasks.ceph.mds.a.smithi016.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x562bd4c91a80] 2023-06-08T04:18:14.242 INFO:tasks.ceph.mds.a.smithi016.stderr: 9: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2ea) [0x562bd4cafc3a] 2023-06-08T04:18:14.242 INFO:tasks.ceph.mds.a.smithi016.stderr: 10: (MDSContext::complete(int)+0x5f) [0x562bd4f7818f] 2023-06-08T04:18:14.242 INFO:tasks.ceph.mds.a.smithi016.stderr: 11: (MDSIOContextBase::complete(int)+0x524) [0x562bd4f78914] 2023-06-08T04:18:14.242 INFO:tasks.ceph.mds.a.smithi016.stderr: 12: (MDSLogContextBase::complete(int)+0x5b) [0x562bd4f78ccb] 2023-06-08T04:18:14.242 INFO:tasks.ceph.mds.a.smithi016.stderr: 13: (Finisher::finisher_thread_entry()+0x18d) [0x7f1b80b4d7cd] 2023-06-08T04:18:14.242 INFO:tasks.ceph.mds.a.smithi016.stderr: 14: /lib64/libpthread.so.0(+0x81ca) [0x7f1b7ee081ca] 2023-06-08T04:18:14.242 INFO:tasks.ceph.mds.a.smithi016.stderr: 15: clone() 2023-06-08T04:18:14.243 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:14.243 INFO:tasks.ceph.mds.a.smithi016.stderr: -58> 2023-06-08T04:18:14.170+0000 7f1b6a5ea700 -1 *** Caught signal (Aborted) ** 2023-06-08T04:18:14.243 INFO:tasks.ceph.mds.a.smithi016.stderr: in thread 7f1b6a5ea700 thread_name:MR_Finisher 2023-06-08T04:18:14.243 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:14.243 INFO:tasks.ceph.mds.a.smithi016.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-08T04:18:14.243 INFO:tasks.ceph.mds.a.smithi016.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f1b7ee12cf0] 2023-06-08T04:18:14.243 INFO:tasks.ceph.mds.a.smithi016.stderr: 2: gsignal() 2023-06-08T04:18:14.243 INFO:tasks.ceph.mds.a.smithi016.stderr: 3: abort() 2023-06-08T04:18:14.244 INFO:tasks.ceph.mds.a.smithi016.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1b80aa9e19] 2023-06-08T04:18:14.244 INFO:tasks.ceph.mds.a.smithi016.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7f1b80aa9f85] 2023-06-08T04:18:14.244 INFO:tasks.ceph.mds.a.smithi016.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x562bd4e49432] 2023-06-08T04:18:14.244 INFO:tasks.ceph.mds.a.smithi016.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x562bd4e3134c] 2023-06-08T04:18:14.244 INFO:tasks.ceph.mds.a.smithi016.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x562bd4e3a187] 2023-06-08T04:18:14.244 INFO:tasks.ceph.mds.a.smithi016.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x562bd4e3e9ff] 2023-06-08T04:18:14.244 INFO:tasks.ceph.mds.a.smithi016.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x562bd4c90bd7] 2023-06-08T04:18:14.245 INFO:tasks.ceph.mds.a.smithi016.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x562bd4c91a80] 2023-06-08T04:18:14.245 INFO:tasks.ceph.mds.a.smithi016.stderr: 12: (Server::_unlink_local_finish(boost::intrusive_ptr&, CDentry*, CDentry*, unsigned long)+0x2ea) [0x562bd4cafc3a] 2023-06-08T04:18:14.245 INFO:tasks.ceph.mds.a.smithi016.stderr: 13: (MDSContext::complete(int)+0x5f) [0x562bd4f7818f] 2023-06-08T04:18:14.245 INFO:tasks.ceph.mds.a.smithi016.stderr: 14: (MDSIOContextBase::complete(int)+0x524) [0x562bd4f78914] 2023-06-08T04:18:14.245 INFO:tasks.ceph.mds.a.smithi016.stderr: 15: (MDSLogContextBase::complete(int)+0x5b) [0x562bd4f78ccb] 2023-06-08T04:18:14.245 INFO:tasks.ceph.mds.a.smithi016.stderr: 16: (Finisher::finisher_thread_entry()+0x18d) [0x7f1b80b4d7cd] 2023-06-08T04:18:14.245 INFO:tasks.ceph.mds.a.smithi016.stderr: 17: /lib64/libpthread.so.0(+0x81ca) [0x7f1b7ee081ca] 2023-06-08T04:18:14.245 INFO:tasks.ceph.mds.a.smithi016.stderr: 18: clone() 2023-06-08T04:18:14.246 INFO:tasks.ceph.mds.a.smithi016.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-08T04:18:14.246 INFO:tasks.ceph.mds.a.smithi016.stderr: 2023-06-08T04:18:17.880 INFO:tasks.ceph.mds.a.smithi016.stderr:daemon-helper: command crashed with signal 6 2023-06-08T04:18:23.837 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-06-08T04:18:30.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-06-08T04:18:37.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-06-08T04:18:39.599 INFO:teuthology.orchestra.run.smithi016.stdout:generic/084 27s 2023-06-08T04:18:39.670 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/084 2023-06-08T04:18:39.670 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:18:39.692 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:39.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:18:39.741 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-06-08T04:18:40.526 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:18:40.543 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:18:40.544 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:18:40.549 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:18:40.549 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:41.468 INFO:teuthology.orchestra.run.smithi016.stdout:generic/085 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-06-08T04:18:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/085 2023-06-08T04:18:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/085 2023-06-08T04:18:41.485 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:18:41.494 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:41.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:18:41.555 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-06-08T04:18:42.343 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:18:42.362 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:18:42.365 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:18:42.369 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:18:42.369 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:43.028 INFO:tasks.ceph.mds.d.smithi169.stderr:2023-06-08T04:18:43.024+0000 7f076c3f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-08T04:18:43.287 INFO:teuthology.orchestra.run.smithi016.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-08T04:18:43.305 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/086 2023-06-08T04:18:43.306 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/086 2023-06-08T04:18:43.306 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:18:43.314 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:43.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:18:43.384 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-06-08T04:18:43.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-06-08T04:18:44.147 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:18:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:18:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:18:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:18:44.178 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:45.240 INFO:teuthology.orchestra.run.smithi016.stdout:generic/087 1s 2023-06-08T04:18:45.363 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/087 2023-06-08T04:18:45.363 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:18:45.375 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:45.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:18:45.557 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-06-08T04:18:46.486 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:18:46.506 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:18:46.508 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:18:46.516 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:18:46.516 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:47.454 INFO:teuthology.orchestra.run.smithi016.stdout:generic/088 1s 2023-06-08T04:18:47.479 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/088 2023-06-08T04:18:47.479 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-06-08T04:18:47.491 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:47.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-08T04:18:47.626 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.KjWTKBMgZ7xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-06-08T04:18:48.528 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-06-08T04:18:48.550 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:21:52 UTC 2023 2023-06-08T04:18:48.552 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-06-08T04:18:48.555 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQB8UoFkFmREGRAAGnMdwxOr/HYVS8mYlqU7QQ== -o context=system_u:object_r:root_t:s0 172.21.15.16:6789:/scratch /tmp/tmp.K0myYlkvcNscratch 2023-06-08T04:18:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:18:50.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~26s 2023-06-08T04:18:56.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~33s 2023-06-08T04:19:03.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~40s 2023-06-08T04:19:10.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~46s 2023-06-08T04:19:16.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~53s 2023-06-08T04:19:23.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~59s 2023-06-08T04:19:29.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~66s 2023-06-08T04:19:36.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~73s 2023-06-08T04:19:43.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~79s 2023-06-08T04:19:49.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~86s 2023-06-08T04:19:56.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~93s 2023-06-08T04:20:02.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~99s 2023-06-08T04:20:09.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~106s 2023-06-08T04:20:16.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~112s 2023-06-08T04:20:22.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~119s 2023-06-08T04:20:29.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~126s 2023-06-08T04:20:34.307 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:20:34.312 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:20:36.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~132s 2023-06-08T04:20:42.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~139s 2023-06-08T04:20:49.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~145s 2023-06-08T04:20:55.850 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~152s 2023-06-08T04:21:02.459 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~159s 2023-06-08T04:21:04.522 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:21:04.527 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:21:09.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~165s 2023-06-08T04:21:15.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~172s 2023-06-08T04:21:22.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~178s 2023-06-08T04:21:28.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~185s 2023-06-08T04:21:34.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:21:34.632 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:21:35.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~192s 2023-06-08T04:21:42.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~198s 2023-06-08T04:21:48.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~205s 2023-06-08T04:21:55.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~211s 2023-06-08T04:22:01.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~218s 2023-06-08T04:22:04.725 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:22:04.729 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:22:08.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~225s 2023-06-08T04:22:15.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~231s 2023-06-08T04:22:21.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~238s 2023-06-08T04:22:28.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~245s 2023-06-08T04:22:34.831 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:22:34.837 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:22:34.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~251s 2023-06-08T04:22:41.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~258s 2023-06-08T04:22:48.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~264s 2023-06-08T04:22:54.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~271s 2023-06-08T04:23:01.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~278s 2023-06-08T04:23:06.103 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:23:06.108 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:23:06.378 INFO:tasks.ceph.mds.b.smithi169.stderr:2023-06-08T04:23:06.374+0000 7f18e13f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117300) UID: 0 2023-06-08T04:23:06.379 INFO:tasks.ceph.mds.d.smithi169.stderr:2023-06-08T04:23:06.374+0000 7f07703f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117300) UID: 0 2023-06-08T04:23:08.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~284s 2023-06-08T04:23:14.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~291s 2023-06-08T04:23:21.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~297s 2023-06-08T04:23:27.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~304s 2023-06-08T04:23:27.832 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-06-08T04:23:27.832 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:23:27.832 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:23:27.880 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:23:27.881 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:23:27.968 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-08T04:23:28.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.210+0000 7f5f3f7ff700 1 Processor -- start 2023-06-08T04:23:28.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.211+0000 7f5f3f7ff700 1 -- start start 2023-06-08T04:23:28.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.212+0000 7f5f3f7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f380ce0e0 0x7f5f38165440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:28.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.212+0000 7f5f3f7ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f38070c90 con 0x7f5f3815a770 2023-06-08T04:23:28.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.212+0000 7f5f3f7ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f380c9110 con 0x7f5f3815b250 2023-06-08T04:23:28.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.212+0000 7f5f3f7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380cbd30 con 0x7f5f380ce0e0 2023-06-08T04:23:28.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.212+0000 7f5f3d59b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5f3815a770 0x7f5f3815ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51154/0 (socket says 172.21.15.16:51154) 2023-06-08T04:23:28.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.212+0000 7f5f3d59b700 1 -- 172.21.15.16:0/3573460764 learned_addr learned my addr 172.21.15.16:0/3573460764 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:23:28.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.212+0000 7f5f3dd9c700 1 --2- 172.21.15.16:0/3573460764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f380ce0e0 0x7f5f38165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:28.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.212+0000 7f5f2ffff700 1 -- 172.21.15.16:0/3573460764 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335110938 0 0) 0x7f5f38070c90 con 0x7f5f3815a770 2023-06-08T04:23:28.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.213+0000 7f5f2ffff700 1 -- 172.21.15.16:0/3573460764 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f240035b0 con 0x7f5f3815a770 2023-06-08T04:23:28.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.213+0000 7f5f2ffff700 1 -- 172.21.15.16:0/3573460764 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669560669 0 0) 0x7f5f380c9110 con 0x7f5f3815b250 2023-06-08T04:23:28.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.213+0000 7f5f2ffff700 1 -- 172.21.15.16:0/3573460764 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f38070c90 con 0x7f5f3815b250 2023-06-08T04:23:28.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.213+0000 7f5f3dd9c700 1 -- 172.21.15.16:0/3573460764 >> v1:172.21.15.169:6789/0 conn(0x7f5f3815b250 legacy=0x7f5f38161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:28.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.213+0000 7f5f3dd9c700 1 -- 172.21.15.16:0/3573460764 >> v1:172.21.15.16:6789/0 conn(0x7f5f3815a770 legacy=0x7f5f3815ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:28.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.213+0000 7f5f3dd9c700 1 -- 172.21.15.16:0/3573460764 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f38070ee0 con 0x7f5f380ce0e0 2023-06-08T04:23:28.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.213+0000 7f5f3dd9c700 1 --2- 172.21.15.16:0/3573460764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f380ce0e0 0x7f5f38165440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009dc0 tx=0x7f5f3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d17c450d255faf9 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:28.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.213+0000 7f5f2ffff700 1 -- 172.21.15.16:0/3573460764 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3000e070 con 0x7f5f380ce0e0 2023-06-08T04:23:28.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.213+0000 7f5f2ffff700 1 -- 172.21.15.16:0/3573460764 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000bb20 con 0x7f5f380ce0e0 2023-06-08T04:23:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.213+0000 7f5f2ffff700 1 -- 172.21.15.16:0/3573460764 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30012430 con 0x7f5f380ce0e0 2023-06-08T04:23:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.214+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/3573460764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f380ce0e0 msgr2=0x7f5f38165440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:28.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.214+0000 7f5f3f7ff700 1 --2- 172.21.15.16:0/3573460764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f380ce0e0 0x7f5f38165440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009dc0 tx=0x7f5f3000b330 comp rx=0 tx=0).stop 2023-06-08T04:23:28.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.214+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/3573460764 shutdown_connections 2023-06-08T04:23:28.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.214+0000 7f5f3f7ff700 1 --2- 172.21.15.16:0/3573460764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f380ce0e0 0x7f5f38165440 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:28.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.214+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/3573460764 >> 172.21.15.16:0/3573460764 conn(0x7f5f3806aa40 msgr2=0x7f5f380b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:28.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.214+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/3573460764 shutdown_connections 2023-06-08T04:23:28.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.214+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/3573460764 wait complete. 2023-06-08T04:23:28.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.216+0000 7f5f3f7ff700 1 Processor -- start 2023-06-08T04:23:28.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.216+0000 7f5f3f7ff700 1 -- start start 2023-06-08T04:23:28.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.217+0000 7f5f3f7ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f380ce0e0 0x7f5f381f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:28.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.217+0000 7f5f3f7ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f3815a770 0x7f5f381f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:28.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.217+0000 7f5f3f7ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f3815b250 0x7f5f381593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:28.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.217+0000 7f5f3f7ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3806db80 con 0x7f5f380ce0e0 2023-06-08T04:23:28.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.217+0000 7f5f3f7ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f381f2480 con 0x7f5f3815a770 2023-06-08T04:23:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.217+0000 7f5f3f7ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f381f2760 con 0x7f5f3815b250 2023-06-08T04:23:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.217+0000 7f5f3d59b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f380ce0e0 0x7f5f381f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.217+0000 7f5f3d59b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f380ce0e0 0x7f5f381f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57142/0 (socket says 172.21.15.16:57142) 2023-06-08T04:23:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.217+0000 7f5f3d59b700 1 -- 172.21.15.16:0/1812142145 learned_addr learned my addr 172.21.15.16:0/1812142145 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:23:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.217+0000 7f5f3cd9a700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f3815a770 0x7f5f381f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.217+0000 7f5f3dd9c700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f3815b250 0x7f5f381593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.218+0000 7f5f3d59b700 1 -- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f3815b250 msgr2=0x7f5f381593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.218+0000 7f5f3d59b700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f3815b250 0x7f5f381593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:28.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.218+0000 7f5f3d59b700 1 -- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f3815a770 msgr2=0x7f5f381f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:28.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.218+0000 7f5f3d59b700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f3815a770 0x7f5f381f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:28.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.218+0000 7f5f3d59b700 1 -- 172.21.15.16:0/1812142145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30009a70 con 0x7f5f380ce0e0 2023-06-08T04:23:28.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.218+0000 7f5f3d59b700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f380ce0e0 0x7f5f381f1e40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400c700 tx=0x7f5f3400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:28.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.218+0000 7f5f2dffb700 1 -- 172.21.15.16:0/1812142145 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34005d70 con 0x7f5f380ce0e0 2023-06-08T04:23:28.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.218+0000 7f5f2dffb700 1 -- 172.21.15.16:0/1812142145 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f340070d0 con 0x7f5f380ce0e0 2023-06-08T04:23:28.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.218+0000 7f5f2dffb700 1 -- 172.21.15.16:0/1812142145 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34007440 con 0x7f5f380ce0e0 2023-06-08T04:23:28.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.218+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/1812142145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f381f2a40 con 0x7f5f380ce0e0 2023-06-08T04:23:28.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.219+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/1812142145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f381f62e0 con 0x7f5f380ce0e0 2023-06-08T04:23:28.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.220+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/1812142145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f38066d50 con 0x7f5f380ce0e0 2023-06-08T04:23:28.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.221+0000 7f5f2dffb700 1 -- 172.21.15.16:0/1812142145 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f340075a0 con 0x7f5f380ce0e0 2023-06-08T04:23:28.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.222+0000 7f5f2dffb700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5f1c06ace0 0x7f5f1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:28.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.222+0000 7f5f2dffb700 1 -- 172.21.15.16:0/1812142145 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f5f340888a0 con 0x7f5f380ce0e0 2023-06-08T04:23:28.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.222+0000 7f5f3cd9a700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5f1c06ace0 0x7f5f1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:28.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.223+0000 7f5f3cd9a700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5f1c06ace0 0x7f5f1c06d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f380af0f0 tx=0x7f5f28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:28.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.228+0000 7f5f2dffb700 1 -- 172.21.15.16:0/1812142145 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5f340538e0 con 0x7f5f380ce0e0 2023-06-08T04:23:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.616+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/1812142145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f380740e0 con 0x7f5f380ce0e0 2023-06-08T04:23:28.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.628+0000 7f5f2dffb700 1 -- 172.21.15.16:0/1812142145 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18447 (secure 0 0 0) 0x7f5f34017020 con 0x7f5f380ce0e0 2023-06-08T04:23:28.647 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-08T04:23:28.647 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":38,"fsid":"e063be5d-be19-46d2-af9e-e986de4a0b1c","created":"2023-06-08T04:01:36.835026+0000","modified":"2023-06-08T04:18:27.032004+0000","last_up_change":"2023-06-08T04:01:48.713277+0000","last_in_change":"2023-06-08T04:01:40.334174+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-08T04:01:49.573506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-08T04:01:50.241129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-08T04:03:09.272435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-08T04:03:10.551045+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0378ae44-ec40-4e27-a6c3-58647f58db99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6801","nonce":704029040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6803","nonce":704029040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6807","nonce":704029040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":704029040},{"type":"v1","addr":"172.21.15.16:6805","nonce":704029040}]},"public_addr":"172.21.15.16:6801/704029040","cluster_addr":"172.21.15.16:6803/704029040","heartbeat_back_addr":"172.21.15.16:6807/704029040","heartbeat_front_addr":"172.21.15.16:6805/704029040","state":["exists","up"]},{"osd":1,"uuid":"db3f3b63-738f-4ed8-bb23-440e10922610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6809","nonce":4017547986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6811","nonce":4017547986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6815","nonce":4017547986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":4017547986},{"type":"v1","addr":"172.21.15.16:6813","nonce":4017547986}]},"public_addr":"172.21.15.16:6809/4017547986","cluster_addr":"172.21.15.16:6811/4017547986","heartbeat_back_addr":"172.21.15.16:6815/4017547986","heartbeat_front_addr":"172.21.15.16:6813/4017547986","state":["exists","up"]},{"osd":2,"uuid":"8ae38eac-16e1-43a4-96f8-2aef6d82963b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6823","nonce":251692641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6827","nonce":251692641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6831","nonce":251692641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":251692641},{"type":"v1","addr":"172.21.15.16:6829","nonce":251692641}]},"public_addr":"172.21.15.16:6823/251692641","cluster_addr":"172.21.15.16:6827/251692641","heartbeat_back_addr":"172.21.15.16:6831/251692641","heartbeat_front_addr":"172.21.15.16:6829/251692641","state":["exists","up"]},{"osd":3,"uuid":"7520a9ec-fda8-434d-bbcd-7c1045ed46cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6817","nonce":1847064506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6819","nonce":1847064506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6826","nonce":1847064506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1847064506},{"type":"v1","addr":"172.21.15.16:6822","nonce":1847064506}]},"public_addr":"172.21.15.16:6817/1847064506","cluster_addr":"172.21.15.16:6819/1847064506","heartbeat_back_addr":"172.21.15.16:6826/1847064506","heartbeat_front_addr":"172.21.15.16:6822/1847064506","state":["exists","up"]},{"osd":4,"uuid":"e578cf78-6df5-4e44-aa6c-497af796b6e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6801","nonce":3777279651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6803","nonce":3777279651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6807","nonce":3777279651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3777279651},{"type":"v1","addr":"172.21.15.169:6805","nonce":3777279651}]},"public_addr":"172.21.15.169:6801/3777279651","cluster_addr":"172.21.15.169:6803/3777279651","heartbeat_back_addr":"172.21.15.169:6807/3777279651","heartbeat_front_addr":"172.21.15.169:6805/3777279651","state":["exists","up"]},{"osd":5,"uuid":"195828e6-c2a1-43a1-a172-fada96c4cd98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6817","nonce":210051049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6819","nonce":210051049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6823","nonce":210051049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":210051049},{"type":"v1","addr":"172.21.15.169:6821","nonce":210051049}]},"public_addr":"172.21.15.169:6817/210051049","cluster_addr":"172.21.15.169:6819/210051049","heartbeat_back_addr":"172.21.15.169:6823/210051049","heartbeat_front_addr":"172.21.15.169:6821/210051049","state":["exists","up"]},{"osd":6,"uuid":"8f6f1127-bb27-4cde-b275-769e074a2a24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6809","nonce":2490026649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6811","nonce":2490026649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6815","nonce":2490026649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2490026649},{"type":"v1","addr":"172.21.15.169:6813","nonce":2490026649}]},"public_addr":"172.21.15.169:6809/2490026649","cluster_addr":"172.21.15.169:6811/2490026649","heartbeat_back_addr":"172.21.15.169:6815/2490026649","heartbeat_front_addr":"172.21.15.169:6813/2490026649","state":["exists","up"]},{"osd":7,"uuid":"2d074f9a-0d63-49a0-b37e-5077219df41c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6825","nonce":3479195367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6827","nonce":3479195367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6831","nonce":3479195367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3479195367},{"type":"v1","addr":"172.21.15.169:6829","nonce":3479195367}]},"public_addr":"172.21.15.169:6825/3479195367","cluster_addr":"172.21.15.169:6827/3479195367","heartbeat_back_addr":"172.21.15.169:6831/3479195367","heartbeat_front_addr":"172.21.15.169:6829/3479195367","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.623322+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.865672+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.937939+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.731438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.573116+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.705165+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.881553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-08T04:01:45.993667+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.16:6833/3183010605":"2023-06-09T04:18:27.031938+0000","172.21.15.16:6832/3183010605":"2023-06-09T04:18:27.031938+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-08T04:23:28.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.663+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5f1c06ace0 msgr2=0x7f5f1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:28.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.663+0000 7f5f3f7ff700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5f1c06ace0 0x7f5f1c06d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f380af0f0 tx=0x7f5f28009040 comp rx=0 tx=0).stop 2023-06-08T04:23:28.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.663+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/1812142145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f380ce0e0 msgr2=0x7f5f381f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:28.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.663+0000 7f5f3f7ff700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f380ce0e0 0x7f5f381f1e40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400c700 tx=0x7f5f3400ca10 comp rx=0 tx=0).stop 2023-06-08T04:23:28.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.685+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/1812142145 shutdown_connections 2023-06-08T04:23:28.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.685+0000 7f5f3f7ff700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f5f1c06ace0 0x7f5f1c06d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.685+0000 7f5f3f7ff700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f3815b250 0x7f5f381593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.685+0000 7f5f3f7ff700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f380ce0e0 0x7f5f381f1e40 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.685+0000 7f5f3f7ff700 1 --2- 172.21.15.16:0/1812142145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f3815a770 0x7f5f381f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.685+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/1812142145 >> 172.21.15.16:0/1812142145 conn(0x7f5f3806aa40 msgr2=0x7f5f380af140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.695+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/1812142145 shutdown_connections 2023-06-08T04:23:28.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:28.695+0000 7f5f3f7ff700 1 -- 172.21.15.16:0/1812142145 wait complete. 2023-06-08T04:23:28.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-08T04:01:49.573506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-08T04:01:50.241129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-08T04:03:09.272435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-06-08T04:03:10.551045+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-08T04:23:28.753 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-08T04:23:29.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.037+0000 7fdcb1fff700 1 Processor -- start 2023-06-08T04:23:29.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.038+0000 7fdcb1fff700 1 -- start start 2023-06-08T04:23:29.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.039+0000 7fdcb1fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdcac06a4c0 0x7fdcac0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:29.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.039+0000 7fdcb1fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac0af3f0 con 0x7fdcac15fb60 2023-06-08T04:23:29.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.039+0000 7fdcb1fff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac0af6d0 con 0x7fdcac0b0940 2023-06-08T04:23:29.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.039+0000 7fdcb1fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac0b0e40 con 0x7fdcac06a4c0 2023-06-08T04:23:29.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.039+0000 7fdcab7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdcac15fb60 0x7fdcac0c9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51158/0 (socket says 172.21.15.16:51158) 2023-06-08T04:23:29.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.039+0000 7fdcab7fe700 1 -- 172.21.15.16:0/2837048400 learned_addr learned my addr 172.21.15.16:0/2837048400 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:23:29.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.039+0000 7fdcabfff700 1 --2- 172.21.15.16:0/2837048400 >> v2:172.21.15.16:3300/0 conn(0x7fdcac06a4c0 0x7fdcac0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:29.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.039+0000 7fdcaa7fc700 1 -- 172.21.15.16:0/2837048400 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594914013 0 0) 0x7fdcac0af3f0 con 0x7fdcac15fb60 2023-06-08T04:23:29.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.040+0000 7fdcaa7fc700 1 -- 172.21.15.16:0/2837048400 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc940035b0 con 0x7fdcac15fb60 2023-06-08T04:23:29.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.040+0000 7fdcabfff700 1 -- 172.21.15.16:0/2837048400 >> v1:172.21.15.169:6789/0 conn(0x7fdcac0b0940 legacy=0x7fdcac069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.040+0000 7fdcabfff700 1 -- 172.21.15.16:0/2837048400 >> v1:172.21.15.16:6789/0 conn(0x7fdcac15fb60 legacy=0x7fdcac0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.040+0000 7fdcabfff700 1 -- 172.21.15.16:0/2837048400 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac0ce720 con 0x7fdcac06a4c0 2023-06-08T04:23:29.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.040+0000 7fdcabfff700 1 --2- 172.21.15.16:0/2837048400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac06a4c0 0x7fdcac0cec40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009d90 tx=0x7fdca400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbd959172596ef0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:29.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.040+0000 7fdcaa7fc700 1 -- 172.21.15.16:0/2837048400 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca400e070 con 0x7fdcac06a4c0 2023-06-08T04:23:29.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.040+0000 7fdcaa7fc700 1 -- 172.21.15.16:0/2837048400 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca400bb20 con 0x7fdcac06a4c0 2023-06-08T04:23:29.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.040+0000 7fdcaa7fc700 1 -- 172.21.15.16:0/2837048400 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca4012430 con 0x7fdcac06a4c0 2023-06-08T04:23:29.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.041+0000 7fdcb1fff700 1 -- 172.21.15.16:0/2837048400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac06a4c0 msgr2=0x7fdcac0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.041+0000 7fdcb1fff700 1 --2- 172.21.15.16:0/2837048400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac06a4c0 0x7fdcac0cec40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdca4009d90 tx=0x7fdca400b330 comp rx=0 tx=0).stop 2023-06-08T04:23:29.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.041+0000 7fdcb1fff700 1 -- 172.21.15.16:0/2837048400 shutdown_connections 2023-06-08T04:23:29.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.041+0000 7fdcb1fff700 1 --2- 172.21.15.16:0/2837048400 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac06a4c0 0x7fdcac0cec40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.041+0000 7fdcb1fff700 1 -- 172.21.15.16:0/2837048400 >> 172.21.15.16:0/2837048400 conn(0x7fdcac098a50 msgr2=0x7fdcac0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:29.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.041+0000 7fdcb1fff700 1 -- 172.21.15.16:0/2837048400 shutdown_connections 2023-06-08T04:23:29.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.041+0000 7fdcb1fff700 1 -- 172.21.15.16:0/2837048400 wait complete. 2023-06-08T04:23:29.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.043+0000 7fdcb1fff700 1 Processor -- start 2023-06-08T04:23:29.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.043+0000 7fdcb1fff700 1 -- start start 2023-06-08T04:23:29.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcb1fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac06a4c0 0x7fdcac0c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:29.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcb1fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcac0b0940 0x7fdcac0b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:29.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcb1fff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcac15fb60 0x7fdcac158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:29.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcb1fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac15a650 con 0x7fdcac06a4c0 2023-06-08T04:23:29.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcb1fff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0b3aa0 con 0x7fdcac0b0940 2023-06-08T04:23:29.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcb1fff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0b3d80 con 0x7fdcac15fb60 2023-06-08T04:23:29.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcab7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac06a4c0 0x7fdcac0c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:29.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcab7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac06a4c0 0x7fdcac0c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57162/0 (socket says 172.21.15.16:57162) 2023-06-08T04:23:29.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcab7fe700 1 -- 172.21.15.16:0/1877573124 learned_addr learned my addr 172.21.15.16:0/1877573124 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:23:29.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcaaffd700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcac0b0940 0x7fdcac0b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:29.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcabfff700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcac15fb60 0x7fdcac158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:29.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcab7fe700 1 -- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcac15fb60 msgr2=0x7fdcac158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcab7fe700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcac15fb60 0x7fdcac158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcab7fe700 1 -- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcac0b0940 msgr2=0x7fdcac0b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcab7fe700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcac0b0940 0x7fdcac0b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcab7fe700 1 -- 172.21.15.16:0/1877573124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca4009a70 con 0x7fdcac06a4c0 2023-06-08T04:23:29.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcabfff700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcac15fb60 0x7fdcac158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:23:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.045+0000 7fdcab7fe700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac06a4c0 0x7fdcac0c8a10 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c001eb0 tx=0x7fdc9c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.046+0000 7fdc93fff700 1 -- 172.21.15.16:0/1877573124 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c005d70 con 0x7fdcac06a4c0 2023-06-08T04:23:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.046+0000 7fdc93fff700 1 -- 172.21.15.16:0/1877573124 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c0070d0 con 0x7fdcac06a4c0 2023-06-08T04:23:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.046+0000 7fdcb1fff700 1 -- 172.21.15.16:0/1877573124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac0b4060 con 0x7fdcac06a4c0 2023-06-08T04:23:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.046+0000 7fdc93fff700 1 -- 172.21.15.16:0/1877573124 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c007460 con 0x7fdcac06a4c0 2023-06-08T04:23:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.046+0000 7fdcb1fff700 1 -- 172.21.15.16:0/1877573124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac0c8f50 con 0x7fdcac06a4c0 2023-06-08T04:23:29.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.047+0000 7fdcb1fff700 1 -- 172.21.15.16:0/1877573124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac0b1060 con 0x7fdcac06a4c0 2023-06-08T04:23:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.048+0000 7fdc93fff700 1 -- 172.21.15.16:0/1877573124 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc9c0075c0 con 0x7fdcac06a4c0 2023-06-08T04:23:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.049+0000 7fdc93fff700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdc9806ace0 0x7fdc9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.049+0000 7fdc93fff700 1 -- 172.21.15.16:0/1877573124 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fdc9c088bb0 con 0x7fdcac06a4c0 2023-06-08T04:23:29.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.049+0000 7fdcaaffd700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdc9806ace0 0x7fdc9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:29.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.050+0000 7fdcaaffd700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdc9806ace0 0x7fdc9806d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdcac15dcd0 tx=0x7fdca0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:29.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.054+0000 7fdc93fff700 1 -- 172.21.15.16:0/1877573124 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdc9c053ab0 con 0x7fdcac06a4c0 2023-06-08T04:23:29.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.271+0000 7fdcb1fff700 1 -- 172.21.15.16:0/1877573124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdcac0740e0 con 0x7fdcac06a4c0 2023-06-08T04:23:29.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.272+0000 7fdc93fff700 1 -- 172.21.15.16:0/1877573124 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdc9c017020 con 0x7fdcac06a4c0 2023-06-08T04:23:29.276 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 8 2023-06-08T04:23:29.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 -- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdc9806ace0 msgr2=0x7fdc9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdc9806ace0 0x7fdc9806d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdcac15dcd0 tx=0x7fdca0009040 comp rx=0 tx=0).stop 2023-06-08T04:23:29.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 -- 172.21.15.16:0/1877573124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac06a4c0 msgr2=0x7fdcac0c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac06a4c0 0x7fdcac0c8a10 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c001eb0 tx=0x7fdc9c00c860 comp rx=0 tx=0).stop 2023-06-08T04:23:29.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 -- 172.21.15.16:0/1877573124 shutdown_connections 2023-06-08T04:23:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fdc9806ace0 0x7fdc9806d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdcac15fb60 0x7fdcac158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac06a4c0 0x7fdcac0c8a10 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 --2- 172.21.15.16:0/1877573124 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdcac0b0940 0x7fdcac0b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 -- 172.21.15.16:0/1877573124 >> 172.21.15.16:0/1877573124 conn(0x7fdcac098a50 msgr2=0x7fdcac0ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 -- 172.21.15.16:0/1877573124 shutdown_connections 2023-06-08T04:23:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.274+0000 7fdcb1fff700 1 -- 172.21.15.16:0/1877573124 wait complete. 2023-06-08T04:23:29.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-08T04:23:29.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.624+0000 7f0738dff700 1 Processor -- start 2023-06-08T04:23:29.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.625+0000 7f0738dff700 1 -- start start 2023-06-08T04:23:29.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.627+0000 7f0738dff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f07340b83f0 0x7f0734160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:29.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.627+0000 7f0738dff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f07340b4d20 0x7f07340d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:29.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.627+0000 7f0738dff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07340d0800 con 0x7f07340ced40 2023-06-08T04:23:29.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.627+0000 7f0738dff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07340cd1e0 con 0x7f07340b4d20 2023-06-08T04:23:29.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.627+0000 7f0738dff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07340cd4c0 con 0x7f07340b83f0 2023-06-08T04:23:29.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.628+0000 7f073259c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f07340b83f0 0x7f0734160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:29.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.628+0000 7f073259c700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f07340b83f0 0x7f0734160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.16:36770/0 (socket says 172.21.15.16:36770) 2023-06-08T04:23:29.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.628+0000 7f0732d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f07340b4d20 0x7f07340d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:29.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.628+0000 7f073259c700 1 -- 172.21.15.16:0/2647749611 learned_addr learned my addr 172.21.15.16:0/2647749611 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:23:29.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.628+0000 7f0732d9d700 1 -- 172.21.15.16:0/2647749611 >> v2:172.21.15.169:3300/0 conn(0x7f07340b83f0 msgr2=0x7f0734160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:23:29.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.628+0000 7f0732d9d700 1 --2- 172.21.15.16:0/2647749611 >> v2:172.21.15.169:3300/0 conn(0x7f07340b83f0 0x7f0734160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.628+0000 7f0732d9d700 1 -- 172.21.15.16:0/2647749611 >> v1:172.21.15.16:6789/0 conn(0x7f07340ced40 legacy=0x7f07340b4610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-08T04:23:29.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.628+0000 7f0732d9d700 1 -- 172.21.15.16:0/2647749611 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07340d0aa0 con 0x7f07340b4d20 2023-06-08T04:23:29.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.629+0000 7f0732d9d700 1 --2- 172.21.15.16:0/2647749611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07340b4d20 0x7f07340d0fc0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f073406ca80 tx=0x7f072c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76857e3e92323b62 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:29.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.630+0000 7f073159a700 1 -- 172.21.15.16:0/2647749611 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c00e070 con 0x7f07340b4d20 2023-06-08T04:23:29.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.630+0000 7f073159a700 1 -- 172.21.15.16:0/2647749611 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c00bb90 con 0x7f07340b4d20 2023-06-08T04:23:29.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.630+0000 7f073159a700 1 -- 172.21.15.16:0/2647749611 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c003a20 con 0x7f07340b4d20 2023-06-08T04:23:29.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.631+0000 7f0738dff700 1 -- 172.21.15.16:0/2647749611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07340b4d20 msgr2=0x7f07340d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.631+0000 7f0738dff700 1 --2- 172.21.15.16:0/2647749611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07340b4d20 0x7f07340d0fc0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f073406ca80 tx=0x7f072c00b330 comp rx=0 tx=0).stop 2023-06-08T04:23:29.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.631+0000 7f0738dff700 1 -- 172.21.15.16:0/2647749611 shutdown_connections 2023-06-08T04:23:29.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.631+0000 7f0738dff700 1 --2- 172.21.15.16:0/2647749611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07340b4d20 0x7f07340d0fc0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.631+0000 7f0738dff700 1 --2- 172.21.15.16:0/2647749611 >> v2:172.21.15.169:3300/0 conn(0x7f07340b83f0 0x7f0734160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.631+0000 7f0738dff700 1 -- 172.21.15.16:0/2647749611 >> 172.21.15.16:0/2647749611 conn(0x7f07340cf610 msgr2=0x7f07340cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:29.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.631+0000 7f0738dff700 1 -- 172.21.15.16:0/2647749611 shutdown_connections 2023-06-08T04:23:29.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.631+0000 7f0738dff700 1 -- 172.21.15.16:0/2647749611 wait complete. 2023-06-08T04:23:29.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.634+0000 7f0738dff700 1 Processor -- start 2023-06-08T04:23:29.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.634+0000 7f0738dff700 1 -- start start 2023-06-08T04:23:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.636+0000 7f0738dff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07340b4d20 0x7f07341513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:29.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.636+0000 7f0738dff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07340b83f0 0x7f07340caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:29.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.636+0000 7f0738dff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07340ced40 0x7f07340d1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:29.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.636+0000 7f0738dff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07340cb970 con 0x7f07340b83f0 2023-06-08T04:23:29.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.636+0000 7f0738dff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07340cbc50 con 0x7f07340b4d20 2023-06-08T04:23:29.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.636+0000 7f0738dff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07340cbf30 con 0x7f07340ced40 2023-06-08T04:23:29.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.637+0000 7f0732d9d700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07340ced40 0x7f07340d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:29.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.637+0000 7f0732d9d700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07340ced40 0x7f07340d1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.16:44626/0 (socket says 172.21.15.16:44626) 2023-06-08T04:23:29.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.637+0000 7f0732d9d700 1 -- 172.21.15.16:0/1741832085 learned_addr learned my addr 172.21.15.16:0/1741832085 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:23:29.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.637+0000 7f0731d9b700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07340b83f0 0x7f07340caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:29.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.637+0000 7f073259c700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07340b4d20 0x7f07341513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:29.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.638+0000 7f0731d9b700 1 -- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07340ced40 msgr2=0x7f07340d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.638+0000 7f0731d9b700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07340ced40 0x7f07340d1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.638+0000 7f0731d9b700 1 -- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07340b4d20 msgr2=0x7f07341513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.638+0000 7f0731d9b700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07340b4d20 0x7f07341513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.638+0000 7f0731d9b700 1 -- 172.21.15.16:0/1741832085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c009a70 con 0x7f07340b83f0 2023-06-08T04:23:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.638+0000 7f0731d9b700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07340b83f0 0x7f07340caed0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0728009fd0 tx=0x7f072800b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.639+0000 7f0722ffd700 1 -- 172.21.15.16:0/1741832085 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728011830 con 0x7f07340b83f0 2023-06-08T04:23:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.639+0000 7f0722ffd700 1 -- 172.21.15.16:0/1741832085 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07280119b0 con 0x7f07340b83f0 2023-06-08T04:23:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.639+0000 7f0738dff700 1 -- 172.21.15.16:0/1741832085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07340cc210 con 0x7f07340b83f0 2023-06-08T04:23:29.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.639+0000 7f0722ffd700 1 -- 172.21.15.16:0/1741832085 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728011d60 con 0x7f07340b83f0 2023-06-08T04:23:29.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.639+0000 7f0738dff700 1 -- 172.21.15.16:0/1741832085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073415ed20 con 0x7f07340b83f0 2023-06-08T04:23:29.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.642+0000 7f0738dff700 1 -- 172.21.15.16:0/1741832085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07340740e0 con 0x7f07340b83f0 2023-06-08T04:23:29.646 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.643+0000 7f0722ffd700 1 -- 172.21.15.16:0/1741832085 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f072801a400 con 0x7f07340b83f0 2023-06-08T04:23:29.647 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.644+0000 7f0722ffd700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f071406ace0 0x7f071406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:29.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.644+0000 7f0722ffd700 1 -- 172.21.15.16:0/1741832085 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f07280895c0 con 0x7f07340b83f0 2023-06-08T04:23:29.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.645+0000 7f073259c700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f071406ace0 0x7f071406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.652+0000 7f0722ffd700 1 -- 172.21.15.16:0/1741832085 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0728054550 con 0x7f07340b83f0 2023-06-08T04:23:29.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.652+0000 7f073259c700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f071406ace0 0x7f071406d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0724009930 tx=0x7f0724008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:29.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.960+0000 7f0738dff700 1 -- 172.21.15.16:0/1741832085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07340d1600 con 0x7f07340b83f0 2023-06-08T04:23:29.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.960+0000 7f0722ffd700 1 -- 172.21.15.16:0/1741832085 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0728057b70 con 0x7f07340b83f0 2023-06-08T04:23:29.964 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-06-08T04:23:29.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 -- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f071406ace0 msgr2=0x7f071406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f071406ace0 0x7f071406d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0724009930 tx=0x7f0724008040 comp rx=0 tx=0).stop 2023-06-08T04:23:29.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 -- 172.21.15.16:0/1741832085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07340b83f0 msgr2=0x7f07340caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:29.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07340b83f0 0x7f07340caed0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0728009fd0 tx=0x7f072800b770 comp rx=0 tx=0).stop 2023-06-08T04:23:29.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 -- 172.21.15.16:0/1741832085 shutdown_connections 2023-06-08T04:23:29.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f071406ace0 0x7f071406d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f07340ced40 0x7f07340d1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07340b4d20 0x7f07341513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 --2- 172.21.15.16:0/1741832085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07340b83f0 0x7f07340caed0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:29.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 -- 172.21.15.16:0/1741832085 >> 172.21.15.16:0/1741832085 conn(0x7f07340cf610 msgr2=0x7f07340cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:29.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 -- 172.21.15.16:0/1741832085 shutdown_connections 2023-06-08T04:23:29.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:29.963+0000 7f0738dff700 1 -- 172.21.15.16:0/1741832085 wait complete. 2023-06-08T04:23:29.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-08T04:23:30.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.189+0000 7f8b645ff700 1 Processor -- start 2023-06-08T04:23:30.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.190+0000 7f8b645ff700 1 -- start start 2023-06-08T04:23:30.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.191+0000 7f8b645ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8b5c159200 0x7f8b5c0adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.191+0000 7f8b645ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b5c15d660 0x7f8b5c070280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.191+0000 7f8b645ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5c0c9b60 con 0x7f8b5c0707c0 2023-06-08T04:23:30.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.191+0000 7f8b645ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5c1595d0 con 0x7f8b5c159200 2023-06-08T04:23:30.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.191+0000 7f8b645ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c070c30 con 0x7f8b5c15d660 2023-06-08T04:23:30.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.191+0000 7f8b6239b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8b5c159200 0x7f8b5c0adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.191+0000 7f8b62b9c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8b5c0707c0 0x7f8b5c06c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51160/0 (socket says 172.21.15.16:51160) 2023-06-08T04:23:30.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.191+0000 7f8b6239b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8b5c159200 0x7f8b5c0adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57182/0 (socket says 172.21.15.16:57182) 2023-06-08T04:23:30.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.191+0000 7f8b62b9c700 1 -- 172.21.15.16:0/917158789 learned_addr learned my addr 172.21.15.16:0/917158789 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:23:30.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.191+0000 7f8b61b9a700 1 --2- 172.21.15.16:0/917158789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b5c15d660 0x7f8b5c070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.192+0000 7f8b6239b700 1 -- 172.21.15.16:0/917158789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b5c15d660 msgr2=0x7f8b5c070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:23:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.192+0000 7f8b6239b700 1 --2- 172.21.15.16:0/917158789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b5c15d660 0x7f8b5c070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.192+0000 7f8b6239b700 1 -- 172.21.15.16:0/917158789 >> v1:172.21.15.16:6789/0 conn(0x7f8b5c0707c0 legacy=0x7f8b5c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.192+0000 7f8b6239b700 1 -- 172.21.15.16:0/917158789 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c0cb000 con 0x7f8b5c159200 2023-06-08T04:23:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.192+0000 7f8b6239b700 1 --2- 172.21.15.16:0/917158789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b5c159200 0x7f8b5c0adb60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009870 tx=0x7f8b58009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb44f292ca12d94f server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.192+0000 7f8b61399700 1 -- 172.21.15.16:0/917158789 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800f8a0 con 0x7f8b5c159200 2023-06-08T04:23:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.192+0000 7f8b61399700 1 -- 172.21.15.16:0/917158789 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5800fa00 con 0x7f8b5c159200 2023-06-08T04:23:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.192+0000 7f8b61399700 1 -- 172.21.15.16:0/917158789 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800fd90 con 0x7f8b5c159200 2023-06-08T04:23:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.193+0000 7f8b645ff700 1 -- 172.21.15.16:0/917158789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b5c159200 msgr2=0x7f8b5c0adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.193+0000 7f8b645ff700 1 --2- 172.21.15.16:0/917158789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b5c159200 0x7f8b5c0adb60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009870 tx=0x7f8b58009b80 comp rx=0 tx=0).stop 2023-06-08T04:23:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.193+0000 7f8b645ff700 1 -- 172.21.15.16:0/917158789 shutdown_connections 2023-06-08T04:23:30.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.193+0000 7f8b645ff700 1 --2- 172.21.15.16:0/917158789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b5c159200 0x7f8b5c0adb60 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.193+0000 7f8b645ff700 1 --2- 172.21.15.16:0/917158789 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b5c15d660 0x7f8b5c070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.193+0000 7f8b645ff700 1 -- 172.21.15.16:0/917158789 >> 172.21.15.16:0/917158789 conn(0x7f8b5c06aa40 msgr2=0x7f8b5c0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.193+0000 7f8b645ff700 1 -- 172.21.15.16:0/917158789 shutdown_connections 2023-06-08T04:23:30.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.193+0000 7f8b645ff700 1 -- 172.21.15.16:0/917158789 wait complete. 2023-06-08T04:23:30.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.195+0000 7f8b645ff700 1 Processor -- start 2023-06-08T04:23:30.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.195+0000 7f8b645ff700 1 -- start start 2023-06-08T04:23:30.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.196+0000 7f8b645ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b5c0707c0 0x7f8b5c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.196+0000 7f8b645ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b5c159200 0x7f8b5c0c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.196+0000 7f8b645ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b5c15d660 0x7f8b5c14d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.196+0000 7f8b645ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0ce560 con 0x7f8b5c159200 2023-06-08T04:23:30.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.196+0000 7f8b645ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0ce980 con 0x7f8b5c0707c0 2023-06-08T04:23:30.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.196+0000 7f8b645ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c0cd8e0 con 0x7f8b5c15d660 2023-06-08T04:23:30.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.196+0000 7f8b61b9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b5c159200 0x7f8b5c0c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.196+0000 7f8b6239b700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b5c0707c0 0x7f8b5c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.196+0000 7f8b61b9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b5c159200 0x7f8b5c0c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57192/0 (socket says 172.21.15.16:57192) 2023-06-08T04:23:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.196+0000 7f8b61b9a700 1 -- 172.21.15.16:0/2200709 learned_addr learned my addr 172.21.15.16:0/2200709 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:23:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.197+0000 7f8b62b9c700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b5c15d660 0x7f8b5c14d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.197+0000 7f8b61b9a700 1 -- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b5c15d660 msgr2=0x7f8b5c14d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.197+0000 7f8b61b9a700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b5c15d660 0x7f8b5c14d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.197+0000 7f8b61b9a700 1 -- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b5c0707c0 msgr2=0x7f8b5c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.197+0000 7f8b61b9a700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b5c0707c0 0x7f8b5c0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.202 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.197+0000 7f8b61b9a700 1 -- 172.21.15.16:0/2200709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580094a0 con 0x7f8b5c159200 2023-06-08T04:23:30.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.197+0000 7f8b61b9a700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b5c159200 0x7f8b5c0c7eb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00e840 tx=0x7f8b4c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:30.203 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.197+0000 7f8b52ffd700 1 -- 172.21.15.16:0/2200709 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c009590 con 0x7f8b5c159200 2023-06-08T04:23:30.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.197+0000 7f8b52ffd700 1 -- 172.21.15.16:0/2200709 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c013680 con 0x7f8b5c159200 2023-06-08T04:23:30.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.197+0000 7f8b52ffd700 1 -- 172.21.15.16:0/2200709 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c013a10 con 0x7f8b5c159200 2023-06-08T04:23:30.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.197+0000 7f8b645ff700 1 -- 172.21.15.16:0/2200709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c0cdbc0 con 0x7f8b5c159200 2023-06-08T04:23:30.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.198+0000 7f8b645ff700 1 -- 172.21.15.16:0/2200709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5c0ce180 con 0x7f8b5c159200 2023-06-08T04:23:30.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.199+0000 7f8b645ff700 1 -- 172.21.15.16:0/2200709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5c0740e0 con 0x7f8b5c159200 2023-06-08T04:23:30.204 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.200+0000 7f8b52ffd700 1 -- 172.21.15.16:0/2200709 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b4c013b70 con 0x7f8b5c159200 2023-06-08T04:23:30.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.201+0000 7f8b52ffd700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8b4006ace0 0x7f8b4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.201+0000 7f8b52ffd700 1 -- 172.21.15.16:0/2200709 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f8b4c089360 con 0x7f8b5c159200 2023-06-08T04:23:30.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.201+0000 7f8b6239b700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8b4006ace0 0x7f8b4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.202+0000 7f8b6239b700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8b4006ace0 0x7f8b4006d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8b580090b0 tx=0x7f8b5801b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:30.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.205+0000 7f8b52ffd700 1 -- 172.21.15.16:0/2200709 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b4c057d80 con 0x7f8b5c159200 2023-06-08T04:23:30.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.444+0000 7f8b645ff700 1 -- 172.21.15.16:0/2200709 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b5c0ce6a0 con 0x7f8b5c159200 2023-06-08T04:23:30.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.444+0000 7f8b52ffd700 1 -- 172.21.15.16:0/2200709 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b5c0ce6a0 con 0x7f8b5c159200 2023-06-08T04:23:30.448 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-06-08T04:23:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.446+0000 7f8b645ff700 1 -- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8b4006ace0 msgr2=0x7f8b4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.446+0000 7f8b645ff700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8b4006ace0 0x7f8b4006d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8b580090b0 tx=0x7f8b5801b040 comp rx=0 tx=0).stop 2023-06-08T04:23:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.446+0000 7f8b645ff700 1 -- 172.21.15.16:0/2200709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b5c159200 msgr2=0x7f8b5c0c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.446+0000 7f8b645ff700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b5c159200 0x7f8b5c0c7eb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00e840 tx=0x7f8b4c00eb50 comp rx=0 tx=0).stop 2023-06-08T04:23:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.447+0000 7f8b645ff700 1 -- 172.21.15.16:0/2200709 shutdown_connections 2023-06-08T04:23:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.447+0000 7f8b645ff700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f8b4006ace0 0x7f8b4006d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.447+0000 7f8b645ff700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8b5c15d660 0x7f8b5c14d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.447+0000 7f8b645ff700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b5c0707c0 0x7f8b5c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.447+0000 7f8b645ff700 1 --2- 172.21.15.16:0/2200709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b5c159200 0x7f8b5c0c7eb0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.447+0000 7f8b645ff700 1 -- 172.21.15.16:0/2200709 >> 172.21.15.16:0/2200709 conn(0x7f8b5c06aa40 msgr2=0x7f8b5c15c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:30.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.447+0000 7f8b645ff700 1 -- 172.21.15.16:0/2200709 shutdown_connections 2023-06-08T04:23:30.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.447+0000 7f8b645ff700 1 -- 172.21.15.16:0/2200709 wait complete. 2023-06-08T04:23:30.469 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-08T04:23:30.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.673+0000 7f3ece1ff700 1 Processor -- start 2023-06-08T04:23:30.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.673+0000 7f3ece1ff700 1 -- start start 2023-06-08T04:23:30.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.674+0000 7f3ece1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ec80b83f0 0x7f3ec8160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.674+0000 7f3ece1ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3ec80b4d20 0x7f3ec80d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.674+0000 7f3ece1ff700 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80d0800 con 0x7f3ec80ced40 2023-06-08T04:23:30.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.674+0000 7f3ece1ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80cd1e0 con 0x7f3ec80b4d20 2023-06-08T04:23:30.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.674+0000 7f3ece1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80cd4c0 con 0x7f3ec80b83f0 2023-06-08T04:23:30.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.675+0000 7f3ec77fe700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ec80b83f0 0x7f3ec8160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.675+0000 7f3ec7fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3ec80b4d20 0x7f3ec80d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.675+0000 7f3ec6ffd700 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f3ec80ced40 0x7f3ec80b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.16:33960/0 (socket says 172.21.15.16:33960) 2023-06-08T04:23:30.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.675+0000 7f3ec6ffd700 1 -- 172.21.15.16:0/1812617836 learned_addr learned my addr 172.21.15.16:0/1812617836 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:23:30.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.675+0000 7f3ec7fff700 1 -- 172.21.15.16:0/1812617836 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ec80b83f0 msgr2=0x7f3ec8160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:23:30.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.675+0000 7f3ec7fff700 1 --2- 172.21.15.16:0/1812617836 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ec80b83f0 0x7f3ec8160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.675+0000 7f3ec7fff700 1 -- 172.21.15.16:0/1812617836 >> v1:172.21.15.169:6789/0 conn(0x7f3ec80ced40 legacy=0x7f3ec80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.675+0000 7f3ec7fff700 1 -- 172.21.15.16:0/1812617836 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80d0aa0 con 0x7f3ec80b4d20 2023-06-08T04:23:30.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.675+0000 7f3ec67fc700 1 -- 172.21.15.16:0/1812617836 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361405691 0 0) 0x7f3ec80d0800 con 0x7f3ec80ced40 2023-06-08T04:23:30.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.675+0000 7f3ec7fff700 1 --2- 172.21.15.16:0/1812617836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec80b4d20 0x7f3ec80d0fc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009d90 tx=0x7f3ec000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c654113c5b56ba server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:30.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.676+0000 7f3ec67fc700 1 -- 172.21.15.16:0/1812617836 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000e070 con 0x7f3ec80b4d20 2023-06-08T04:23:30.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.676+0000 7f3ec67fc700 1 -- 172.21.15.16:0/1812617836 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec000bb20 con 0x7f3ec80b4d20 2023-06-08T04:23:30.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.676+0000 7f3ec67fc700 1 -- 172.21.15.16:0/1812617836 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0012430 con 0x7f3ec80b4d20 2023-06-08T04:23:30.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.676+0000 7f3ece1ff700 1 -- 172.21.15.16:0/1812617836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec80b4d20 msgr2=0x7f3ec80d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.676+0000 7f3ece1ff700 1 --2- 172.21.15.16:0/1812617836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec80b4d20 0x7f3ec80d0fc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009d90 tx=0x7f3ec000b330 comp rx=0 tx=0).stop 2023-06-08T04:23:30.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.676+0000 7f3ece1ff700 1 -- 172.21.15.16:0/1812617836 shutdown_connections 2023-06-08T04:23:30.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.676+0000 7f3ece1ff700 1 --2- 172.21.15.16:0/1812617836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec80b4d20 0x7f3ec80d0fc0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.676+0000 7f3ece1ff700 1 --2- 172.21.15.16:0/1812617836 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ec80b83f0 0x7f3ec8160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.676+0000 7f3ece1ff700 1 -- 172.21.15.16:0/1812617836 >> 172.21.15.16:0/1812617836 conn(0x7f3ec80cf610 msgr2=0x7f3ec80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:30.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.676+0000 7f3ece1ff700 1 -- 172.21.15.16:0/1812617836 shutdown_connections 2023-06-08T04:23:30.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.676+0000 7f3ece1ff700 1 -- 172.21.15.16:0/1812617836 wait complete. 2023-06-08T04:23:30.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.678+0000 7f3ece1ff700 1 Processor -- start 2023-06-08T04:23:30.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.678+0000 7f3ece1ff700 1 -- start start 2023-06-08T04:23:30.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.679+0000 7f3ece1ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ec80b4d20 0x7f3ec81e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.679+0000 7f3ece1ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec80b83f0 0x7f3ec81e7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.679+0000 7f3ece1ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ec80ced40 0x7f3ec815f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.679+0000 7f3ece1ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec81e6f70 con 0x7f3ec80b83f0 2023-06-08T04:23:30.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.679+0000 7f3ece1ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec815f840 con 0x7f3ec80ced40 2023-06-08T04:23:30.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.679+0000 7f3ece1ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec81e62f0 con 0x7f3ec80b4d20 2023-06-08T04:23:30.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec6ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec80b83f0 0x7f3ec81e7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec7fff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ec80ced40 0x7f3ec815f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec6ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec80b83f0 0x7f3ec81e7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57216/0 (socket says 172.21.15.16:57216) 2023-06-08T04:23:30.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec6ffd700 1 -- 172.21.15.16:0/2482243407 learned_addr learned my addr 172.21.15.16:0/2482243407 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:23:30.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec77fe700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ec80b4d20 0x7f3ec81e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec6ffd700 1 -- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ec80b4d20 msgr2=0x7f3ec81e5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec6ffd700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ec80b4d20 0x7f3ec81e5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec6ffd700 1 -- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ec80ced40 msgr2=0x7f3ec815f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec6ffd700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ec80ced40 0x7f3ec815f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec6ffd700 1 -- 172.21.15.16:0/2482243407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0009a70 con 0x7f3ec80b83f0 2023-06-08T04:23:30.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec7fff700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ec80ced40 0x7f3ec815f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:23:30.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.680+0000 7f3ec6ffd700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec80b83f0 0x7f3ec81e7370 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00c550 tx=0x7f3ebc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:30.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.681+0000 7f3eaffff700 1 -- 172.21.15.16:0/2482243407 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc004c80 con 0x7f3ec80b83f0 2023-06-08T04:23:30.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.681+0000 7f3eaffff700 1 -- 172.21.15.16:0/2482243407 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc004e00 con 0x7f3ec80b83f0 2023-06-08T04:23:30.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.681+0000 7f3ece1ff700 1 -- 172.21.15.16:0/2482243407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec81e65d0 con 0x7f3ec80b83f0 2023-06-08T04:23:30.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.681+0000 7f3eaffff700 1 -- 172.21.15.16:0/2482243407 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc007310 con 0x7f3ec80b83f0 2023-06-08T04:23:30.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.681+0000 7f3ece1ff700 1 -- 172.21.15.16:0/2482243407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec81e6b90 con 0x7f3ec80b83f0 2023-06-08T04:23:30.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.682+0000 7f3ece1ff700 1 -- 172.21.15.16:0/2482243407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec80740e0 con 0x7f3ec80b83f0 2023-06-08T04:23:30.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.683+0000 7f3eaffff700 1 -- 172.21.15.16:0/2482243407 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ebc007470 con 0x7f3ec80b83f0 2023-06-08T04:23:30.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.685+0000 7f3eaffff700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3eb406ace0 0x7f3eb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:30.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.685+0000 7f3eaffff700 1 -- 172.21.15.16:0/2482243407 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f3ebc089030 con 0x7f3ec80b83f0 2023-06-08T04:23:30.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.685+0000 7f3ec77fe700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3eb406ace0 0x7f3eb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:30.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.686+0000 7f3ec77fe700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3eb406ace0 0x7f3eb406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009be0 tx=0x7f3eb8009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:30.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.689+0000 7f3eaffff700 1 -- 172.21.15.16:0/2482243407 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3ebc0540f0 con 0x7f3ec80b83f0 2023-06-08T04:23:30.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.908+0000 7f3ece1ff700 1 -- 172.21.15.16:0/2482243407 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ec806bdb0 con 0x7f3ec80b83f0 2023-06-08T04:23:30.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.908+0000 7f3eaffff700 1 -- 172.21.15.16:0/2482243407 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ebc057710 con 0x7f3ec80b83f0 2023-06-08T04:23:30.912 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-06-08T04:23:30.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 -- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3eb406ace0 msgr2=0x7f3eb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3eb406ace0 0x7f3eb406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009be0 tx=0x7f3eb8009210 comp rx=0 tx=0).stop 2023-06-08T04:23:30.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 -- 172.21.15.16:0/2482243407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec80b83f0 msgr2=0x7f3ec81e7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:30.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec80b83f0 0x7f3ec81e7370 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00c550 tx=0x7f3ebc00c860 comp rx=0 tx=0).stop 2023-06-08T04:23:30.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 -- 172.21.15.16:0/2482243407 shutdown_connections 2023-06-08T04:23:30.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7f3eb406ace0 0x7f3eb406d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3ec80ced40 0x7f3ec815f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3ec80b4d20 0x7f3ec81e5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 --2- 172.21.15.16:0/2482243407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ec80b83f0 0x7f3ec81e7370 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:30.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 -- 172.21.15.16:0/2482243407 >> 172.21.15.16:0/2482243407 conn(0x7f3ec80cf610 msgr2=0x7f3ec80b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:30.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 -- 172.21.15.16:0/2482243407 shutdown_connections 2023-06-08T04:23:30.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:30.911+0000 7f3ece1ff700 1 -- 172.21.15.16:0/2482243407 wait complete. 2023-06-08T04:23:30.934 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-08T04:23:31.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.143+0000 7fd6fc3ff700 1 Processor -- start 2023-06-08T04:23:31.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.143+0000 7fd6fc3ff700 1 -- start start 2023-06-08T04:23:31.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.144+0000 7fd6fc3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b83f0 0x7fd6f4160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:31.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.144+0000 7fd6fc3ff700 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd6f40ced40 0x7fd6f40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:31.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.144+0000 7fd6fc3ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f40d0800 con 0x7fd6f40b4b50 2023-06-08T04:23:31.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.144+0000 7fd6fc3ff700 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f40b4fd0 con 0x7fd6f40ced40 2023-06-08T04:23:31.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.144+0000 7fd6fc3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40cd1e0 con 0x7fd6f40b83f0 2023-06-08T04:23:31.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.145+0000 7fd6fa99c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd6f40b4b50 0x7fd6f406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51164/0 (socket says 172.21.15.16:51164) 2023-06-08T04:23:31.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.145+0000 7fd6fa99c700 1 -- 172.21.15.16:0/1898637627 learned_addr learned my addr 172.21.15.16:0/1898637627 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-06-08T04:23:31.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.145+0000 7fd6f999a700 1 --2- 172.21.15.16:0/1898637627 >> v2:172.21.15.169:3300/0 conn(0x7fd6f40ced40 0x7fd6f40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:31.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.145+0000 7fd6fa19b700 1 --2- 172.21.15.16:0/1898637627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b83f0 0x7fd6f4160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:31.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.145+0000 7fd6f9199700 1 -- 172.21.15.16:0/1898637627 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666144663 0 0) 0x7fd6f40d0800 con 0x7fd6f40b4b50 2023-06-08T04:23:31.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.145+0000 7fd6f9199700 1 -- 172.21.15.16:0/1898637627 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e00035b0 con 0x7fd6f40b4b50 2023-06-08T04:23:31.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.145+0000 7fd6f999a700 1 -- 172.21.15.16:0/1898637627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b83f0 msgr2=0x7fd6f4160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-08T04:23:31.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.145+0000 7fd6f999a700 1 --2- 172.21.15.16:0/1898637627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b83f0 0x7fd6f4160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:31.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.145+0000 7fd6f999a700 1 -- 172.21.15.16:0/1898637627 >> v1:172.21.15.16:6789/0 conn(0x7fd6f40b4b50 legacy=0x7fd6f406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:31.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.145+0000 7fd6f999a700 1 -- 172.21.15.16:0/1898637627 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f40cd4c0 con 0x7fd6f40ced40 2023-06-08T04:23:31.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.145+0000 7fd6fa19b700 1 --2- 172.21.15.16:0/1898637627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b83f0 0x7fd6f4160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-08T04:23:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.146+0000 7fd6f999a700 1 --2- 172.21.15.16:0/1898637627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40ced40 0x7fd6f40b4610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009840 tx=0x7fd6e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79c756c635086e0a server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.146+0000 7fd6f9199700 1 -- 172.21.15.16:0/1898637627 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4011830 con 0x7fd6f40ced40 2023-06-08T04:23:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.146+0000 7fd6f9199700 1 -- 172.21.15.16:0/1898637627 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e4011990 con 0x7fd6f40ced40 2023-06-08T04:23:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.146+0000 7fd6f9199700 1 -- 172.21.15.16:0/1898637627 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4011d20 con 0x7fd6f40ced40 2023-06-08T04:23:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.147+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/1898637627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40ced40 msgr2=0x7fd6f40b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.147+0000 7fd6fc3ff700 1 --2- 172.21.15.16:0/1898637627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40ced40 0x7fd6f40b4610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009840 tx=0x7fd6e4009b50 comp rx=0 tx=0).stop 2023-06-08T04:23:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.147+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/1898637627 shutdown_connections 2023-06-08T04:23:31.152 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.147+0000 7fd6fc3ff700 1 --2- 172.21.15.16:0/1898637627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b83f0 0x7fd6f4160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.147+0000 7fd6fc3ff700 1 --2- 172.21.15.16:0/1898637627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40ced40 0x7fd6f40b4610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.147+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/1898637627 >> 172.21.15.16:0/1898637627 conn(0x7fd6f40cf610 msgr2=0x7fd6f40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.147+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/1898637627 shutdown_connections 2023-06-08T04:23:31.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.147+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/1898637627 wait complete. 2023-06-08T04:23:31.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.149+0000 7fd6fc3ff700 1 Processor -- start 2023-06-08T04:23:31.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.149+0000 7fd6fc3ff700 1 -- start start 2023-06-08T04:23:31.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6fc3ff700 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b4b50 0x7fd6f415c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:31.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6fc3ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6f40b83f0 0x7fd6f4153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:31.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6fc3ff700 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40ced40 0x7fd6f4158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:31.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6fc3ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f415ceb0 con 0x7fd6f40b83f0 2023-06-08T04:23:31.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6fc3ff700 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f415d180 con 0x7fd6f40ced40 2023-06-08T04:23:31.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6fc3ff700 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f415d460 con 0x7fd6f40b4b50 2023-06-08T04:23:31.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6f999a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6f40b83f0 0x7fd6f4153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:31.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6f999a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6f40b83f0 0x7fd6f4153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57230/0 (socket says 172.21.15.16:57230) 2023-06-08T04:23:31.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6f999a700 1 -- 172.21.15.16:0/2549026940 learned_addr learned my addr 172.21.15.16:0/2549026940 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-06-08T04:23:31.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6fa19b700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b4b50 0x7fd6f415c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:31.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6fa99c700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40ced40 0x7fd6f4158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:31.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6f999a700 1 -- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b4b50 msgr2=0x7fd6f415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:31.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6f999a700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b4b50 0x7fd6f415c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:31.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6f999a700 1 -- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40ced40 msgr2=0x7fd6f4158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:31.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6f999a700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40ced40 0x7fd6f4158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:31.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6f999a700 1 -- 172.21.15.16:0/2549026940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00094a0 con 0x7fd6f40b83f0 2023-06-08T04:23:31.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.150+0000 7fd6fa99c700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40ced40 0x7fd6f4158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-08T04:23:31.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.151+0000 7fd6f999a700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6f40b83f0 0x7fd6f4153e80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009fd0 tx=0x7fd6e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:31.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.151+0000 7fd6eaffd700 1 -- 172.21.15.16:0/2549026940 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40036a0 con 0x7fd6f40b83f0 2023-06-08T04:23:31.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.151+0000 7fd6eaffd700 1 -- 172.21.15.16:0/2549026940 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e401e070 con 0x7fd6f40b83f0 2023-06-08T04:23:31.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.151+0000 7fd6eaffd700 1 -- 172.21.15.16:0/2549026940 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4003a60 con 0x7fd6f40b83f0 2023-06-08T04:23:31.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.151+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/2549026940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e40094a0 con 0x7fd6f40b83f0 2023-06-08T04:23:31.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.151+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/2549026940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f415da20 con 0x7fd6f40b83f0 2023-06-08T04:23:31.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.152+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/2549026940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f40740e0 con 0x7fd6f40b83f0 2023-06-08T04:23:31.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.153+0000 7fd6eaffd700 1 -- 172.21.15.16:0/2549026940 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6e4003bc0 con 0x7fd6f40b83f0 2023-06-08T04:23:31.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.155+0000 7fd6eaffd700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd6d806ace0 0x7fd6d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-08T04:23:31.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.155+0000 7fd6eaffd700 1 -- 172.21.15.16:0/2549026940 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fd6e408a400 con 0x7fd6f40b83f0 2023-06-08T04:23:31.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.155+0000 7fd6fa19b700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd6d806ace0 0x7fd6d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-08T04:23:31.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.156+0000 7fd6fa19b700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd6d806ace0 0x7fd6d806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009d70 tx=0x7fd6f0009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-08T04:23:31.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.159+0000 7fd6eaffd700 1 -- 172.21.15.16:0/2549026940 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd6e4055420 con 0x7fd6f40b83f0 2023-06-08T04:23:31.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.395+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/2549026940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd6f40b7720 con 0x7fd6f40b83f0 2023-06-08T04:23:31.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.396+0000 7fd6eaffd700 1 -- 172.21.15.16:0/2549026940 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v38) v1 ==== 80+0+122 (secure 0 0 0) 0x7fd6e4058a40 con 0x7fd6f40b83f0 2023-06-08T04:23:31.399 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6833/3183010605 2023-06-09T04:18:27.031938+0000 2023-06-08T04:23:31.400 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16:6832/3183010605 2023-06-09T04:18:27.031938+0000 2023-06-08T04:23:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd6d806ace0 msgr2=0x7fd6d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd6d806ace0 0x7fd6d806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009d70 tx=0x7fd6f0009210 comp rx=0 tx=0).stop 2023-06-08T04:23:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/2549026940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6f40b83f0 msgr2=0x7fd6f4153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-08T04:23:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6f40b83f0 0x7fd6f4153e80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009fd0 tx=0x7fd6e4004750 comp rx=0 tx=0).stop 2023-06-08T04:23:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/2549026940 shutdown_connections 2023-06-08T04:23:31.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:6832/2339348297,v1:172.21.15.169:6833/2339348297] conn(0x7fd6d806ace0 0x7fd6d806d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:31.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f40ced40 0x7fd6f4158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:31.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f40b4b50 0x7fd6f415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:31.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 --2- 172.21.15.16:0/2549026940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6f40b83f0 0x7fd6f4153e80 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-08T04:23:31.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/2549026940 >> 172.21.15.16:0/2549026940 conn(0x7fd6f40cf610 msgr2=0x7fd6f40cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-08T04:23:31.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/2549026940 shutdown_connections 2023-06-08T04:23:31.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-06-08T04:23:31.398+0000 7fd6fc3ff700 1 -- 172.21.15.16:0/2549026940 wait complete. 2023-06-08T04:23:31.404 INFO:teuthology.orchestra.run.smithi016.stderr:listed 2 entries 2023-06-08T04:23:31.420 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-08T04:23:31.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:23:31.421 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-08T04:23:31.522 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2023-06-08T04:23:31.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:23:31.522 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-08T04:23:31.570 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-06-08T04:23:31.570 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:23:31.616 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348776k,nr_inodes=4087194,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.16:6789:/test /tmp/tmp.LAsb5LIhsgtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=e063be5d-be19-46d2-af9e-e986de4a0b1c,acl 0 0 2023-06-08T04:23:31.616 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2023-06-08T04:23:31.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:23:31.617 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-08T04:23:31.702 INFO:teuthology.orchestra.run.smithi016.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-08T04:23:31.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T04:23:31.703 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:23:31.704 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:23:31.813 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345684k,nr_inodes=4086421,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-06-08T04:23:31.813 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2023-06-08T04:23:31.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:23:31.814 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-08T04:23:31.877 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-06-08T04:23:31.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T04:23:31.879 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2023-06-08T04:23:31.879 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-08T04:23:31.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345684k,nr_inodes=4086421,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275008k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-06-08T04:23:31.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2023-06-08T04:23:31.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-08T04:23:31.928 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-08T04:23:31.977 INFO:teuthology.orchestra.run.smithi169.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-08T04:23:31.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-08T04:23:33.585 INFO:tasks.ceph.osd.0:Sent signal 15 2023-06-08T04:23:33.585 INFO:tasks.ceph.osd.1:Sent signal 15 2023-06-08T04:23:33.586 INFO:tasks.ceph.osd.2:Sent signal 15 2023-06-08T04:23:33.586 INFO:tasks.ceph.osd.3:Sent signal 15 2023-06-08T04:23:33.586 INFO:tasks.ceph.osd.4:Sent signal 15 2023-06-08T04:23:33.587 INFO:tasks.ceph.osd.5:Sent signal 15 2023-06-08T04:23:33.587 INFO:tasks.ceph.osd.6:Sent signal 15 2023-06-08T04:23:33.587 INFO:tasks.ceph.osd.7:Sent signal 15 2023-06-08T04:23:33.587 INFO:tasks.ceph.mds.c:Sent signal 15 2023-06-08T04:23:33.588 INFO:tasks.ceph.mds.b:Sent signal 15 2023-06-08T04:23:33.588 INFO:tasks.ceph.mds.d:Sent signal 15 2023-06-08T04:23:33.588 INFO:tasks.ceph.mon.a:Sent signal 15 2023-06-08T04:23:33.589 INFO:tasks.ceph.mon.b:Sent signal 15 2023-06-08T04:23:33.589 INFO:tasks.ceph.mon.c:Sent signal 15 2023-06-08T04:23:33.589 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-06-08T04:23:33.589 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-06-08T04:23:33.590 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-06-08T04:23:33.584+0000 7ff7b5ff8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 108253) UID: 0 2023-06-08T04:23:33.590 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-06-08T04:23:33.584+0000 7ff7b5ff8700 -1 osd.4 38 *** Got signal Terminated *** 2023-06-08T04:23:33.590 INFO:tasks.ceph.osd.4.smithi169.stderr:2023-06-08T04:23:33.584+0000 7ff7b5ff8700 -1 osd.4 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T04:23:33.591 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-06-08T04:23:33.584+0000 7fba111f8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 108256) UID: 0 2023-06-08T04:23:33.591 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-06-08T04:23:33.584+0000 7fba111f8700 -1 osd.5 38 *** Got signal Terminated *** 2023-06-08T04:23:33.591 INFO:tasks.ceph.osd.5.smithi169.stderr:2023-06-08T04:23:33.584+0000 7fba111f8700 -1 osd.5 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T04:23:33.591 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-06-08T04:23:33.584+0000 7f0aec7f8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 108259) UID: 0 2023-06-08T04:23:33.592 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-06-08T04:23:33.584+0000 7f0aec7f8700 -1 osd.6 38 *** Got signal Terminated *** 2023-06-08T04:23:33.592 INFO:tasks.ceph.osd.6.smithi169.stderr:2023-06-08T04:23:33.584+0000 7f0aec7f8700 -1 osd.6 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T04:23:33.592 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-06-08T04:23:33.585+0000 7f639c5f8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 108262) UID: 0 2023-06-08T04:23:33.592 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-06-08T04:23:33.585+0000 7f639c5f8700 -1 osd.7 38 *** Got signal Terminated *** 2023-06-08T04:23:33.593 INFO:tasks.ceph.osd.7.smithi169.stderr:2023-06-08T04:23:33.585+0000 7f639c5f8700 -1 osd.7 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T04:23:33.593 INFO:tasks.ceph.mds.b.smithi169.stderr:2023-06-08T04:23:33.585+0000 7f18e13f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 115783) UID: 0 2023-06-08T04:23:33.593 INFO:tasks.ceph.mds.b.smithi169.stderr:2023-06-08T04:23:33.585+0000 7f18e13f9700 -1 mds.b *** got signal Terminated *** 2023-06-08T04:23:33.593 INFO:tasks.ceph.mds.d.smithi169.stderr:2023-06-08T04:23:33.586+0000 7f07703f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 115784) UID: 0 2023-06-08T04:23:33.594 INFO:tasks.ceph.mds.d.smithi169.stderr:2023-06-08T04:23:33.586+0000 7f07703f9700 -1 mds.d *** got signal Terminated *** 2023-06-08T04:23:33.594 INFO:tasks.ceph.mon.b.smithi169.stderr:2023-06-08T04:23:33.587+0000 7f17ea9ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 107551) UID: 0 2023-06-08T04:23:33.594 INFO:tasks.ceph.mon.b.smithi169.stderr:2023-06-08T04:23:33.587+0000 7f17ea9ff700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-06-08T04:23:33.594 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:23:33.588+0000 7f008d5f7700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 107556) UID: 0 2023-06-08T04:23:33.595 INFO:tasks.ceph.mgr.x.smithi169.stderr:2023-06-08T04:23:33.588+0000 7f008d5f7700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-06-08T04:23:33.595 INFO:tasks.ceph.mon.c.smithi169.stderr:2023-06-08T04:23:33.588+0000 7f4bc13ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 107553) UID: 0 2023-06-08T04:23:33.595 INFO:tasks.ceph.mon.c.smithi169.stderr:2023-06-08T04:23:33.588+0000 7f4bc13ff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-06-08T04:23:33.596 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-06-08T04:23:33.582+0000 7f5c9e7f8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 108004) UID: 0 2023-06-08T04:23:33.596 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-06-08T04:23:33.582+0000 7f5c9e7f8700 -1 osd.0 38 *** Got signal Terminated *** 2023-06-08T04:23:33.596 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-06-08T04:23:33.582+0000 7f5c9e7f8700 -1 osd.0 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T04:23:33.596 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-06-08T04:23:33.583+0000 7f226a7f8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 108009) UID: 0 2023-06-08T04:23:33.596 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-06-08T04:23:33.583+0000 7f226a7f8700 -1 osd.1 38 *** Got signal Terminated *** 2023-06-08T04:23:33.597 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-06-08T04:23:33.583+0000 7f226a7f8700 -1 osd.1 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T04:23:33.597 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-06-08T04:23:33.583+0000 7fadba3f8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 108014) UID: 0 2023-06-08T04:23:33.597 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-06-08T04:23:33.583+0000 7fadba3f8700 -1 osd.2 38 *** Got signal Terminated *** 2023-06-08T04:23:33.597 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-06-08T04:23:33.583+0000 7fadba3f8700 -1 osd.2 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T04:23:33.598 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-06-08T04:23:33.583+0000 7f5d559f8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 108016) UID: 0 2023-06-08T04:23:33.598 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-06-08T04:23:33.583+0000 7f5d559f8700 -1 osd.3 38 *** Got signal Terminated *** 2023-06-08T04:23:33.598 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-06-08T04:23:33.583+0000 7f5d559f8700 -1 osd.3 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-08T04:23:33.598 INFO:tasks.ceph.mds.c.smithi016.stderr:2023-06-08T04:23:33.585+0000 7f392d3f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 121105) UID: 0 2023-06-08T04:23:33.598 INFO:tasks.ceph.mds.c.smithi016.stderr:2023-06-08T04:23:33.585+0000 7f392d3f9700 -1 mds.c *** got signal Terminated *** 2023-06-08T04:23:33.599 INFO:tasks.ceph.mon.a.smithi016.stderr:2023-06-08T04:23:33.586+0000 7f5b3efff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 107641) UID: 0 2023-06-08T04:23:33.599 INFO:tasks.ceph.mon.a.smithi016.stderr:2023-06-08T04:23:33.586+0000 7f5b3efff700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-06-08T04:23:33.790 INFO:tasks.ceph.mgr.y.smithi016.stderr:daemon-helper: command crashed with signal 15 2023-06-08T04:25:48.486 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:25:48.491 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:26:18.664 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:26:18.669 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:26:48.852 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:26:48.857 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:27:19.031 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:27:19.036 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:27:49.201 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:27:49.206 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:28:19.373 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:28:19.378 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:28:49.560 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:28:49.565 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:29:19.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:29:19.768 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:29:49.960 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:29:49.964 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:30:20.130 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:30:20.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:30:50.326 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:30:50.331 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:31:20.505 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:31:20.510 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:31:50.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:31:50.698 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:32:20.880 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:32:20.885 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:32:51.050 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:32:51.055 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:33:21.221 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:33:21.226 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:33:51.417 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:33:51.422 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:34:21.588 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:34:21.594 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:34:51.767 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:34:51.772 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:35:21.929 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:35:21.934 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:35:52.108 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:35:52.113 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:36:22.287 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:36:22.292 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:36:52.474 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:36:52.479 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:37:22.653 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:37:22.658 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:37:52.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:37:52.838 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:38:23.012 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:38:23.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:38:53.199 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:38:53.204 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:39:23.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:39:23.383 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:39:53.557 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:39:53.561 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:40:23.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:40:23.768 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:40:53.965 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:40:53.970 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:41:24.161 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:41:24.166 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:41:54.349 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:41:54.353 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:42:24.461 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:42:24.466 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:42:54.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:42:54.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:43:24.861 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:43:24.866 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:43:55.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:43:55.045 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:44:25.235 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:44:25.240 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:44:55.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:44:55.428 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:45:25.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:45:25.598 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:45:55.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:45:55.768 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:46:25.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:46:25.947 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:46:56.121 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:46:56.126 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:47:26.309 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:47:26.314 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:47:56.497 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:47:56.502 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:48:26.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:48:26.698 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:48:56.863 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:48:56.868 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:49:27.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:49:27.064 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:49:57.238 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:49:57.243 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:50:27.424 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:50:27.430 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:50:57.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:50:57.601 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:51:27.783 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:51:27.788 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:51:57.971 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:51:57.976 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:52:28.175 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:52:28.180 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:52:58.354 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:52:58.359 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:53:28.541 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:53:28.545 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:53:58.728 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:53:58.733 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:54:28.916 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:54:28.921 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:54:59.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:54:59.117 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:55:29.307 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:55:29.311 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:55:59.485 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:55:59.490 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:56:29.594 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:56:29.599 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:56:59.802 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:56:59.807 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:57:30.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:57:30.011 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:58:00.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:58:00.198 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:58:30.364 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:58:30.369 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:59:00.534 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:59:00.539 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:59:30.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T04:59:30.752 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:00:00.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:00:00.948 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:00:31.114 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:00:31.119 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:01:01.284 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:01:01.289 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:01:31.446 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:01:31.451 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:02:01.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:02:01.589 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:02:31.789 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:02:31.793 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:03:01.959 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:03:01.964 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:03:32.154 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:03:32.159 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:04:02.334 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:04:02.338 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:04:32.479 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:04:32.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:05:02.667 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:05:02.672 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:05:32.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:05:32.859 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:06:03.017 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:06:03.021 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:06:33.212 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:06:33.217 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:07:03.332 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:07:03.337 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:07:33.503 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:07:33.508 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:08:03.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:08:03.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:08:33.860 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:08:33.865 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:09:04.056 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:09:04.061 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:09:34.194 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:09:34.199 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:10:04.372 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:10:04.377 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:10:34.552 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:10:34.557 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:11:04.739 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:11:04.744 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:11:34.910 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:11:34.915 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:12:05.098 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:12:05.103 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:12:35.212 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:12:35.217 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:13:05.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:13:05.410 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:13:35.642 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:13:35.647 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:14:05.821 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:14:05.826 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:14:36.017 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:14:36.021 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:15:06.179 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:15:06.184 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:15:36.341 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:15:36.346 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:16:06.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:16:06.458 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:16:36.566 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:16:36.571 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:17:06.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:17:06.750 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:17:36.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:17:36.912 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:18:07.061 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:18:07.065 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:18:37.241 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:18:37.246 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:19:07.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:19:07.441 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:19:37.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:19:37.620 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:20:07.803 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:20:07.807 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:20:38.007 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:20:38.012 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:21:08.185 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:21:08.190 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:21:38.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:21:38.386 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:22:08.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:22:08.573 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:22:38.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:22:38.752 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:23:08.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:23:08.980 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:23:39.089 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:23:39.094 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:24:09.194 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:24:09.199 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:24:39.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:24:39.385 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:25:09.551 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:25:09.556 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:25:39.738 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:25:39.743 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:26:09.926 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:26:09.931 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:26:40.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:26:40.110 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:27:10.275 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:27:10.280 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:27:40.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:27:40.401 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:28:10.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:28:10.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:28:40.776 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:28:40.781 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:29:10.949 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:29:10.954 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:29:41.145 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:29:41.150 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:30:11.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:30:11.321 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:30:41.487 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:30:41.492 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:31:11.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:31:11.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:31:41.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:31:41.858 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:32:12.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:32:12.028 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:32:42.212 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:32:42.217 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:33:12.382 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:33:12.386 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:33:42.543 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:33:42.548 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:34:12.732 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:34:12.736 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:34:42.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:34:42.924 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:35:13.106 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:35:13.111 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:35:43.277 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:35:43.282 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:36:13.456 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:36:13.461 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:36:43.685 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:36:43.690 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:37:13.847 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:37:13.852 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:37:44.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:37:44.013 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:38:14.197 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:38:14.202 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:38:44.392 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:38:44.397 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:39:14.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:39:14.609 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:39:44.801 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:39:44.806 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:40:15.004 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:40:15.009 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:40:45.192 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:40:45.197 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:41:15.308 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:41:15.312 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:41:45.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:41:45.522 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:42:15.646 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:42:15.651 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:42:45.824 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:42:45.829 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:43:16.012 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:43:16.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:43:46.200 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:43:46.205 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:44:16.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:44:16.424 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:44:46.607 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:44:46.612 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:45:16.803 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:45:16.807 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:45:46.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:45:46.979 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:46:17.161 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:46:17.166 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:46:47.298 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:46:47.303 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:47:17.468 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:47:17.474 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:47:47.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:47:47.661 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:48:17.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:48:17.832 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:48:48.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:48:48.028 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:49:18.209 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:49:18.214 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:49:48.389 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:49:48.394 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:50:18.575 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:50:18.580 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:50:48.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:50:48.768 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:51:18.892 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:51:18.898 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:51:49.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:51:49.043 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:52:19.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:52:19.222 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:52:49.388 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:52:49.393 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:53:19.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:53:19.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:53:49.787 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:53:49.792 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:54:19.899 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:54:19.904 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:54:50.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:54:50.092 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:55:20.258 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:55:20.263 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:55:50.428 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:55:50.433 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:56:20.607 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:56:20.612 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:56:50.753 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:56:50.758 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:57:20.949 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:57:20.954 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:57:51.127 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:57:51.132 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:58:21.323 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:58:21.328 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:58:51.511 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:58:51.516 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:59:21.631 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:59:21.636 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:59:51.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T05:59:51.814 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:00:21.918 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:00:21.922 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:00:52.127 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:00:52.132 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:01:22.246 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:01:22.251 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:01:52.435 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:01:52.440 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:02:22.623 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:02:22.628 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:02:52.802 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:02:52.807 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:03:22.972 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:03:22.977 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:03:53.168 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:03:53.173 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:04:23.281 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:04:23.286 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:04:53.469 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:04:53.474 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:05:23.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:05:23.587 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:05:53.750 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:05:53.755 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:06:23.921 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:06:23.926 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:06:54.117 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:06:54.121 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:07:24.304 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:07:24.309 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:07:54.492 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:07:54.496 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:08:24.662 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:08:24.667 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:08:54.841 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:08:54.845 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:09:25.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:09:25.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:09:55.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:09:55.179 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:10:25.353 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:10:25.358 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:10:55.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:10:55.545 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:11:25.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:11:25.716 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:11:55.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:11:55.912 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:12:26.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:12:26.023 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:12:56.190 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:12:56.195 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:13:26.394 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:13:26.398 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:13:56.573 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:13:56.578 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:14:26.760 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:14:26.765 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:14:56.866 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:14:56.872 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:15:27.035 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:15:27.039 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:15:57.214 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:15:57.219 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:16:27.387 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:16:27.391 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:16:57.574 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:16:57.579 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:17:27.761 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:17:27.766 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:17:57.932 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:17:57.937 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:18:28.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:18:28.125 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:18:58.298 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:18:58.303 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:19:28.464 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:19:28.469 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:19:58.640 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:19:58.644 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:20:28.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:20:28.857 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:20:59.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:20:59.044 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:21:29.219 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:21:29.224 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:21:59.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:21:59.411 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:22:29.602 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:22:29.606 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:22:59.807 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:22:59.811 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:23:29.994 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:23:29.998 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:24:00.180 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:24:00.185 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:24:30.376 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:24:30.381 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:25:00.564 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:25:00.569 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:25:30.738 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:25:30.744 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:26:00.930 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:26:00.935 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:26:31.109 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:26:31.114 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:27:01.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:27:01.301 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:27:31.476 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:27:31.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:28:01.638 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:28:01.643 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:28:31.817 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:28:31.822 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:29:02.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:29:02.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:29:32.200 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:29:32.205 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:30:02.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:30:02.368 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:30:32.534 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:30:32.538 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:31:02.712 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:31:02.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:31:32.924 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:31:32.929 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:32:03.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:32:03.117 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:32:33.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:32:33.304 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:33:03.495 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:33:03.501 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:33:33.658 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:33:33.662 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:34:03.787 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:34:03.792 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:34:33.965 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:34:33.970 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:35:04.128 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:35:04.133 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:35:34.307 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:35:34.312 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:36:04.477 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:36:04.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:36:34.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:36:34.671 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:37:04.845 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:37:04.849 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:37:35.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:37:35.046 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:38:05.211 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:38:05.216 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:38:35.416 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:38:35.420 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:39:05.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:39:05.624 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:39:35.807 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:39:35.812 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:40:05.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:40:05.998 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:40:36.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:40:36.161 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:41:06.334 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:41:06.339 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:41:36.464 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:41:36.469 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:42:06.660 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:42:06.665 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:42:36.830 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:42:36.835 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:43:07.001 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:43:07.006 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:43:37.222 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:43:37.228 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:44:07.368 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:44:07.373 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:44:37.573 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:44:37.577 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:45:07.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:45:07.756 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:45:37.938 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:45:37.943 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:46:08.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:46:08.115 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:46:38.221 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:46:38.226 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:47:08.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:47:08.406 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:47:38.597 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:47:38.601 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:48:08.839 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:48:08.844 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:48:39.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:48:39.018 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:49:09.150 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:49:09.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:49:39.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:49:39.330 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:50:09.524 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:50:09.530 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:50:39.705 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:50:39.711 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:51:09.817 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:51:09.823 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:51:39.925 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:51:39.933 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:52:10.117 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:52:10.125 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:52:40.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:52:40.309 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:53:10.502 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:53:10.509 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:53:40.714 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:53:40.720 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:54:10.930 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:54:10.938 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:54:41.134 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:54:41.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:55:11.375 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:55:11.383 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:55:41.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:55:41.578 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:56:11.771 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:56:11.785 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:56:41.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:56:41.972 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:57:12.166 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:57:12.174 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:57:42.364 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:57:42.372 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:58:12.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:58:12.575 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:58:42.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:58:42.751 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:59:12.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:59:12.945 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:59:43.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T06:59:43.115 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:00:13.289 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:00:13.295 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:00:43.462 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:00:43.468 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:01:13.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:01:13.666 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:01:43.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:01:43.857 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:02:14.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:02:14.047 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:02:44.226 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:02:44.231 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:03:14.421 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:03:14.426 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:03:44.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:03:44.614 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:04:14.796 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:04:14.801 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:04:44.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:04:44.988 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:05:15.163 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:05:15.168 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:05:45.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:05:45.346 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:06:15.512 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:06:15.516 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:06:45.699 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:06:45.704 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:07:15.887 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:07:15.892 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:07:46.066 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:07:46.070 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:08:16.253 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:08:16.258 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:08:46.440 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:08:46.445 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:09:16.612 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:09:16.617 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:09:46.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:09:46.804 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:10:16.969 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:10:16.974 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:10:47.081 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:10:47.085 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:11:17.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:11:17.457 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:11:47.624 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:11:47.629 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:12:17.739 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:12:17.744 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:12:47.940 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:12:47.945 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:13:18.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:13:18.124 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:13:48.331 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:13:48.336 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:14:18.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:14:18.533 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:14:48.722 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:14:48.728 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:15:18.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:15:18.889 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:15:49.071 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:15:49.076 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:16:19.284 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:16:19.289 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:16:49.463 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:16:49.468 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:17:19.650 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:17:19.655 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:17:49.838 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:17:49.846 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:18:20.025 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:18:20.030 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:18:50.230 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:18:50.235 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:19:20.425 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:19:20.429 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:19:50.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:19:50.611 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:20:20.791 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:20:20.796 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:20:50.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:20:50.974 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:21:21.091 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:21:21.096 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:21:51.295 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:21:51.300 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:22:21.473 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:22:21.478 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:22:51.660 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:22:51.665 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:23:21.823 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:23:21.828 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:23:52.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:23:52.024 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:24:22.206 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:24:22.211 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:24:52.377 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:24:52.383 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:25:22.582 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:25:22.587 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:25:52.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:25:52.756 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:26:22.947 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:26:22.952 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:26:53.060 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:26:53.065 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:27:23.239 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:27:23.245 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:27:53.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:27:53.407 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:28:23.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:28:23.610 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:28:53.834 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:28:53.841 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:29:24.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:29:24.027 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:29:54.201 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:29:54.206 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:30:24.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:30:24.377 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:30:54.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:30:54.564 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:31:24.697 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:31:24.701 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:31:54.875 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:31:54.880 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:32:25.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:32:25.060 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:32:55.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:32:55.230 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:33:25.412 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:33:25.418 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:33:55.542 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:33:55.547 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:34:25.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:34:25.734 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:34:55.916 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:34:55.921 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:35:26.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:35:26.109 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:35:56.309 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:35:56.317 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:36:26.461 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:36:26.466 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:36:56.641 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:36:56.646 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:37:26.828 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:37:26.833 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:37:57.007 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:37:57.012 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:38:27.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:38:27.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:38:57.307 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:38:57.312 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:39:27.486 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:39:27.492 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:39:57.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:39:57.671 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:40:27.794 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:40:27.799 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:40:57.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:40:57.941 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:41:28.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:41:28.116 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:41:58.281 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:41:58.287 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:42:28.394 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:42:28.399 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:42:58.580 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:42:58.585 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:43:28.760 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:43:28.765 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:43:58.931 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:43:58.937 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:44:29.101 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:44:29.105 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:44:59.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:44:59.310 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:45:29.492 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:45:29.497 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:45:59.680 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:45:59.685 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:46:29.850 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:46:29.856 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:47:00.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:47:00.026 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:47:30.191 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:47:30.196 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:48:00.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:48:00.387 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:48:30.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:48:30.565 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:49:00.739 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:49:00.744 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:49:30.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:49:30.933 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:50:01.129 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:50:01.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:50:31.266 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:50:31.271 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:51:01.461 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:51:01.467 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:51:31.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:51:31.655 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:52:01.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:52:01.837 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:52:32.015 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:52:32.021 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:53:02.204 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:53:02.221 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:53:32.416 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:53:32.421 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:54:02.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:54:02.600 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:54:32.781 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:54:32.786 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:55:02.968 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:55:02.974 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:55:33.147 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:55:33.152 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:56:03.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:56:03.357 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:56:33.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:56:33.544 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:57:03.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:57:03.724 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:57:33.897 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:57:33.902 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:58:04.092 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:58:04.098 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:58:34.271 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:58:34.276 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:59:04.449 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:59:04.454 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:59:34.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T07:59:34.642 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:00:04.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:00:04.749 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:00:34.938 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:00:34.944 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:01:05.150 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:01:05.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:01:35.337 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:01:35.343 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:02:05.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:02:05.526 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:02:35.712 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:02:35.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:03:05.900 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:03:05.905 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:03:36.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:03:36.118 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:04:06.291 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:04:06.297 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:04:36.462 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:04:36.467 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:05:06.673 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:05:06.679 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:05:36.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:05:36.870 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:06:07.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:06:07.054 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:06:37.233 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:06:37.238 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:07:07.407 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:07:07.412 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:07:37.588 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:07:37.593 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:08:07.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:08:07.787 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:08:37.969 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:08:37.975 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:09:08.131 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:09:08.136 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:09:38.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:09:38.249 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:10:08.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:10:08.463 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:10:38.644 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:10:38.649 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:11:08.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:11:08.869 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:11:39.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:11:39.064 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:12:09.255 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:12:09.260 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:12:39.451 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:12:39.456 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:13:09.613 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:13:09.618 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:13:39.801 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:13:39.806 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:14:09.980 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:14:09.985 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:14:40.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:14:40.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:15:10.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:15:10.387 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:15:40.550 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:15:40.556 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:16:10.779 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:16:10.784 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:16:40.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:16:40.972 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:17:11.138 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:17:11.143 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:17:41.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:17:41.321 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:18:11.479 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:18:11.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:18:41.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:18:41.671 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:19:11.871 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:19:11.876 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:19:42.051 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:19:42.056 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:20:12.220 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:20:12.226 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:20:42.408 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:20:42.414 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:21:12.545 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:21:12.550 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:21:42.725 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:21:42.732 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:22:12.904 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:22:12.914 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:22:43.083 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:22:43.089 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:23:13.254 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:23:13.260 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:23:43.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:23:43.392 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:24:13.554 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:24:13.559 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:24:43.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:24:43.772 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:25:13.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:25:13.941 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:25:44.145 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:25:44.153 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:26:14.287 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:26:14.293 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:26:44.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:26:44.463 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:27:14.645 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:27:14.650 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:27:44.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:27:44.837 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:28:15.003 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:28:15.009 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:28:45.157 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:28:45.163 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:29:15.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:29:15.274 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:29:45.448 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:29:45.454 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:30:15.635 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:30:15.640 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:30:45.770 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:30:45.775 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:31:15.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:31:15.940 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:31:46.123 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:31:46.129 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:32:16.311 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:32:16.317 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:32:46.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:32:46.502 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:33:16.685 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:33:16.691 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:33:46.872 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:33:46.877 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:34:17.060 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:34:17.065 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:34:47.248 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:34:47.254 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:35:17.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:35:17.441 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:35:47.631 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:35:47.636 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:36:17.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:36:17.815 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:36:47.989 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:36:47.994 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:37:18.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:37:18.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:37:48.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:37:48.352 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:38:18.518 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:38:18.523 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:38:48.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:38:48.701 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:39:18.893 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:39:18.898 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:39:49.080 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:39:49.085 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:40:19.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:40:19.281 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:40:49.447 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:40:49.452 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:41:19.625 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:41:19.631 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:41:49.821 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:41:49.827 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:42:19.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:42:19.947 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:42:50.122 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:42:50.127 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:43:20.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:43:20.305 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:43:50.479 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:43:50.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:44:20.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:44:20.655 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:44:50.821 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:44:50.826 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:45:21.008 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:45:21.013 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:45:51.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:45:51.200 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:46:21.374 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:46:21.379 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:46:51.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:46:51.584 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:47:21.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:47:21.770 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:47:51.928 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:47:51.933 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:48:22.090 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:48:22.095 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:48:52.262 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:48:52.269 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:49:22.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:49:22.462 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:49:52.655 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:49:52.660 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:50:22.840 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:50:22.846 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:50:53.044 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:50:53.049 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:51:23.223 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:51:23.231 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:51:53.411 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:51:53.416 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:52:23.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:52:23.595 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:52:53.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:52:53.777 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:53:23.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:53:23.977 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:53:54.168 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:53:54.173 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:54:24.372 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:54:24.377 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:54:54.560 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:54:54.564 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:55:24.740 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:55:24.745 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:55:54.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:55:54.940 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:56:25.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:56:25.052 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:56:55.251 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:56:55.257 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:57:25.447 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:57:25.452 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:57:55.618 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:57:55.624 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:58:25.821 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:58:25.831 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:58:56.018 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:58:56.023 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:59:26.196 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:59:26.202 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:59:56.367 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T08:59:56.372 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:00:26.545 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:00:26.550 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:00:56.733 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:00:56.738 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:01:26.896 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:01:26.901 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:01:57.075 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:01:57.080 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:02:27.271 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:02:27.276 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:02:57.442 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:02:57.447 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:03:27.640 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:03:27.645 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:03:57.825 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:03:57.830 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:04:27.988 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:04:27.995 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:04:58.201 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:04:58.206 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:05:28.379 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:05:28.384 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:05:58.508 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:05:58.513 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:06:28.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:06:28.700 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:06:58.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:06:58.888 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:07:29.070 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:07:29.075 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:07:59.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:07:59.262 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:08:29.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:08:29.475 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:08:59.657 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:08:59.663 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:09:29.827 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:09:29.832 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:10:00.031 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:10:00.036 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:10:30.211 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:10:30.217 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:11:00.356 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:11:00.361 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:11:30.535 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:11:30.540 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:12:00.722 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:12:00.727 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:12:30.834 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:12:30.840 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:13:01.031 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:13:01.035 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:13:31.159 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:13:31.164 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:14:01.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:14:01.343 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:14:31.526 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:14:31.532 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:15:01.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:15:01.693 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:15:31.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:15:31.889 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:16:02.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:16:02.027 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:16:32.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:16:32.230 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:17:02.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:17:02.401 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:17:32.575 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:17:32.580 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:18:02.771 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:18:02.776 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:18:32.900 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:18:32.906 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:19:03.054 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:19:03.060 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:19:33.234 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:19:33.239 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:20:03.428 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:20:03.433 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:20:33.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:20:33.638 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:21:03.819 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:21:03.824 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:21:34.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:21:34.021 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:22:04.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:22:04.200 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:22:34.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:22:34.405 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:23:04.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:23:04.600 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:23:34.783 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:23:34.787 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:24:04.902 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:24:04.907 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:24:35.081 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:24:35.086 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:25:05.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:25:05.249 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:25:35.424 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:25:35.431 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:26:05.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:26:05.624 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:26:35.789 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:26:35.794 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:27:05.976 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:27:05.982 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:27:36.180 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:27:36.186 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:28:06.368 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:28:06.373 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:28:36.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:28:36.568 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:29:06.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:29:06.756 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:29:36.938 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:29:36.943 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:30:07.134 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:30:07.139 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:30:37.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:30:37.318 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:31:07.501 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:31:07.506 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:31:37.705 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:31:37.710 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:32:07.883 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:32:07.892 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:32:38.063 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:32:38.068 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:33:08.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:33:08.263 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:33:38.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:33:38.385 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:34:08.557 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:34:08.563 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:34:38.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:34:38.741 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:35:08.924 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:35:08.929 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:35:39.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:35:39.100 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:36:09.284 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:36:09.289 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:36:39.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:36:39.475 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:37:09.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:37:09.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:37:39.870 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:37:39.879 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:38:10.056 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:38:10.061 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:38:40.228 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:38:40.233 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:39:10.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:39:10.428 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:39:40.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:39:40.614 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:40:10.773 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:40:10.777 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:40:40.910 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:40:40.915 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:41:11.098 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:41:11.103 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:41:41.269 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:41:41.274 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:42:11.455 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:42:11.460 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:42:41.618 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:42:41.624 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:43:11.732 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:43:11.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:43:41.926 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:43:41.931 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:44:12.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:44:12.109 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:44:42.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:44:42.305 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:45:12.487 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:45:12.493 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:45:42.675 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:45:42.680 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:46:12.863 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:46:12.868 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:46:43.058 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:46:43.063 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:47:13.239 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:47:13.247 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:47:43.417 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:47:43.422 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:48:13.620 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:48:13.628 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:48:43.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:48:43.808 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:49:13.995 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:49:14.001 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:49:44.173 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:49:44.179 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:50:14.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:50:14.383 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:50:44.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:50:44.590 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:51:14.760 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:51:14.765 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:51:44.931 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:51:44.937 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:52:15.118 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:52:15.123 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:52:45.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:52:45.230 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:53:15.419 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:53:15.424 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:53:45.613 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:53:45.618 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:54:15.793 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:54:15.798 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:54:45.988 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:54:45.993 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:55:16.168 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:55:16.172 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:55:46.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:55:46.386 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:56:16.541 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:56:16.546 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:56:46.712 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:56:46.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:57:16.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:57:16.922 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:57:47.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:57:47.117 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:58:17.308 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:58:17.314 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:58:47.495 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:58:47.500 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:59:17.683 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:59:17.688 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:59:47.861 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T09:59:47.866 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:00:18.042 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:00:18.047 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:00:48.171 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:00:48.177 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:01:18.291 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:01:18.297 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:01:48.488 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:01:48.493 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:02:18.659 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:02:18.664 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:02:48.855 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:02:48.860 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:03:18.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:03:18.989 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:03:49.170 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:03:49.177 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:04:19.366 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:04:19.371 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:04:49.561 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:04:49.566 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:05:19.740 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:05:19.745 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:05:49.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:05:49.884 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:06:20.083 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:06:20.089 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:06:50.252 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:06:50.257 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:07:20.448 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:07:20.453 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:07:50.644 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:07:50.650 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:08:20.781 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:08:20.786 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:08:50.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:08:50.990 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:09:21.181 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:09:21.186 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:09:51.376 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:09:51.389 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:10:21.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:10:21.576 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:10:51.777 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:10:51.783 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:11:21.955 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:11:21.961 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:11:52.067 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:11:52.072 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:12:22.190 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:12:22.196 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:12:52.358 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:12:52.363 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:13:22.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:13:22.560 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:13:52.733 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:13:52.739 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:14:22.932 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:14:22.938 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:14:53.118 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:14:53.125 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:15:23.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:15:23.326 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:15:53.491 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:15:53.496 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:16:23.682 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:16:23.687 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:16:53.849 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:16:53.854 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:17:24.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:17:24.026 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:17:54.207 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:17:54.212 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:18:24.377 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:18:24.382 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:18:54.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:18:54.561 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:19:24.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:19:24.734 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:19:54.898 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:19:54.903 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:20:25.086 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:20:25.091 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:20:55.281 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:20:55.286 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:21:25.452 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:21:25.460 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:21:55.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:21:55.644 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:22:25.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:22:25.831 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:22:55.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:22:56.003 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:23:26.202 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:23:26.207 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:23:56.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:23:56.411 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:24:26.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:24:26.589 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:24:56.779 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:24:56.785 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:25:26.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:25:26.955 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:25:57.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:25:57.153 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:26:27.333 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:26:27.338 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:26:57.520 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:26:57.525 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:27:27.708 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:27:27.713 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:27:57.872 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:27:57.877 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:28:28.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:28:28.046 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:28:58.227 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:28:58.232 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:29:28.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:29:28.411 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:29:58.586 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:29:58.591 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:30:28.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:30:28.771 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:30:58.928 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:30:58.935 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:31:29.107 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:31:29.112 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:31:59.269 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:31:59.274 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:32:29.464 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:32:29.469 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:32:59.660 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:32:59.665 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:33:29.846 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:33:29.853 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:34:00.043 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:34:00.048 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:34:30.222 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:34:30.226 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:35:00.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:35:00.396 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:35:30.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:35:30.611 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:36:00.793 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:36:00.798 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:36:30.976 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:36:30.983 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:37:01.188 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:37:01.194 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:37:31.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:37:31.386 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:38:01.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:38:01.589 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:38:31.754 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:38:31.759 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:39:01.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:39:01.923 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:39:32.113 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:39:32.118 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:40:02.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:40:02.305 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:40:32.426 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:40:32.432 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:41:02.624 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:41:02.629 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:41:32.803 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:41:32.808 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:42:02.999 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:42:03.004 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:42:33.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:42:33.119 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:43:03.323 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:43:03.328 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:43:33.485 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:43:33.491 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:44:03.690 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:44:03.695 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:44:33.860 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:44:33.866 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:45:04.031 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:45:04.037 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:45:34.227 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:45:34.232 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:46:04.397 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:46:04.403 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:46:34.560 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:46:34.565 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:47:04.739 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:47:04.744 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:47:34.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:47:34.948 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:48:05.155 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:48:05.160 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:48:35.343 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:48:35.348 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:49:05.529 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:49:05.534 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:49:35.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:49:35.723 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:50:05.823 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:50:05.829 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:50:36.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:50:36.033 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:51:06.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:51:06.201 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:51:36.374 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:51:36.379 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:52:06.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:52:06.576 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:52:36.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:52:36.771 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:53:06.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:53:06.917 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:53:37.107 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:53:37.113 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:54:07.303 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:54:07.310 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:54:37.482 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:54:37.486 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:55:07.670 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:55:07.675 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:55:37.815 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:55:37.820 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:56:07.986 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:56:07.991 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:56:38.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:56:38.170 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:57:08.343 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:57:08.348 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:57:38.533 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:57:38.538 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:58:08.676 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:58:08.681 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:58:38.788 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:58:38.793 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:59:08.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:59:08.972 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:59:39.189 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T10:59:39.195 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:00:09.386 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:00:09.395 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:00:39.530 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:00:39.535 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:01:09.726 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:01:09.731 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:01:39.904 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:01:39.910 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:02:10.084 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:02:10.090 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:02:40.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:02:40.293 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:03:10.484 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:03:10.489 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:03:40.662 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:03:40.667 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:04:10.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:04:10.839 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:04:41.012 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:04:41.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:05:11.200 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:05:11.205 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:05:41.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:05:41.401 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:06:11.590 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:06:11.595 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:06:41.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:06:41.787 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:07:11.957 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:07:11.963 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:07:42.144 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:07:42.150 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:08:12.349 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:08:12.355 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:08:42.544 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:08:42.549 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:09:12.738 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:09:12.744 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:09:42.928 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:09:42.934 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:10:13.106 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:10:13.111 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:10:43.285 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:10:43.291 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:11:13.489 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:11:13.497 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:11:43.670 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:11:43.676 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:12:13.872 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:12:13.877 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:12:44.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:12:44.100 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:13:14.280 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:13:14.286 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:13:44.485 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:13:44.491 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:14:14.700 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:14:14.706 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:14:44.876 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:14:44.883 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:15:15.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:15:15.060 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:15:45.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:15:45.236 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:16:15.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:16:15.411 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:16:45.579 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:16:45.585 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:17:15.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:17:15.763 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:17:45.957 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:17:45.963 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:18:16.155 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:18:16.163 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:18:46.265 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:18:46.271 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:19:16.444 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:19:16.450 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:19:46.565 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:19:46.571 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:20:16.761 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:20:16.767 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:20:46.873 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:20:46.878 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:21:17.053 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:21:17.059 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:21:47.207 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:21:47.213 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:22:17.402 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:22:17.408 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:22:47.581 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:22:47.586 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:23:17.760 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:23:17.765 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:23:47.948 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:23:47.955 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:24:18.128 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:24:18.133 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:24:48.298 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:24:48.304 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:25:18.494 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:25:18.499 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:25:48.664 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:25:48.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:26:18.834 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:26:18.839 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:26:48.999 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:26:49.004 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:27:19.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:27:19.198 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:27:49.388 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:27:49.394 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:28:19.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:28:19.572 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:28:49.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:28:49.751 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:29:19.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:29:19.923 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:29:50.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:29:50.110 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:30:20.308 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:30:20.314 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:30:50.504 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:30:50.509 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:31:20.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:31:20.621 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:31:50.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:31:50.809 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:32:20.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:32:20.989 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:32:51.179 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:32:51.185 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:33:21.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:33:21.304 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:33:51.485 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:33:51.490 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:34:21.691 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:34:21.697 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:34:51.870 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:34:51.875 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:35:22.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:35:22.054 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:35:52.220 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:35:52.225 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:36:22.415 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:36:22.421 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:36:52.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:36:52.601 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:37:22.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:37:22.770 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:37:52.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:37:52.993 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:38:23.181 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:38:23.187 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:38:53.367 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:38:53.372 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:39:23.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:39:23.544 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:39:53.725 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:39:53.730 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:40:23.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:40:23.927 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:40:54.109 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:40:54.115 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:41:24.280 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:41:24.285 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:41:54.461 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:41:54.465 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:42:24.579 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:42:24.585 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:42:54.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:42:54.706 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:43:24.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:43:24.884 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:43:55.076 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:43:55.081 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:44:25.254 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:44:25.259 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:44:55.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:44:55.446 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:45:25.562 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:45:25.566 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:45:55.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:45:55.771 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:46:25.962 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:46:25.967 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:46:56.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:46:56.138 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:47:26.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:47:26.307 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:47:56.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:47:56.428 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:48:26.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:48:26.624 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:48:56.807 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:48:56.811 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:49:27.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:49:27.007 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:49:57.173 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:49:57.177 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:50:27.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:50:27.324 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:50:57.506 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:50:57.511 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:51:27.668 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:51:27.674 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:51:57.814 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:51:57.819 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:52:27.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:52:27.999 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:52:58.181 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:52:58.186 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:53:28.359 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:53:28.364 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:53:58.521 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:53:58.526 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:54:28.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:54:28.707 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:54:58.880 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:54:58.885 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:55:29.050 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:55:29.056 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:55:59.237 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:55:59.242 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:56:29.433 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:56:29.438 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:56:59.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:56:59.633 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:57:29.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:57:29.804 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:57:59.966 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:57:59.971 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:58:30.157 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:58:30.162 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:59:00.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:59:00.343 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:59:30.541 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T11:59:30.545 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:00:00.728 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:00:00.734 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:00:30.899 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:00:30.904 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:01:01.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:01:01.083 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:01:31.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:01:31.244 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:02:01.419 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:02:01.424 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:02:31.581 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:02:31.586 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:03:01.768 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:03:01.774 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:03:31.939 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:03:31.944 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:04:02.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:04:02.140 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:04:32.306 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:04:32.313 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:05:02.484 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:05:02.489 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:05:32.688 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:05:32.695 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:06:02.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:06:02.872 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:06:33.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:06:33.051 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:07:03.237 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:07:03.242 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:07:33.412 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:07:33.417 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:08:03.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:08:03.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:08:33.762 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:08:33.768 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:09:03.933 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:09:03.938 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:09:34.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:09:34.125 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:10:04.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:10:04.321 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:10:34.512 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:10:34.518 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:11:04.716 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:11:04.721 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:11:34.903 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:11:34.908 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:12:05.082 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:12:05.087 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:12:35.212 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:12:35.217 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:13:05.328 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:13:05.333 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:13:35.511 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:13:35.516 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:14:05.698 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:14:05.704 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:14:35.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:14:35.890 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:15:06.090 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:15:06.095 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:15:36.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:15:36.198 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:16:06.364 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:16:06.369 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:16:36.551 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:16:36.556 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:17:06.722 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:17:06.728 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:17:36.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:17:36.856 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:18:07.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:18:07.027 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:18:37.192 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:18:37.197 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:19:07.388 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:19:07.393 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:19:37.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:19:37.573 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:20:07.754 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:20:07.759 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:20:37.925 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:20:37.931 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:21:08.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:21:08.118 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:21:38.291 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:21:38.296 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:22:08.462 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:22:08.467 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:22:38.650 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:22:38.654 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:23:08.828 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:23:08.833 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:23:38.990 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:23:38.994 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:24:09.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:24:09.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:24:39.356 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:24:39.361 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:25:09.501 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:25:09.506 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:25:39.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:25:39.694 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:26:09.876 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:26:09.881 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:26:40.056 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:26:40.061 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:27:10.168 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:27:10.172 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:27:40.388 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:27:40.393 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:28:10.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:28:10.581 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:28:40.771 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:28:40.776 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:29:10.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:29:10.972 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:29:41.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:29:41.151 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:30:11.349 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:30:11.354 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:30:41.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:30:41.542 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:31:11.724 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:31:11.729 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:31:41.911 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:31:41.916 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:32:12.091 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:32:12.095 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:32:42.211 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:32:42.216 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:33:12.398 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:33:12.403 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:33:42.586 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:33:42.591 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:34:12.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:34:12.770 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:34:42.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:34:42.940 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:35:13.072 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:35:13.077 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:35:43.188 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:35:43.193 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:36:13.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:36:13.368 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:36:43.551 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:36:43.556 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:37:13.749 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:37:13.754 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:37:43.892 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:37:43.897 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:38:14.071 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:38:14.076 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:38:44.250 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:38:44.255 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:39:14.373 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:39:14.378 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:39:44.557 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:39:44.562 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:40:14.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:40:14.683 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:40:44.873 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:40:44.878 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:41:15.069 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:41:15.074 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:41:45.253 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:41:45.258 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:42:15.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:42:15.441 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:42:45.607 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:42:45.611 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:43:15.769 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:43:15.774 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:43:45.981 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:43:45.986 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:44:16.160 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:44:16.165 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:44:46.364 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:44:46.369 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:45:16.551 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:45:16.556 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:45:46.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:45:46.753 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:46:16.870 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:46:16.875 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:46:47.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:46:47.052 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:47:17.234 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:47:17.238 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:47:47.429 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:47:47.434 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:48:17.600 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:48:17.605 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:48:47.721 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:48:47.725 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:49:17.899 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:49:17.904 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:49:48.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:49:48.091 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:50:18.200 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:50:18.205 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:50:48.379 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:50:48.383 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:51:18.524 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:51:18.529 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:51:48.703 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:51:48.708 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:52:18.899 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:52:18.904 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:52:49.077 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:52:49.082 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:53:19.274 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:53:19.279 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:53:49.477 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:53:49.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:54:19.673 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:54:19.678 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:54:49.860 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:54:49.865 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:55:20.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:55:20.052 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:55:50.218 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:55:50.223 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:56:20.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:56:20.401 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:56:50.575 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:56:50.580 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:57:20.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:57:20.776 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:57:50.933 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:57:50.937 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:58:21.113 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:58:21.118 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:58:51.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:58:51.321 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:59:21.487 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:59:21.492 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:59:51.691 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T12:59:51.696 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:00:21.805 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:00:21.810 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:00:51.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:00:51.979 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:01:22.090 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:01:22.096 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:01:52.266 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:01:52.271 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:02:22.478 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:02:22.483 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:02:52.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:02:52.623 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:03:22.819 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:03:22.824 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:03:53.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:03:53.028 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:04:23.218 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:04:23.223 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:04:53.414 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:04:53.419 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:05:23.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:05:23.598 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:05:53.788 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:05:53.793 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:06:23.959 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:06:23.964 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:06:54.130 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:06:54.134 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:07:24.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:07:24.347 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:07:54.529 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:07:54.534 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:08:24.647 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:08:24.652 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:08:54.838 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:08:54.842 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:09:25.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:09:25.029 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:09:55.229 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:09:55.233 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:10:25.416 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:10:25.421 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:10:55.603 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:10:55.608 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:11:25.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:11:25.771 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:11:55.878 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:11:55.883 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:12:26.057 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:12:26.062 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:12:56.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:12:56.240 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:13:26.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:13:26.428 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:13:56.611 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:13:56.616 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:14:26.781 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:14:26.786 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:14:56.968 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:14:56.973 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:15:27.147 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:15:27.152 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:15:57.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:15:57.323 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:16:27.533 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:16:27.538 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:16:57.726 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:16:57.731 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:17:27.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:17:27.927 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:17:58.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:17:58.115 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:18:28.271 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:18:28.276 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:18:58.450 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:18:58.455 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:19:28.646 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:19:28.651 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:19:58.825 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:19:58.829 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:20:29.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:20:29.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:20:59.183 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:20:59.187 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:21:29.361 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:21:29.366 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:21:59.474 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:21:59.479 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:22:29.600 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:22:29.605 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:22:59.774 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:22:59.778 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:23:29.944 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:23:29.949 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:24:00.123 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:24:00.128 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:24:30.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:24:30.307 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:25:00.440 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:25:00.444 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:25:30.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:25:30.623 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:26:00.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:26:00.811 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:26:30.918 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:26:30.923 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:27:01.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:27:01.102 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:27:31.251 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:27:31.255 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:28:01.430 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:28:01.435 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:28:31.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:28:31.630 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:29:01.797 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:29:01.802 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:29:32.001 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:29:32.005 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:30:02.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:30:02.117 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:30:32.325 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:30:32.330 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:31:02.521 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:31:02.527 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:31:32.700 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:31:32.705 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:32:02.887 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:32:02.892 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:32:33.075 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:32:33.080 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:33:03.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:33:03.275 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:33:33.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:33:33.462 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:34:03.653 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:34:03.659 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:34:33.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:34:33.837 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:35:03.995 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:35:04.000 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:35:34.165 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:35:34.170 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:36:04.345 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:36:04.350 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:36:34.532 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:36:34.537 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:37:04.710 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:37:04.715 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:37:34.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:37:34.894 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:38:05.060 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:38:05.099 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:38:35.281 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:38:35.285 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:39:05.452 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:39:05.457 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:39:35.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:39:35.644 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:40:05.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:40:05.831 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:40:36.015 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:40:36.020 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:41:06.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:41:06.197 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:41:36.372 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:41:36.376 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:42:06.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:42:06.581 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:42:36.697 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:42:36.702 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:43:06.883 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:43:06.888 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:43:37.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:43:37.051 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:44:07.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:44:07.154 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:44:37.329 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:44:37.334 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:45:07.495 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:45:07.500 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:45:37.670 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:45:37.675 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:46:07.866 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:46:07.871 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:46:38.053 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:46:38.058 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:47:08.241 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:47:08.246 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:47:38.422 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:47:38.427 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:48:08.592 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:48:08.597 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:48:38.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:48:38.760 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:49:08.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:49:08.948 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:49:39.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:49:39.109 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:50:09.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:50:09.305 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:50:39.479 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:50:39.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:51:09.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:51:09.671 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:51:39.828 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:51:39.834 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:52:10.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:52:10.021 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:52:40.212 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:52:40.217 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:53:10.390 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:53:10.395 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:53:40.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:53:40.583 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:54:10.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:54:10.770 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:54:40.953 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:54:40.958 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:55:11.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:55:11.120 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:55:41.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:55:41.307 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:56:11.465 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:56:11.469 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:56:41.652 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:56:41.656 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:57:11.856 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:57:11.861 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:57:42.043 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:57:42.048 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:58:12.222 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:58:12.227 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:58:42.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:58:42.406 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:59:12.588 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:59:12.593 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:59:42.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T13:59:42.805 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:00:12.988 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:00:12.993 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:00:43.192 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:00:43.197 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:01:13.362 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:01:13.367 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:01:43.550 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:01:43.555 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:02:13.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:02:13.751 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:02:43.916 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:02:43.921 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:03:14.096 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:03:14.101 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:03:44.266 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:03:44.271 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:04:14.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:04:14.441 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:04:44.640 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:04:44.645 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:05:14.836 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:05:14.841 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:05:44.954 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:05:44.959 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:06:15.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:06:15.141 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:06:45.306 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:06:45.311 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:07:15.518 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:07:15.524 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:07:45.706 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:07:45.711 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:08:15.901 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:08:15.906 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:08:46.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:08:46.102 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:09:16.277 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:09:16.281 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:09:46.455 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:09:46.460 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:10:16.659 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:10:16.664 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:10:46.786 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:10:46.791 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:11:16.951 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:11:16.956 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:11:47.113 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:11:47.118 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:12:17.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:12:17.250 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:12:47.430 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:12:47.435 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:13:17.599 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:13:17.604 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:13:47.779 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:13:47.784 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:14:17.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:14:17.979 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:14:48.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:14:48.116 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:15:18.282 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:15:18.288 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:15:48.454 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:15:48.458 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:16:18.632 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:16:18.637 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:16:48.811 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:16:48.816 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:17:18.940 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:17:18.945 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:17:49.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:17:49.115 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:18:19.298 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:18:19.303 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:18:49.477 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:18:49.482 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:19:19.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:19:19.661 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:19:49.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:19:49.777 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:20:19.981 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:20:19.986 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:20:50.159 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:20:50.164 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:21:20.355 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:21:20.360 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:21:50.534 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:21:50.538 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:22:20.705 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:22:20.709 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:22:50.892 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:22:50.897 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:23:21.071 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:23:21.076 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:23:51.267 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:23:51.272 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:24:21.462 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:24:21.467 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:24:51.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:24:51.654 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:25:21.845 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:25:21.849 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:25:52.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:25:52.046 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:26:22.229 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:26:22.234 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:26:52.390 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:26:52.395 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:27:22.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:27:22.583 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:27:52.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:27:52.753 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:28:22.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:28:22.941 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:28:53.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:28:53.120 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:29:23.294 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:29:23.299 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:29:53.473 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:29:53.478 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:30:23.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:30:23.684 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:30:53.881 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:30:53.886 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:31:24.076 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:31:24.081 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:31:54.264 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:31:54.269 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:32:24.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:32:24.448 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:32:54.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:32:54.611 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:33:24.776 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:33:24.781 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:33:54.947 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:33:54.951 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:34:25.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:34:25.130 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:34:55.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:34:55.326 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:35:25.525 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:35:25.530 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:35:55.712 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:35:55.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:36:25.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:36:25.912 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:36:56.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:36:56.082 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:37:26.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:37:26.261 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:37:56.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:37:56.448 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:38:26.631 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:38:26.636 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:38:56.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:38:56.751 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:39:26.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:39:26.927 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:39:57.101 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:39:57.208 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:40:27.379 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:40:27.384 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:40:57.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:40:57.588 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:41:27.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:41:27.759 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:41:57.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:41:57.946 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:42:28.045 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:42:28.051 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:42:58.241 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:42:58.246 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:43:28.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:43:28.425 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:43:58.668 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:43:58.673 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:44:28.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:44:28.866 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:44:59.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:44:59.044 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:45:29.211 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:45:29.216 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:45:59.415 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:45:59.419 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:46:29.602 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:46:29.607 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:46:59.797 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:46:59.802 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:47:29.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:47:29.998 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:48:00.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:48:00.169 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:48:30.343 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:48:30.348 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:49:00.521 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:49:00.526 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:49:30.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:49:30.722 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:50:00.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:50:00.884 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:50:31.068 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:50:31.072 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:51:01.246 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:51:01.250 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:51:31.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:51:31.446 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:52:01.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:52:01.642 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:52:31.824 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:52:31.829 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:53:01.994 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:53:01.999 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:53:32.157 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:53:32.162 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:54:02.344 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:54:02.349 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:54:32.549 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:54:32.553 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:55:02.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:55:02.748 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:55:32.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:55:32.927 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:56:03.102 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:56:03.107 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:56:33.272 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:56:33.277 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:57:03.476 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:57:03.481 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:57:33.672 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:57:33.677 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:58:03.835 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:58:03.840 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:58:34.030 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:58:34.035 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:59:04.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:59:04.230 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:59:34.429 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T14:59:34.434 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:00:04.625 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:00:04.631 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:00:34.829 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:00:34.834 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:01:05.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:01:05.021 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:01:35.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:01:35.192 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:02:05.440 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:02:05.446 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:02:35.645 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:02:35.650 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:03:05.761 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:03:05.767 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:03:35.945 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:03:35.949 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:04:06.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:04:06.137 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:04:36.277 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:04:36.282 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:05:06.464 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:05:06.470 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:05:36.653 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:05:36.657 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:06:06.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:06:06.827 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:06:37.027 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:06:37.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:07:07.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:07:07.161 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:07:37.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:07:37.356 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:08:07.530 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:08:07.535 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:08:37.726 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:08:37.731 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:09:07.921 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:09:07.926 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:09:38.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:09:38.064 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:10:08.246 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:10:08.250 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:10:38.362 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:10:38.366 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:11:08.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:11:08.567 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:11:38.754 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:11:38.759 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:12:08.929 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:12:08.934 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:12:39.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:12:39.138 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:13:09.328 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:13:09.334 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:13:39.516 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:13:39.522 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:14:09.720 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:14:09.726 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:14:39.899 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:14:39.904 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:15:10.103 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:15:10.108 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:15:40.298 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:15:40.304 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:16:10.468 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:16:10.473 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:16:40.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:16:40.670 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:17:10.852 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:17:10.857 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:17:41.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:17:41.061 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:18:11.243 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:18:11.248 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:18:41.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:18:41.410 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:19:11.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:19:11.582 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:19:41.754 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:19:41.761 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:20:11.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:20:11.947 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:20:42.128 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:20:42.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:21:12.320 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:21:12.326 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:21:42.514 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:21:42.520 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:22:12.713 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:22:12.722 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:22:42.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:22:42.923 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:23:13.130 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:23:13.138 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:23:43.323 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:23:43.332 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:24:13.509 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:24:13.527 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:24:43.726 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:24:43.737 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:25:13.854 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:25:13.860 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:25:44.037 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:25:44.048 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:26:14.248 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:26:14.256 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:26:44.473 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:26:44.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:27:14.690 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:27:14.696 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:27:44.868 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:27:44.886 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:28:15.077 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:28:15.109 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:28:45.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:28:45.324 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:29:15.514 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:29:15.519 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:29:45.690 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:29:45.696 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:30:15.860 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:30:15.865 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:30:45.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:30:45.980 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:31:16.154 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:31:16.159 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:31:46.333 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:31:46.338 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:32:16.525 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:32:16.530 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:32:46.700 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:32:46.705 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:33:16.886 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:33:16.892 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:33:47.082 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:33:47.088 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:34:17.295 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:34:17.302 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:34:47.482 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:34:47.486 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:35:17.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:35:17.682 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:35:47.839 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:35:47.844 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:36:18.027 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:36:18.033 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:36:48.231 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:36:48.236 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:37:18.418 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:37:18.424 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:37:48.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:37:48.611 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-08T15:38:16.301 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-06-08T15:38:16.302 DEBUG:teuthology.task.console_log:Killing console logger for smithi016 2023-06-08T15:38:16.303 DEBUG:teuthology.task.console_log:Killing console logger for smithi169 2023-06-08T15:38:16.303 DEBUG:teuthology.exit:Finished running handlers